Can our condo association ban rental units?

What are the consequences of not allowing rental for our units? We have a wonderful situation here with 24 units. Some owners have rented their units and we feel it will destroy the entire development.