I don't really mind what people come to a gym to do, they all pay their memberships; but as long as they're actually there to work out.
What I can't stand are people just loafing around turning it into more of a social club than a gym. Disperse any large groups of (usually) youths standing around. Apart from that I'd let people get on with it. I'm not a big fan of too many rules.