Why do people see this as a problem in my town?

Don't listen to them. I consider you more of a man than these so called gropers. Seems to me they are the immature ones. And good for you for respecting woman. You are going to meet someone worth meeting, a girl who respects you too. Not a girl who wants every Tom, and Harry touching her inappropriately. Don't let anyone change you or make you feel like there is something wrong with you because there isn't. They are the ones who need the adjustments done.