How do you get over public anxiety

I have gotten a camera and lenses I like but never want to use them publicly. Like at parks or on the side of the road. It's just scary, what if people freak out and think I'm taking pictures of them. I suppose it's just I don't want to be confronted. But what are some ways to go about getting into somewhat public places to take pictures.