We, too, love the outdoors but could never stand the noisy drunks. It's true that the crowds (at least here in CA) tend to be less diverse than you would think. I haven't been camping in years but I imagine I, too, would have been on edge with a Kevin nearby.
About 20 years ago, we shifted from camping to houseboating. I love that we can literally pull up the stakes and sail to a new cove if someone comes too close and disturbs our peace and quiet. I recognize "running away" means I'm just ignoring the Kevins and Karens to bully others, but as I get older, I don't want to waste any energy to deal with them.
I wrote about houseboating recently (as we just returned from our annual trip) and even mentioned the obnoxious campsite neighbors as a reason to rent a houseboat instead! https://medium.com/illumination/simple-family-vacations-yield-the-sweetest-joy-e8d6e9ccb17a Would love to hear your thoughts.