Theres two kinds of Harley owners, really. Ones who ride, and ones who, well, own Harleys.
I've never had problems with people who ride, no matter what they ride, be it harleys or anything else.
We all just love to ride, and we all have motorcycles. That's all that matters to me and pretty much anyone else who rides to ride, instead of occasionally riding to make some kind of fashion statement.