For the life of me, I can't figure out why that bothers you.

The kilt looks like a skirt to many un-educated. They see you as a man in a skirt. You're not, but that's the way that they see you.

Go with it. Who cares?

Ooooooooooooooo a man in a kilt! Wooooooooooohoooooooooooo!

You've been kilted for a while now, aren't you used to it?