"Yes, a parade of common sense and FREEDOM!!"

I usually just say what you say, "No - I enjoy wearing the kilt."

Or you can say yes and toss in the dates of the next nearby Highland Games.

If you wanna really befuddle them then after they ask look at your watch and give them the time. See if they point out that's not what they said. After you can say, "Oh, I heard you wrong, sorry, today is - " and give them the day of the week.

Chances are they'll walk away...