My father in law is a pastor (I always said I'd marry a vicars daughter ) and he doesn't seem to mind. Although I never have asked him!
When I see him and I'm in my kilt he just seems vaguely amused and says 'has she, (his daughter, my wife), made you wear that'.
Cheers Rhino