My first time wearing a kilt was on St. Patrick's Day as well. I then didn't wear it for a while, and after a few months just decided to go for it and wear it all the time. I got a little good-natured ribbing (I worked in an office with all women except for me), but otherwise it went over just fine, and everyone respected my choice to wear what I wanted.

Good luck!

Andrew.