I would definitely wear what is comfortable to you. When it comes to the office, I guess you should wear what they require of you. If they'll let you wear your kilt, then I would try to follow the remaining parts of the dress code as much as possible. Treat the Kilt as a nice pair of slacks.