I do not see a problem with it, I have been known to wear a Graham of Mantieth kilt pin on a Gunn modern kilt, My Granmother was a Gunn, she married an Allardyce, sept of Graham of Mantieth, so for me it works.

At least you do have a conection to both so that if the dreaded kilt police show up, you have an answer to thier questions.