I would say not on the Prince Charlie, since that is the equivalent of a tuxedo jacket, and you would not see a crest there.

Wearing it as the equivalent of a crested blazer would be okay in my view.