I expect you will get varying opinions on this question. I would say a blue or green waistcoat could work with the MacDuff modern, if the tweed is dark or neutral and with a white or neutral shirt.

You will definately not blend into a crowd though. Red might be a bit much and would have to match the red in the tartan very closely. Black, gray, or tan would tone it down a bit.