Whether you are a Scottish "Brown" or not you might want to apply for membership in one of the clans of which Brown is a sept, and then wear that tartan. Unless you have a genealogical connection to either Clan Lamont or Clan MacMillan, your decision could be based on simple aesthetics-- choosing the tartan you like the most.