In addition to being careful not to catch it on anything, you may want to "reinforce" the attachment in some way so that you don't lose the pin.

Here's a couple of threads:

Why I don't lose my kilt pin

Securing kilt pins