I've not had a problem wearing a sgian dubh in public, but most of the time I was wearing it with my pipe band uniform. Otherwise, I rarely wear one. Many kilt wearers consider it to be a semi-formal to formal accessory, not a casual accessory.