Don't see how hand brushing a wool kilt would cause any more "damage" to the garment than hand brushing a wool suit.

No clue about the vacuum and brush - the vacuum brushes seem much softer than brushes intended to brush wool suits/kilts