I think it comes down to visual proportion on the human body. To my eye - if the kilt is too long it makes the legs look short and stubby and the torso looks too long. To me - this looks weak and frail.

Now, how you choose to wear your kilt is of course your business - just wear it and be happy. Personally I prefer to wear my kilts at the top of my knee.