I'd say it depends on the church.

At some churches, wearing a sweater is dressed up, while at others a suit is the norm.

I doubt there are any churches that go more formal that a suit for typical services.

So just figure the kilt is like a pair of appropriate slacks and select the upper portion accordingly.