No need to be too formal, particularly when you say your church dress code is relaxed.
I wear a kilt every time I attend church which is most Sundays and I usually wear it with a polo neck shirt.