This is going to sound weird but it's possible that you're retaining too much water weight as the day goes on. You could always try taking those water pills for a day or two and see if it helps. Water pills will use up the water in your system so it may dehydrate you also, so be careful. But if you're feeling bigger later in the day it may be the cause.

good luck!