Well, the Veep was nice about it. Kudos to him for that. And after all, it IS just another article of clothing.

On the other hand, I bet you're a skilful, smart, talented fellow and you know, there's another job out there with your name on it.

It just depends on what you want to do, and of course, there's no rush.