Doing some reading on the Derby's page and it looks like dress code is to where you sit.

In the stands it is the fancier code. Down in the infield it seems to be slightly different. Seems to be a Mardi Gras like party on one end from their discription and a G-rated family picnic style on the other.

Jim