Personally I have always tried to have all the leathers match. I have a brown belt and sporran from Celtic Empire that match, so with those I oftern wore brown dree shoes, or brown work boots for casual. I find brown a bit more casual than black to begin with though.

However, the rule of thumb I have read before, is that at the very least your belt and sporran should match.