As long as you are sure about how casual the rest of the guest will be the outfit sounds grand. Personally I am one of those people who couldn't show up at a wedding without at least a jacket and tie, but then again I don't live in Alaska.