I must admit that I prefer casual dress (sports jacket and slacks) for places like upscale restaurants,casinos,or clubs.
I tell my friends that if they see me in a suit, I'll be standing in front of a jury or a casket.
Sport Jacket and slacks is a good look! Nothing wrong with that!
