You know where I've had historically good and unexpected luck? The Daffy's in Herald Square. It's not as big a clusterfuck as Filene's, but you do have to look a little harder.

Fortunately, the semi-formal/formalwear section is pretty small. Maybe worth a shot.