Are you looking exclusively in the theater district? There are lots of nice brunch places in Chelsea and around there, from there it's a quick 5 min subway ride back to Times Square or a leisurely ca. 30 min stroll.
If you're willing to go out of the theatre district, Galloway Green offers a nice brunch at the McKittrick (where Sleep No More is) and during the spring/summer it's on the rooftop. I also love the brunch at the Smith by Lincoln Center.