It's not typically what one thinks of as "New York," but the Cloisters, in northwestern Manhattan, is a beautiful place.
The Museums are all good. Some of the best ancient Egyptian material in the world.
Central Park is huge and free.
Battery Park gives you a nice view of the Brooklyn Bridge, and is close to South Street Seaport Museum.