To set up operations in NYC, most companies usually target New Jersey - which is in close commute-able proximity to NYC, and choose a nice location. I am not from there, but here are some ideas about space and how much they cost - say in Orange, NJ. Looks like $2 a sqft. per month, which is not bad. Maybe someone here who lives in that area can comment. About which location in New Jersey, I'd talk to a real estate agent from there. There are horrible unsafe areas in NJ (Perth Amboy and vicinity for example) which you cannot go into after dark. Ditto for NYC (Bronx and Hell's kitchen come to mind where you can't even go into in the daytime!).
Find your next office space to rent in New Jersey. Browse thousands of listings to find the right fit for your company.
www.officespace.com
Also - if you want to be able to get to Newark airport in New Jersey for travel (if that is a concern), choose an office location near that airport, which S'pore Airlines (SQ) serves non-stop from their hub in S'pore. It is the world's longest non-stop flight at 18 hours though LAX-Dubai at 17.5 hours comes pretty close (also some others).
For the inaugural of the world's longest flight, we decided to test how Singapore Airlines premium economy would be for 18 hours. Here's what we found.
thepointsguy.com
Newark is also a nice airport to connect to NYC from the rest of the US, Mexico and Canada. Although Outside NYC, Newark in NJ is considered as important as La Guardia and JFK for NYC area airports.
en.wikipedia.org