New York City’s shrinking middle class is now in full retreat, as masses of our most endangered population depart the city in numbers not seen since the Depression, according to analysts.