The wealthy live differently than you and I.

In 2008,  note Reardon and Bischoff, nearly one in three U.S. families in metro areas “lived in neighborhoods at the extremes of the local income spectrum,” in poor neighborhoods with incomes under 67 percent of the metro median or in affluent neighborhoods with incomes above 150 percent of that median.
Today’s affluent, Reardon and Bischoff observe, actually live more segregated lives than America’s poor. These affluent have become “much less likely” to live in mixed-income neighborhoods than poor families.

Growing income inequality is driving increasing residential segregation. 

http://www.alternet.org/hard-times-usa/american-housing-market-set-screw-people-far-future?akid=10072.294211.IEeH9d&rd=1&src=newsletter796377&t=13