The growing fortunes of the 1 percent weren't enough to combat a slowdown in luxury sales over the past year.