The Context, Use & Misuse of Real Estate Statistics
Using, Understanding & Evaluating Real Estate Statistics
By Patrick Carlisle, Chief Market Analyst, Paragon Real Estate Group
Statistics can be an enormously valuable tool for assessing the conditions and trends in the real estate market. However, they are also among the most misused, misquoted and misunderstood “facts” we are bombarded with. The only honest purpose for market statistics is to provide reasonably unbiased information for those trying to make decisions regarding the purchase, sale or ongoing ownership of real estate – typically one of the largest, most complicated (and most emotional) financial investments of one’s life. The problem is that most market analysis is provided by those who want to convince you to do something (for their own financial benefit); or those so fiercely attached to one position or another – the most common being either unrelenting optimism or unrelenting pessimism – that every statistic is twisted to justify that position; and/or those who don’t understand and are not qualified to interpret the data in the first place. Whether delivered by real estate agents, so-called pundits, analysts, reporters, bloggers, special algorithms, or the guy who lives next door, all these situations often lead to the improper use of statistics.
Rule 1: Statistics without informed context are generally worthless. One can make virtually any case, positive or negative, by cherry-picking a single statistic derived from a particular data set and a specific period of time, whether that be the median sales price, foreclosure sales or the latest Case-Shiller Index. Small data set statistics can swing wildly without any significance. Computerized algorithms (Case-Shiller, Zillow) are not as flawless as they are presented to be by the media. The overall national trend may misrepresent California’s; the state trend may misrepresent the Bay Area’s; the Bay Area’s may misrepresent the city’s; the city’s trend may misrepresent the trend in a specific neighborhood, price segment or property type. Within San Francisco and the Bay Area, distinct neighborhood and community market segments often move in different directions at varying speeds.
One needs to know a specific market inside out, from the ground up, first to carefully vet the data for statistical flaws, outliers, or anomalies, and then, standing back to look at the larger picture, to be able to intelligently interpret what it appears to signify for the present and for the future. Having a sense of the longer-term cycles in financial and real estate markets is also helpful: markets neither go up forever or down forever – it’s amazing how often this simple fact is forgotten in the drama of the moment.
Rule 2: Average and median statistics are gross generalities. They often fluctuate up and down in the short term even in stable markets and price statistics are often affected by other factors besides changes in value, such as seasonality, available inventory, financing conditions, buyer profile and significant changes in the distressed-property, new-construction or luxury home market segments. In San Francisco, every month sees a relatively small number of relatively unique properties sell. Median and average values usually disguise an enormous disparity of values among the underlying individual home sales in the data set, and how they apply to any particular property is impossible to say without a specific comparative market analysis (CMA). To value a specific property, an analysis crafted to its exact location, condition, circumstances and amenities, is required.
Rule 3: Any definitive trend will be reflected over the longer term and in more than a single statistic, i.e. not just last month’s median sales price (as quoted in most media articles), but in a wider array of supply, demand and value measures, such as dollar per square foot, months supply of inventory, sales volume, percentage of listings accepting offers, days on market, and so on. We prefer to look at as many different statistical angles on the market as we can think of, to see how they do or don’t line up, and prefer quarterly or longer-term data to ever-fluctuating monthly data. Annual data really allows one to step back and see the larger view, instead of just what is in front of one’s shoe: Long-Term Annual Trends in San Francisco Real Estate
Rule 4: No one knows the future. Again: No one knows or can confidently predict the future. Recent studies* suggest that the confident predictions of financial market pundits and experts are wrong 50% of the time – or more. (One business professor compared them to monkeys throwing darts.) Generally speaking, you would do as well or better just flipping a coin: Think of the years of pundit projections prior to the 2008 financial and real estate markets meltdown. Or here’s another example: Robert Shiller, the Nobel Prize winning economist, who helped develop the respected S&P Case-Shiller Home Price Index (and the complex algorithm behind its calculations) and is certainly one of the most often quoted financial and real estate markets economists in the country, stated in March 2012 that the U.S. homes market was probably still headed down, and that we may “never in our lifetime see a rebound in these prices.” Since then the market has gone through a huge recovery – the market actually started to turn in San Francisco in 2011 – with values up enormously virtually everywhere, according to his own Index. That is, he could not have been more wrong. This is an excellent example of an “expert” who became attached to the anti-optimism position for which he became famous in 2008. We’ve seen hundreds of such examples.
It has been found that the most reliable experts are also the most humble, people who constantly double-check and question their own conclusions. The more confident (or arrogant) a pundit is about what is to come, the more you should distrust their opinions.
Financial and real estate markets are now subject to an astounding number of constantly changing, local, national and international, economic, political and even ecological factors. Changes in the Chinese stock market, Greece debt levels, oil prices, EU elections, tax or immigration law, the bond market, or a new SF ballot proposal, natural disaster, or conflict in the Mideast – all these are samples of the thousands of events that can have significant ramifications for Bay Area real estate. Even a super computer can’t track all the spinning factors and figure out what the future will look like tomorrow.
At Paragon, we are not immune to the failings that afflict other analysts, but we try our best to provide straightforward information regarding market conditions, with as many angles and as much detail and context as possible, so that you can make your own informed decisions. 99% of our focus is on San Francisco and the Bay Area and we don’t believe anyone performs the amount of analysis we do regarding the area’s real estate markets. Very, very few of our charts are created automatically by computer: almost all the data is personally investigated and vetted for anomalies before being charted. We make very few predictions, but when we do make a tentative forecast, with lots of caveats, it is based upon what appears to us to be overwhelming supply-and-demand conditions and decades of experience in San Francisco Bay Area real estate. (But please see Rule 4: We really don’t know the future either.)
The Trends & Analysis link at the top of this page will take you to a wide range of analyses, which we try to keep updated. Please don’t hesitate to contact me if you have any questions or comments.
Patrick Carlisle, Chief Market Analyst, Paragon Real Estate Group, firstname.lastname@example.org