One of the great evolutions in real estate during the past decade is the power of the Internet, and more than 90 percent of home buyers begin their search there. We think that’s great, and buyers are more empowered than ever with loads of information.
Some of that information can come from sites like Zillow that offer what’s called an “automated valuation model”—AVM for short—that purportedly offer a great estimate of the current market value of millions of homes. It’s cool technology, amassing an enormous amount of information from publicly available sources in one place that is then scrubbed through very sophisticated algorithms to predict value. And all of that is typically presented in an easy-to-use interface. There’s just one problem: Those predicted values are wildly inaccurate and inconsistent.
We check on the accuracy, or lack thereof, of these sites every year. We identified almost 300 properties throughout the Washington, DC, metro area that went to settlement in the first two weeks of September 2012, and compared their actual sales prices to the predicted values from three prominent AVMs —Zillow, Eppraisal and Chase Home Valuator —as well as the relevant taxing jurisdiction’s current assessments. To be as generous as possible, we excluded new homes since it would be unlikely that any of these AVM sites could have the details on just-completed homes. We selected all types of homes—condos, townhomes and detached—across all price ranges. To top it off, we looked at the predicted value after the properties had gone to settlement, knowing full well that the AVMs could have had the opportunity to update their models with the actual sales price. We broke the results down by area, and the chart below shows the dismal results of the 70 homes evaluated in Montgomery County.
|Montgomery Co.||Zillow||Eppraisal||Chase||Tax Value|
|Within 20% of SP||93%||71%||91%||69%|
|Within 10% of SP||71%||39%||81%||46%|
|Within 5% of SP||47%||24%||54%||29%|
|More than 5% high||30%||20%||12%||49%|
|More than 5% low||23%||56%||34%||22%|
Chase was the “best” of the bunch, getting within 5 percent of the actual value 54 percent of the time—but, unlike the other sites, their accuracy went up because they had updated their data with the new sales price in six cases.
We call this the “horseshoes and hand grenades” home valuation model. You know the old cliché that "close" only counts in horseshoes and hand grenades—well, “close” isn’t nearly good enough when it comes to valuing a home.
That’s precisely why we don’t offer the estimated values from any of the sites on our website—we think our clients deserve up-to-date knowledge about the market, not just a data dump.
Before you decide to put a lot of confidence in these AVMs, consider this comment in an email to us from a senior Zillow executive this summer when we complained about the problems caused by the inaccuracy of their “Zestimates” of value: “You are correct—this is nothing new for any of us. But because consumers are so fond of the Zestimate, it is not going anywhere.” OK, we get it—they know it’s inaccurate but don’t really care because it brings eyeballs to their site. But since they know they’re not accurate, we think you should too.
NEW CONTRACT ACTIVITY
- The number of new contracts ratified in August 2012 was up 6.1 percent from the number of contracts ratified in August 2011.
- Contract activity YTD is up 2.8 percent.
- Also, 37.9 percent of all homes going under contract in August 2012 had a price reduction before going under contract.
- And, 47.7 percent of all homes going under contract in August were on the market for 30 days or fewer.
- The overall supply of homes on the market at the end of August was just 2.5 months, down from 3.6 months at the end of August 2011.
- The supply of homes priced less than $300,000 is just 40 days.
- In addition, the supply of homes in every price range is lower now than it was this time last year.