Why Automation Is Killing the Property Appraisal Business
By Benjamin Keys and Stan Humphries @ Wharton School
August 22, 2017
Wharton's Benjamin Keys and Stan Humphries, Zillow.com, recently appeared on the Knowledge@Wharton on SiriusXM to discuss the changes in real estate

EXCERPT: Property assessment has long been a solid industry with steady work for those willing to undertake the education and training required to enter the field. But that stability is changing thanks to automation. The number of appraisers is shrinking as software gets more accurate at valuing property and is increasingly integrated into the sale process. Benjamin Keys, Wharton professor of real estate, and Stan Humphries, chief analytics officer at online real estate marketplace Zillow.com, recently appeared on the Knowledge@Wharton show on SiriusXM channel 111 to discuss the changes and where the industry is headed. 

Following are key takeaways from their conversation: Listen to the Podcast

The margin of error is decreasing as automation improves.

Zillow offers a tool it calls Zestimate that uses input factors to determine the worth of a property. The Zestimate, which has been around since the website’s inception in 2006, cannot be considered an official, certified appraisal. But it’s a start, said Humphries. It’s also getting better as the company pours more resources into research and development.

“Back when we launched, we put in about 43 million homes and had a median error rate of close to 14%,” he said. “Today, we value about 100 million homes every single night and our error rate is down to 4.3%. So, we’ve made a lot of advances in the accuracy of valuing homes.”

Zillow is pushing for even greater precision. The company is offering a monetary prize for its teams that can get the algorithm’s error rate down to 2% or 3%.

“Computerized models are going to get very accurate, although in the end there’s probably some role for human beings to be involved there,” Humphries said. “The question is, what is that role of that human being? Right now, appraisers are professionals. They have a high degree of discretion, and there’s a bit of an art to what they do. In the future, there is a role to make sure that the facts the computer is using are accurate, but that’s more of a technician type job as opposed to professional.”

Keys credits Zillow for improving virtual assessment methods and said automation is an undeniably growing part of the industry.

“I think it’s only a matter of time until the technology is strong enough and cheap enough, from the standpoint of the lenders and the buyers, to cut out the humans from this process and move to more of an algorithm-based process,” he said.

Recommended For You

Digital appraising can reduce confirmation bias.

Keys underscores that buying a home is a relatively infrequent transaction for the average American, so individuals have limited expertise in the valuation process. That’s where the professional appraiser comes in. He or she makes a reasonable assessment by examining a set of comparable properties nearby and making adjustments based on the finishes and other elements of the home.

“If I see a sofa on Craigslist; I don’t hire an external appraiser to argue about whether it’s worth $100 or $200,” he said. “But in this case, there’s a third party with money at stake, and that’s the lender or the investors. They want to make sure that their investment is appropriate and the value of the house is appropriate for the transaction.”

Still, even the most professional appraisers are vulnerable to the forces of the real estate market.

“One of the things we observed during the housing boom was a lot of pressure on appraisers to hit various prices, so the incentive problems there are really deeply entrenched,” Keys said. “The deck is already stacked to hit a certain appraisal number. That’s really problematic and can also lead to a driving up of house prices. All of these things are pointing towards the potential for technology to play a really important and potentially beneficial role.”

As comparable properties sell for higher and higher prices, the pressure on the appraiser increases. An appraiser who wants to hold the line on the price of a property runs the risk of not getting subsequent business.

“There have been a number of layers of regulation put into place to block that type of behavior where you’re shooting for a particular number,” Keys said. “But it is the case that the historical appraisal process led to the risk of being gamed and the risk of ratcheting up prices.”

Humphries agreed, saying there are countervailing incentives in the process.

“If you look at appraisal accuracy over a long period of time, 90% of the time appraisals come in above the purchase of sale agreement,” he said. “That leads you to believe there’s confirmation bias there, that appraisers are not individually valuing that home but justifying the price that’s already been agreed to. Normally, that doesn’t get you into that much trouble because home prices are increasing.”

However, the 2008 recession and real estate market collapse illuminated the problem of inflated home prices. The experts said automated appraisals could help take some of the air out of the balloon.

“Computerized models are going to get very accurate, although in the end there’s probably some role for human beings to be involved there.” –Stan Humphries

Continues at The Wharton School of the University of Pennsylvania.