Tom Davenport The Next Big Thing RSS Feed

When Economists Make Predictions, Remember: Nobody Knows Nuthin'

12:11 PM Wednesday October 29, 2008

Tags:Economy

The current economic crisis is further evidence that nobody really knows the future of our domestic or global economy. While there are a few economists who predicted aspects of the current situation (Robert Schiller of Yale predicted a housing bubble collapse in 2005, and Nouriel Roubini of NYU has predicted a systemic financial collapse for several years), nobody predicted all the manifold aspects of this crisis and how they would come together.

And some futurists got things spectacularly wrong. Remember, for example, Kevin Hassett and James K. Glassman, who wrote the book Dow 36,000 in 1999? Only a few more declines like those of last week, and they'll be off by a factor of 10. With such economic perspicacity, perhaps they should be working for the McCain and Bush economic teams. Wait, this just in -- according to an article in Monday's NY Times, that's exactly what they're doing. As Monty Python used to repeat, "Say no more..."

And how about Peter Schwartz and Peter Leyden, authors in 1997 of The Long Boom? This article, first published in Wired magazine and then expanded into a 1999 book (with a third author, Joel Hyatt), argued that things were just going to keep getting better and better. With information technology and the Internet, and the expansion of democratic capitalism, how could the economy do anything but grow? Well, I suppose it could also shrink.

I think that people should be held accountable for their predictions. One hopes they will be embarrassed enough to refrain from wasting our time and trees on future predictions. Maybe we should construct a giant prediction market, and force futurists to buy options on their predictions coming true.

I suppose it's useful for futurists to be provocative, but we should recognize that the economy is too complex and interconnected for anybody to really know what's going to happen with it. Economists don't have good models that reflect all the complexity, so they are just guessing like anyone else. Those that don't employ data are even worse -- there is nothing to constrain them at all.

Because the economy is highly interconnected these days, the swings that do happen often turn out to be violent. Today there's a 900-point upswing, tomorrow probably a 900-point downswing -- and that's just the Dow. It's probably safe to predict dramatic change -- we just don't know the direction. Futurists don't typically predict small change anyway, because it wouldn't be interesting to read about. But economists do -- their predictions are frequently aggregated and compared, so anyone whose predictions stand out gets beaten down. Other than Roubini, who doesn't issue numeric forecasts, I don't know of any who predicted how truly awful this year's economy would be.

Of course, it's not just economic experts that have a poor record of prediction. Philip Tetlock's research on political experts (summarized well in a Louis Menand review in the New Yorker) suggests that they also have a very poor track record. If you want accuracy, better stick to history.

People who read this also read:

 
* * *
Sign up for the Weekly Hotlist, a weekly email roundup featuring the top posts from HarvardBusiness.org and HBR.org.

Never miss a new post from your favorite blogger again with the HarvardBusiness.org Daily Alert email. The Alert delivers the latest blog posts from HarvardBusiness.org and HBR.org directly to your inbox every morning at 8:00 AM ET.


Trackbacks

TrackBack URL for this entry:
http://blogs.harvardbusiness.org/cgi-bin/mt/mt-tb.cgi/3110

No trackbacks have been made to this entry.

Comments

Good post Tom. This is why predicting the future is so difficult. As for making the predictors accountable, you may want to check out http://www.longbets.org/

Maybe you know about this site already.

- Posted by rajagopal sukumar 
October 30, 2008 12:17 AM

Tom, this is very interesting !! Certainly I have never thought like that. You supported it with names etc which brings a lot of credibility with what you say.

Cheers and thnks
Anshil

- Posted by Anshil 
October 30, 2008 3:48 AM

It is a great aspiration but somehow people always gravitate towards confident predictions about the future no matter how often it is proven that oracles don't exist.

We actually ran a 4 month experiment called Pundit Watch were we tracked the performance of 9 of the US's top pundits across politics, entertainment and technology. In general we found no correlation between accurate punditry and readership. Here are the results: http://punditwatch.hubdub.com/

- Posted by nigeleccles 
October 30, 2008 5:41 AM

I think that predictions should be accounted as a variable within the model. The predictions mass can shift the public's expectations and change minds, thus affecting the real outcome.
It may become an economics uncertainity law: issuing a prediction automatically changes the outcome. That is, a predicton may never come true.

Regards

- Posted by Stray Cat 
October 30, 2008 7:40 AM

there are always some people who can show where the market bubbles are or potential threats for economic stability but nobody knows which one will finally burst out.. even the stocks market bubble?? i was reading that housing bubble we have in europe but in the US. living for credit and consumption was always like a normal stereotypical feature of america and it always looked a bit strange and everybody knew about it.. it always looked like a potential threat for stability (but it was possible to claim that its just the way america looks among others till it burst) and there was only one small and OBVIOUS bug - interest rate relation to mortgage loan rate and also to prices of houses (its actually strange that internal risk measurements in these banks did not take under consideration such risk).. and second commonly known feature of american economy which is freedom and high risk acceptance.. people are like not scared to take the risk of any investment which on one hand of course is like a blessing - eg. i heard that before internet bubble Google got soem 1 mln$ check from some investor in soem dining space at the Stanford university jus to make sth of it..

- Posted by Ania 
October 31, 2008 7:40 AM

A futures market on the likelihood of a given prognosticator's prediction being accurate? Too many variables. Fun idea, though, particularly if we can work immersion in a dunking tank into the concept.

- Posted by Bill Reith 
November 1, 2008 11:48 PM

A book, The Black Swan: The Impact of the Highly Improbable, has said it all: economists and media really know nothing about what they are doing when it comes to prediction.

- Posted by James 
November 25, 2008 9:05 AM

Join The Discussion

* Required Fields




Verification (needed to reduce spam):

Posting Guidelines

We hope the conversations that take place on HarvardBusiness.org will be energetic, constructive, free-wheeling, and provocative. To make sure we all stay on-topic, all posts will be reviewed by our editors and may be edited for clarity, length, and relevance.

We ask that you adhere to the following guidelines.

  1. No selling of products or services. Let's keep this an ad-free zone.
  2. No ad hominem attacks. These are conversations in which we debate ideas. Criticize ideas, not the people behind them.
  3. No multimedia. If you want us to know about outside sources, please point to them, Don't paste them in.
We look forward to including your voices on the site - and learning from you in the process.

The editors

Tom Davenport

Tom Davenport holds the President’s Chair in Information Technology and Management at Babson College, where he also leads the Process Management and Working Knowledge Research Centers. His books and articles on business process reengineering, knowledge management, attention management, knowledge worker productivity, and analytical competition helped to establish each of those business ideas. His website is tomdavenport.com

Introducing The Next Big Thing

Favorite Links

Learn how business innovators like Amazon's Jeff Bezos and Pixar's Ed Catmull achieve breakthrough results.
Harvard Business Review

ADVERTISEMENT

Browse Our Store

Productive Business Dialogue (Simulation)

This simulation will help you learn how to craft conversations that are fact based, minimize defensiveness, and draw out the best thinking from everyone involved.

Measuring Marketing Performance

In many organizations, marketing exists far from the executive suite and the boardroom. Learn how to improve the link between high level corporate strategy and the marketing function.

Management Tip of the Day Enrollment
SPONSORED BY:  

ADVERTISEMENT

Free Downloads