Charles Plott (a big-shot economist) condemns all the hype surrounding the prediction markets and the wisdom of crowds.

No Gravatar

California Institute of Technology economist Charles Plott:

What you&#8217-re doing is collecting bits and pieces of information and aggregating it so we can watch it and understand what people know. People picked this up and called it the &#8216-wisdom of crowds&#8217- and other things, but a lot of that is just hype.

The Rise of Crowdsourcing: Creative Wisdom of the Crowd – Tuesday, May 20th, 2008 at 6:00pm – @ Bo Cowgills Alma Mater

No Gravatar

The Rise of Crowdsourcing: Creative Wisdom of the Crowd – @ Stanford Business School, Stanford University, California, U.S.A. – 2008-05-20

&#8211-&gt- Predictify &amp- Cambrian House

Via Daniel Horowitz (Business and Technology Consultant)

Collective Error = Average Individual Error – Prediction Diversity

No Gravatar

The Brain has a comment on Scott Page&#8217-s presentation [PPT file] about his book, The Difference:

One question is whether there is a way to usefully systematize that principle by trader selection or via something other than a strict market such as an (incentivised) weighted average system like HP’s BRAIN. The latter type of system will work better in some domains but in general might be less robust because it constantly runs the danger of being overfit to past trader correlations (or apparent expertise, risk appetites, etc). In general, trader self-selection and self-weighting might be more accurate. If you have some metric of “fundamental” trader similarity like proximity, org chart relations, demographic data – as opposed to past trading correlations only, that might work better in terms of expert-selection/expert-weighting.

The Difference

Previous blog posts by Chris F. Masse:

  • BetFair-TradeFair has won its second Queen’s Award for Enterprise in its eight-year history.
  • Inkling Markets is one of the “Hot Companies To Watch In 2008”, according to Forrester.
  • Plenty of great news coming from Inkling Markets in the coming weeks
  • ??? charity-driven prediction markets OR social issue prediction markets ???
  • That can’t be Nigel Eccles of HubDub.
  • The Marketing Of The Reading Of The Public Prediction Markets = What Robin Hanson has deep trouble with, and what the prediction exchanges (e.g., InTrade-TradeSports, BetFair-TradeFair) haven’t fully computed yet
  • In 2013, Enterprise 2.0 will be a $4.6 billion industry. Good. But they forgot to mind the enterprise prediction markets.

The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies

No GravatarThe Difference

Via Emile Servan-Schreiber (who claims it&#8217-s the supportive evidence for The Wisdom Of Crowds)

Has somebody read that book?

Previous blog posts by Chris F. Masse:

  • The Most Surprising Piece Of News I’ve Heard Today
  • My first prediction market plugin for WordPress
  • Self-Serving Prediction Market Of The Day — Unlawful Internet Gambling Enforcement Act of 2006
  • Prediction markets tend to be so illiquid, though, that mere activity looks like volatility.
  • Decision Markets and Futarchy are solutions in desperate search for a problem to solve and for their early adopters… and that may stay that way well after Robin Hanson’s head gets cryogenized.

La Sagesse Des Foules

No Gravatar

Good news this week for French-speaking Midas Oracle readers: The French version of Surowiecki&#8217-s book has at last been released. Here&#8217-s wishing it the success it deserves! Early reviews are very positive: One reviewer writes poetically about &#8220-crowds so wise that they become revolutionary.&#8221- Cute, and telling: As the country celebrates the student uprisings of April-May 1968, when Mao&#8217-s little red book was a must read, Surowiecki&#8217-s manifesto is indeed perfectly timed to launch a new cultural revolution.

La Sagesse des Foules

Who did best in explaining the prediction markets to the lynching crowd?

No Gravatar

After the New Hampshire fiasco, 16 18 people came to defend the prediction markets, so far. So far, the best takes are from:

  1. George Tziralis
  2. Robin Hanson
  3. Jonathan Kennedy
  4. and I&#8217-ll give the 4th spot to a combo, mixing takes from John Tierney, Adam Siegel (surprisingly pertinent &#8211-I bet he is on a fish diet, post Christmas :-D ), and Steve Roman.
  5. UPDATE: &#8220-Thrutch&#8220-, Emile Servan-Schreiber and Panos Ipeirotis.

AWOLs (so far): PMIA, AEI-Brookings, InTrade, TradeSports, BetFair, TradeFair, NewsFutures, Emile Servan-Schreiber, Jed Christiansen, Koleman Strumpf, Bo Cowgill, Richard Borghesi, Chris Hibbert, David Perry, Ken Kittlitz, Paul Tetlock, David Pennock, Mike Linksvayer, Brent Stinsky, David Yu, Mark Davis, David Jack, James Surowiecki, Tyler Cowen, Greg Mankiw, Donald Luskin, John Delaney [*], etc.

[*] Steve Bass tells us that John Delaney&#8217-s pre-NH CNBC appearance was awesome. I was up that day, waiting for that CNBC segment, but failed to spot it. If somebody sends me the YouTube link, I&#8217-ll publish it here.

GIGO and prophets, tears and markets

No Gravatar

Prediction markets failed to accurately predict the unexpected effect a few tears had on the New Hampshire primaries- and some analysts rushed to blame the tool and undermine its reliability and applicability. Let me restate some fundamentals and my view, in a snapshot:

  • Markets are not prophets, prophets do not exist.
  • A mechanism&#8217-s forecastability should not be judged against a virtual fool-proof prophet- we&#8217-d better compare it with other existing or widely-used mechanisms and -to my partial and context-bound knowledge- markets outperform all those.
  • Markets are the only tool that intrinsically suggests their probability of failure. If Obama&#8217-s stock is traded at 70 cents, this suggests that there is a 30% probability of Obama losing- I&#8217-d say markets are by character modest and no fanfare has any place in describing their suggestions.
  • Markets are primarily an aggregation/meta mechanism- as such, garbage-in-garbage-out effects are expected to happen, so we&#8217-d need to keep focus on minimizing garbage rather than blaming the market/compiler.
  • Maturity of the mechanism and its use, as long as trading volume (in real-money intrade for example), have not yet reached a fully efficient level (more on this to come soon), but these result in significant profit opportunities, so I expect things to just keep getting better.

cross-posted from my blog

THE SILICON ALLEY BLOG COMES TO THE RESCUE OF THE PREDICTION MARKETS.

No Gravatar

Silicon Alley&#8217-s Jonathan Kennedy:

[…] In denouncing prediction markets as &#8220-wrong,&#8221- however, many pundits miss the point. Prediction markets do not provide accurate predictions of the future. (How could they? They simply represent the consensus guess of a group of people who aren&#8217-t prophets). They merely provide the most-informed guess as to what that future is likely to be.

As numerous &#8220-collective wisdom&#8221- studies have shown, the consensus guess is always better than the majority of the individual guesses that are factored into it (not sometimes&#8211-always). The collective wisdom, moreover, is often more accurate than that of ANY individual. Why? Because the market collectively incorporates far more information than is available to any one individual.

Like the stock market, prediction markets don&#8217-t get it right every time. They do, however, provide a useful window into the collective expectations of others&#8211-one that is often the best available estimate of the future. And they do sometimes get it right. Just as they did with Mr. McCain.

Bravo, mister Jonathan Kennedy.

&#8212-

Take that, Barry Ritholtz. :-D

In an upcoming post, we will review the strengths and weaknesses of these thinly traded prediction markets&#8230-

We are holding our breath, Barry. Hurry up.

Prediction markets = A tool for quantifying the conventional wisdom

No GravatarEric Zitzewitz responded to Paul Krugman:

Almost all of the serious people who study or work with these markets are not in the “markets are magic” camp.

My work in this area (with Justin Wolfers usually and Andrew Leigh and Erik Snowberg occassionally) uses these markets as a way of quantifying the conventional wisdom.

This has more value than may be immediately apparent. It can help you get from “the market rose 0.25% in response to Obama’s Iowa victory” to “the market rose 0.25% in response to Obama’s Iowa victory, which raised his nomination probability by 20% and did not affect the Democrats odds of winning in November” to an estimate of how much more stocks will be worth under Obama than Edwards or Clinton.

In corporate settings, a market can help turn something that “everyone knows” into an objective fact that can then be acted upon. The best example is probably markets on whether software projects will be completed on time– if a market run among the project team members says that the launch will be 2 months late, it becomes harder for the project manager to insist that everything is on track.

Eric Zitzewitz
Assoc. Prof. of Econ
Dartmouth College

Thanks to Jason Ruspini for the link. Jason also posted a comment on Paul Krugman&#8217-s post, and also on Felix Salmon&#8217-s post.

Previous blog posts by Chris F. Masse:

  • NUCLEAR SCANDAL: HubDub allow their traders to bet on celebrities’ death.
  • APRIL FOOL’S DAY: This year, again, CNET makes fun of the wisdom of crowds.
  • Play-money prediction exchange HubDub is a phenomenal success.
  • BetFair Australia’s spin doctor tells all about their payments to the horse race industry.
  • Meet Jeffrey Ma (at right on the photo), the ProTrade co-founder, and whose gambling life is the basis of the upcoming movie, 21.

Prediction Markets = the greatest time-saving invention of this century

No Gravatar

John Tierney (and again this morning):

[…] Keeping up with a presidential campaign used to require at least an hour a day of wading through punditry, and much more time during the peak primary season. But now, with a few clicks on Intrade, you can see the accumulated expertise of thousands of people betting on the campaign. […]

That&#8217-s what I mean by &#8220-Prediction markets are forecasting tools of convenience that feed on advanced indicators&#8220-.

I will have another post on John Tierney&#8230- if Barry Ritholtz delivers on his promise to write up on prediction markets.