The Michigan primary as seen thru the prism of the InTrade prediction markets

No Gravatar

Michigan, U.S.A. &#8212- Tuesday, January 15, 2008

&#8212-

The Democrats

The Hillary Clinton event derivative was expired to 100.

MI Dem Clinton

MI Dem Obama

MI Dem Edwards

MI Dem Field

&#8212-

The Republicans

The Mitt Romney event derivative was expired to 100.

MI Rep Romney

MI Rep McCain

MI Rep Giuliani

MI Rep Field

Source: InTrade

Five Reasons the Prediction Market Critics Are Wrong.

No Gravatar

1. It really was an upset – As it has been pointed out elsewhere, the Clinton victory was a surprise to everyone. Favorites can lose. But so what? Ordinarily, that’s not a market flaw or a reason to doubt the odds shown in the market.

Justin Wolfers article in the WSJ had the best summary:

Against this background, it is no exaggeration to term the result truly historic. Not that there haven&#8217-t been more dramatic upsets or come-from-behind wins that carried more significance &#8212- this was just an early primary, albeit a pivotal one. But in terms of unpredictability, or at least the failure of everyone to predict it, it may have no modern match.

Historical comparisons are already being drawn between the New Hampshire primary and the famous 1948 presidential race…Yet the magnitude of the Clinton surprise is arguably even greater&#8230-Thus, Sen. Clinton&#8217-s victory on Tuesday was more surprising than President Truman&#8217-s in 1948.

Given the above, were the Clinton prices on Intrade very far off? It&#8217-s not obvious that they were.

2. Pundits/Critics are NOT traders – If I believe a contract should be trading around 30 and I see it trading at 7, it would make my day. As a trader, seeing a contract that is clearly mispriced is a good thing. Traders who remember the French politician Le Pen’s strong showing in 2002 vs his polls or who read Steve Sailer’s blog should not be surprised that people are dishonest with pollsters. However, to a pundit, an isolated incident of mispricing means the entire concept of prediction markets is faulty.

Since NH results, pundits have been asking, “Are prediction markets flawed?” The traders who make and move the market don’t believe so- they are trading more than ever. In any case, there were no postings on the 7th of January about how wrong the prediction markets are, only after-the-fact postings demonstrating perfect 20/20 hindsight. Traders, not critics, will determine the success of the prediction markets.

Let us not forget that pundits have an agenda too. For some, especially political ones, they need to present themselves as being able to offer insight that no one else has. Since prediction markets allow events to be quantified in real time, the pundits have less to add. This makes critics especially eager to take some of the shine off prediction markets and make themselves look smarter by comparison.

Additionally, there is a contingent of commentators and bloggers with an anti-market bias who delight in seeing any market based tool be wrong. They will be the first to loudly smear PM errors but no where to be found when the market turns out to be right.

3. PMs are not polls – This common mistake is exemplified by this quote from the Chicago Tribune, “The New Hampshire primary was a reminder that prediction markets, where bettors are putting money on the line, can have no more value than opinion polls, where participation costs nothing.” This critic missed the point and doesn&#8217-t realize he is comparing apples and oranges.

Most commentators have focused on the accuracy of the market prices without touching on the underlying purpose of the market: speculation and hedging. Even if the polls are no more accurate than the market, they still can’t be used for trading functions.

4. Regulations have hurt the accuracy and liquidity of PMs – The inconvenience of opening a trading account at Intrade has excluded many Americans from participating. What is the cost of accuracy to the PMs? Surowiecki’s The Wisdom of Crowds lists four factors necessary for a wise crowd: diversity of opinion, independence, decentralization, and aggregation. At least two of these have been highly restricted due to regulations. Even so, the market is usually more accurate than the polls. None of the critics has pointed out that with so many potential traders cut off from trading, the market is surely excluding informed participants.

5. “Serious people who study or work with these markets are not in the &#8216-markets are magic&#8217- camp” – Prediction markets are like other financial markets: fat tails, black swans, bubbles, “manipulations” etc. These are all visible in housing, equities, and fixed income markets as well and no one speculates about the end of those instruments. As Eric Zitzewitz pointed out, the “markets are magic” crowd is just a strawman and not a logical basis to attack prediction markets.

Digg Link:

http://digg.com/business_finance/Top_Five_Reasons&#8230-

HUBDUB = where the news shape the future

I like the motto dreamed up by Nigel Eccles and his Scottish team. [I think they&#8217-ll come up with a play-money prediction exchange, but I&#8217-m not sure exactly what they are doing up there.]

And he, too, has come up to the defense of the prediction markets.

[I have updated my list of PM friends. Quite a long list now.]


Author Profile&nbsp-Editor and Publisher of Midas Oracle .ORG .NET .COM &#8212- Chris Masse&#8217-s mugshot &#8212- Contact Chris Masse &#8212- Chris Masse&#8217-s LinkedIn profile &#8212- Chris Masse&#8217-s FaceBook profile &#8212- Chris Masse&#8217-s Google profile &#8212- Sophia-Antipolis, France, E.U. Read more from this author&#8230-


Read the previous blog posts by Chris. F. Masse:

  • Barack Obama is the 44th US president.
  • We already have prediction markets in future tax rates. It’s called the municipal bond yield curve.
  • DELEGATES AND SUPERDELEGATES ACCOUNTANCY
  • O’Reilly – Money-Tech Conference
  • Google Profiles
  • Event Derivative Exchange HedgeStreet is baaaaaaaaack… from the grave.
  • Sports Derivative Forum

Justin Wolfers aftermath article in the Wall Street Journal

No GravatarNot his best piece.

I&#8217-m sure he&#8217-ll produce a better piece on Freaknomics, or Marginal Revolution, later on. Or in one of his papers.

Previous blog posts by Chris F. Masse:

  • Last year’s best April Fool’s Day Joke had something to do with the Wisdom Of Crowds.
  • Will HedgeStreet USA, the hypothetical InTrade USA, and the hypothetical TradeFair USA, be regulated in the future by a merged SEC+CFTC regulatory structure?
  • WORST THAN ELIOT SPITZER (if it were possible): Formula One boss, Max Mosley, had sado-masochist sex with 5 prostitutes, for 5 hours (!!), reenacting a concentration camp scene (!!) in which he played the role of both Nazi guard and inmate.
  • Is BetFair Poker a booby trap for the gullible novices? Does The Sporting Exchange (the operator of the BetFair brands) help gangs plucking down innocent recreational poker players?? To get an inkling, don’t read The Guardian, seeded by the BetFair spin doctor- read Midas Oracle.
  • The video that the technologically retarded BetFair spin doctor should watch.

The prediction markets reflect the polls and the national media.

No GravatarJason Ruspini:

In general, futures markets are &#8220-less futures markets than immediate-past markets&#8221-.

It is hard to evaluate the markets fairly given how difficult it is for someone in New Hampshire to participate in them. Naturally then, the [prediction] markets more easily come to reflect the polls and national media – which were wrong in this case. (Here, the left-leaning media fell in love with Obama, while the right-leaning media happily went about trying to bury the Clinton &#8220-dynasty&#8221-. Consider the tremendously misleading FOX NEWS clip that PoliticalBetting.com linked to over the weekend.)

The legal situation also damages liquidity to the point where these markets are usually manipulated at the margin, as traders with momentum sense a rout and begin to engage in predatory trading, i.e. pushing prices to extremes to force capitulation and/or margin blow-ups.

Dr. Servan-Shrieber&#8217-s comment suggests that these market errors might persist even in modern regulatory regimes like Holland, and corroborates the excellent Erikson/Wlezien paper. Leaving aside the question of significance, Erikson and Wlezien have apparently found a market inefficiency, but since markets can take this into account (they are a &#8220-meta forecasting tool&#8220-), we should expect it to dissipate over time.

Read the previous blog posts by Chris F. Masse:

  • Bzzzzzzzzz…
  • Bzzzzzzzzz…
  • “No offense, but I think Radley Balko is the most valuable blogger in America right now.”
  • Are you a better predictor than John McCain?
  • What does climate scientist James Annan think of InTrade’s global warming prediction markets?
  • Inkling Markets, one year later
  • One trader’s view on BetFair’s new bet-matching logic

Prediction markets are forecasting tools of convenience that feed on advanced indicators.

No Gravatar

Why were the political prediction markets so wrong about Barak Obama and Hillary Clinton in New Hampshire?

&#8230-asks Slate&#8217-s Daniel Gross &#8212-via Mister Usability (Alex Kirtland), who needs to go and get his own gravatar.

So, I&#8217-ve been watching the action in one of the political futures markets this evening, Intrade. And the action in this prediction market has reinforced my opinion that these are less futures markets than immediate-past markets. The price movement tends to respond to conventional wisdom and polling data- it doesn&#8217-t lead them.

Throughout the day and into the early evening, while polls were still open, Democratic investors, mimicking the post-Iowa c.w. and polls, believed Obama was highly likely to be the Democratic nominee. The Obama contract was trading in the lows 70s, meaning investors believed he had a 70 percent chance of being the nominee, while Hillary Clinton contracts were in the 20s. […] At 6 p.m., this market had written Hillary Clinton&#8217-s entire presidential campaign off. At 9:30 p.m., it was calling a dead heat. What caused investors to change their minds so drastically in the space of a couple of hours? A few data points that went against the day&#8217-s prevailing conventional wisdom and polls. […]

See also Niall O&#8217-Connor&#8217-s assessment:

I am looking forward to the post New Hampshire Caucus, when all you prediction market advocates crawl out from under your stones. For the record at one point the market on Intrade and Betfair was suggesting that Obama had a 95% probability of winning the caucas- whilst Intrade had him at 77% to win the nomination.A case perhaps of both the foolery of crowds and, the market biting back.

New Hampshire will go down as the Black Wednesday of prediction markets and unless there is now objective transparent debate (as opposed to the usual biased sabre rattling) – prediction markets will be dead in the water.

My answer to Dan Gross&#8217- legitimate question and to Niall O&#8217-Connor&#8217-s snarky comment:

  1. Prediction markets are forecasting tools of convenience that feed on advanced indicators. When those advanced indicators are wrong, the prediction markets are wrong.
  2. If you prefer the polls or the pundits, your call &#8212-but polls and pundits were also wrong, this time, right? Required reading for mister Niall O&#8217-Connor: &#8220-New Hampshire&#8217-s Polling Fiasco&#8221- + &#8220-Analysis: pundits eat crow&#8220-.
  3. The ultimate forecasting tool would be a way to reverse our psychological arrow of time &#8212-so as to remember the future instead of the past. Only science-fiction writers and some imbecile ( :-D ) believe in that.
  4. The prediction market approach is to stick with the markets, on the long term. Take their successes. Take their failures. Unlike Donald Luskin and Markos Moulitsas, Chris Masse will not turn against the prediction markets when they fail punctually. What counts is the long series.
  5. My first point should be included in the prediction markets approach definition, in my view, but others (like economist Michael Giberson) might have different opinions.
  6. With respect to my first point, I bet that the prediction markets will never replace the polls as the forecasting tool of choice for political analysts &#8212-on that particular point (but not on a myriad of others), I break away from Justin Wolfers&#8217- irrational exuberance and I side with Emile Servan-Schreiber of NewsFutures (my preferred play-money prediction exchange). Prediction market reporting will have a function, indeed (as suggests Justin Wolfers), but not the dominant function.
  7. Going forward, prediction market journalism should emphasize relative accuracy (as opposed to absolute accuracy) &#8212-that is, comparing prediction markets with polls and pundits, which is what Robin Hanson has said from day one. Our good friend Niall O&#8217-Connor has difficulty to compute that, apparently. He should eat more fish. :-D

&#8212-

Justin Wolfers:

In a few years, we may regard the second half of the 20th century as the aberration in which the press used polls rather than markets to track political races,” Justin Wolfers, a business professor at the University of Pennsylvania’s Wharton School, wrote in an e-mail message. “And in the 21st century, we may return to the habits of the early 20th century, reporting on political races through the lens of prediction markets rather than polls.

Emile Servan-Scheiber:

1) The traders themselves are the first to look at the polls to inform their trades. So the polls are here to stay.

2) Our recent experience in Western Europe seems to indicate that the superior accuracy of markets over polls when predicting elections may be a U.S. artifact that isn’t so easily reproducible elsewhere. I’ve discussed this with Forrest Nelson of IEM [Iowa Electronic Markets], and apparently, ever since the Truman-Dewey polling debacle of 1948, U.S. pollsters have adopted a policy of reporting mostly raw numbers rather than projections based on sophisticated secret formulas, so they can’t be accused of manipulating opinion. However, raw numbers are notoriously unreliable when based on small samples, and Western European pollsters never report them, preferring instead to publish projections based on historically-informed statistical formulas. What we’ve observed in France and Holland is that it it’s very hard to beat the accuracy of such projections.

[I don’t make mine Emile Servan-Schreiber’s second point, but that’s a minor.]

&#8212-

InTrade&#8217-s expired prediction markets:

&#8212-

New Hampshire

&#8212-

The Democrats

&#8212-

The Hillary Clinton event derivative was expired to 100.

Dem NH Clinton

Dem NH Obama

Dem NH Edwards

&#8212-

The Republicans

&#8212-

The John McCain event derivative was expired to 100.

Rep NH McCain

Rep NH Romney

Rep NH Huckabee

Rep NH Giuliani

&#8212-

Iowa

&#8212-

The Democrats.

The Barack Obama event derivative was expired to 100.

Dem Iowa Obama

Dem Iowa Clinton

Dem Iowa Edwards

&#8212-

The Republicans

The Mike Huckabee event derivative was expired to 100.

Rep Iowa Huckabee

Rep Iowa omney

Rep Iowa McCain

&#8212-

Source: InTrade

&#8212-

[A more complete prediction market reporting should have included expired contracts from NewsFutures and BetFair. Sorry for that. Note that InTrade-TradeSports is the only exchange to offer a “closed contacts” section.]

&#8212-

NEXT: Prediction Markets 101 + Who did best in explaining the prediction markets to the lynching crowd? + After the New Hampshire fiasco, 16 people came to defend the prediction markets, so far. + The prediction markets deserve a fair trial. + Prediction Markets = the greatest time-saving invention of this century

&#8212-

Since Chris must sleep at some time (I think)…

No Gravatar

&#8230- I&#8217-ll alert you to a developing story. [Slate’s Daniel Gross: Why were the political futures markets so wrong about Obama and Clinton?]

Thanks to a friend.

~alex

Intrade markets and Zogby polls agree in New Hampshire

No Gravatarthat Obama and McCain will be the winners tomorrow.

Previous blog posts by Caveat Bettor:

  • Intrade lists Global Warming Contracts!
  • Intrade beats Zogby on Super Tuesday
  • Super Tuesday Showdown: Intrade v. Zogby
  • The Democrat SC Showdown: Intrade v. Zogby
  • Zogby beats Intrade in predicting Nevada caucus winner Clinton.

In a truly efficient prediction market, the price will come to reflect the influence of all available information.

No Gravatar

Justin Wolfers in the Wall Street Journal:

[…] Through this process of different people trading based on their own observations about the race, prediction markets prices come to aggregate disparate pieces of information into a single summary measure of the likelihood of various outcomes. Moreover, if this market operates efficiently, it will appropriately summarize all of this information and the price will become the most statistically accurate forecast of the election outcome. […]

If I may, I would like to jot down some thoughts related to my concept of prediction market journalism.

  1. The explainer on prediction markets is pretty good.
  2. Crappy URL: http://online.wsj.com/article/SB119902559340658043.html?mod=rss_Politics_And_Policy
  3. No way to leave a comment.
  4. WSJ did list (in one of the sidebar boxes) BetFair along with InTrade &#8212-good point.
  5. WSJ didn&#8217-t list NewsFutures and Inkling Markets but listed their own play-money, bots-driven prediction exchange (WSJ Political Market) &#8212-bad point (conflict of interest).
  6. No external links embedded in Justin Wolfers&#8217- text &#8212-there are very good resources listed in the sidebar boxes, though (but the links use JavaScript and are not direct).
  7. No static or dynamic prediction market charts, even though Justin Wolfers spent a good deal of air time analyzing the recent prediction market events &#8212-a concept he formalized with Eric Zitzewitz.
  8. No tips &#8212-&#8221-I can&#8217-t predict what these trends will be […]&#8220-. Sounds like the prediction market approach (declaring that the market is a better forecasting tool than the polls or the experts) kills any anticipation and scenario planning. It shouldn&#8217-t be like that. Prediction market journalism can&#8217-t be only about analyzing the past. More on that in the coming weeks on Midas Oracle &#8212-not in the WSJ.

For all these reasons, I can give more than a straight B to Justin Wolfers&#8217- copy. You can do better than that, prof. :-D

The market moved but is it news?

No Gravatar

In financial markets there is strong evidence to suggest that news gets priced into markets within 15 minutes of its release and sometimes even more quickly. Recent research into prediction markets suggests that they aren’t nearly as efficient with researchers from University of Pennsylvania showing that prices on IEM can be predicted using public news flow.

Doing a simple analysis of some the key events in the 2008 Presidential Elections against prices on Intrade shows that on discrete events there is a clear relationship between prices and news flow. However over longer periods the relationship is not always clear.

On the 4th of March CBS announced the results of a straw poll conducted at the conservative PAC convention in Washington DC. They picked Romney as their favourite. Romney’s price on Intrade lifted immediately where it stayed for about a week.

Romney price

On the 11th of April the Fred Thompson revealed on Fox News and ABC Radio that he had been diagnosed with non-Hodgkin’s lymphoma nearly three years prior. The New York Times and other publications picked up the story the next day. Looking at his price chart shows he opened on the 12th of April at 19 but then closed at 15. The next day he opened at 11.2 but then closed at 17, as the story died down.

Thompson price

In both these cases, the news stories the media considered to be the important ones correspond with the news flow that traders thought was important.

However, the most interesting market movement of the year must be the Obama August slide. On the first of August Obama opened on Intrade at 35.5 but by the 24th of that month he had slide to 17.2. He continued sliding hitting a rock bottom of 10.7 on the 14th of October.

Obama price

The question is what was the news flow on Obama from the 1st of August to the 24th of August? Analysing the news articles in the New York Times suggests a disconnect between what was reported and how the market was reacting. Obama started August badly with a bungled comment on use of nuclear weapons.

Additionally, his continued line that stabilisation of Iraq had been a ‘complete failure’ may also have cost him some points.

However in sum these news items don’t seem to correlate with an 18 point slide. This could lead us to two possible conclusions:

  1. The New York Times didn’t report the most market sensitive news affecting Obama in August
  2. Obama was over-sold in August and his price did not reflect his true value

Cross-posted from the Hubdub blog.