Jason Ruspini and David Pennock should listen.
Political prediction markets react (with a small delay) to political polls —-just like the political experts and the mass media do, too. Hence, in order to discover their true social utility, the prediction markets (which are tools of intelligence) should not be compared to the polls (which are just facts) but to the similar meta intelligence mechanisms (the averaged probabilistic predictions from a large panel of experts, or the averaged probabilistic predictions from the political reporters in the mass media, or else). My bet is that, in complicated situations (such as the 2008 Democratic primary), the prediction markets beat the mass media (in terms of velocity) —-even though the prediction markets are not omniscient and not completely objective (but who is?).
You might remember the research article that I have blogged about:
Learning in Investment Decisions: Evidence from Prediction Markets and Polls – (PDF file) – David S. Lee and Enrico Moretti – 2008-12-XX
In this paper, we explore how polls and prediction markets interact in the context of the 2008 U.S. Presidential election. We begin by presenting some evidence on the relative predictive power of polls and prediction markers. If almost all of the information that is relevant for predicting electoral outcomes is not captured in polling, then there is little reason to believe that prediction market prices should co-move with contemporaneous polling. If, at the other extreme, there is no useful information beyond what is already summarized by the current polls, then market prices should react to new polling information in a particular way. Using both a random walk and a simple autoregressive model, we find that the latter view appears more consistent with the data. Rather than anticipating significant changes in voter sentiment, the market price appears to be reacting to the release of the polling information.
We then outline and test a more formal model of investor learning. In the model, investors have a prior on the probability of victory of each candidate, and in each period they update this probability after receiving a noisy signal in the form of a poll. This Bayesian model indicates that the market price should be a function of the prior and each of the available signals, with weights reflecting their relative precision. It also indicates that more precise polls (i.e. polls with larger sample size) and earlier polls should have more effect on market prices, everything else constant. The empirical evidence is generally, although not completely, supportive of the predictions of the Bayesian model.
You might also have watched Emile Servan-Schreiber’-s videos. Emile is a smart man, and those videos are truly instructive.
- In the first part (the lecture), our good doctor Emile Servan-Schreiber sold the usual log lines about the prediction markets —-blah blah blah blah blah.
- In the second part, Emile Servan-Schreiber took questions from the audience in the room. “-Aren’-t political prediction markets just following the polls?”-, asked one guy. Emile’-s answer was long and confused. However, in my view, Emile actually did answer that question (before it was ever asked) in his preceding lecture when, at one point, he made the point that the media were slower than the prediction markets to integrate all the facts about the 2008 Democratic primary, around May 2008. That is the right answer to give to a conference attendee who enquires about prediction markets “-following”- the polls. Both the mass media and the prediction markets do follow the polls (since the polls are facts that can’-t be ignored), during political campaigns. Let’-s compare the prediction markets with the mass media, instead, and let’-s see who’-s quicker to deliver the right intelligence..
Lance Fortnow gives a good insight about the relationship between polls and prediction markets (see his last paragraph).
Yesterday the Electoral College delegates voted, 365 for Barack Obama and 173 for John McCain. How did the markets do?
To compare, here is my map the night before the election and the final results. The leaning category had Obama at 364. The markets leaned the wrong way for Missouri and Indiana, their 11 electoral votes canceling each other out. The extra vote for Obama came from a quirk in Nebraska that the Intrade markets didn’-t cover: Nebraska splits their votes based on congressional delegations, one of which went to Obama.
Indiana and Missouri were the most likely Republican and Democratic states to switch sides according to the markets, which mean the markets did very well this year again. Had every state leaned the right way (again), one would wonder if the probabilities in each state had any meaning beyond being above or below 50%.
Many argue the markets just followed the predictions based on polls like Nate Silver’-s fivethirtyeight.com. True to a point, Silver did amazingly well and the markets smartly trusted him. But the markets also did very well in 2004 without Silver. [Chris Masse’s remark: In 2004, Electoral-Vote.com (another poll aggregator) was all the rage.] One can aggregate polls and other information using hours upon hours of analysis or one can just trust the markets to get essentially equally good results with little effort.
The polls are facts. Prediction markets are meta to facts. Prediction markets are intelligence tools. Let’-s compare them with similar intelligence tools.
Lance Fortnow’-s post attracted an interesting comment from one of his readers:
to provide an exciting collection of political and other prediction markets.
These markets are as much a “-prediction”- tool as a wind vane or outdoor thermometer are. They moved up and down according to the daily trends, with very little insight of the longer place phenomena underlying them.
When the weather was hot (Palin’-s nomination announcement) the market swinged widely towards McCain, while ignoring the cold front on the way here (the economic recession + Palin inexperience).
The value of weather forecast is in telling us things we didn’-t know. We don’-t need to trade securities to believe that if McCain is closing on the polls then his chances of wining are higher (duh!), which is what the markets did. We need sophisticated prediction mechanisms to tell us how the worsening economic conditions, the war in Iraq and Palin ineptitude (which in pre-Couric days wasn’-t as well established) will impact this election, today poll’-s be damned.
Looking at the actions by the republican teams, who were trying to read past the daily trend all the way to November 4th, it is clear that they thought all along they were losing by a fair margin. Because of this is they choose moderate, maverick McCain, went for the Palin hail mary fumble^H^H^H^H^H pass and the put-the-campaign-on-hold move.
A full two weeks before the election the McCain team concluded the election was unwinnable, while the electoral college market was still giving 25-35% odds to McCain.
As highlighted in bold, the commenter says two things:
- The prediction markets are just following the polls.
- The prediction markets have a minimal societal value.
My replies to his/her points:
- That’-s not the whole truth. The polls are just a set of facts, whereas the prediction markets are intelligence tools that aggregate both facts and expertise. The commenter picks up a simple situation (the 2008 US presidential election) where, indeed, anybody reading the latest polls (highly favorable to Barack Obama) could figure out by himself/herself what the outcome would be (provided the polls wouldn’-t screw it).
- That’-s true in simple situations, but that’-s wrong in complicated situations (such as the 2008 Democratic primary).
The emergence of the social utility of the prediction markets will come more clearly to people once we:
- Highlight the complicated situations-
- Code the mass media’-s analysis of those complicated situations, and compare that with the prediction markets.
No TweetBacks yet. (Be the first to Tweet this post)
– Logical flaw?
ADDED BONUS: Additional thought on arbitrage.
UPDATE: The HubDub PM on who will win the 2nd debate.
A quick link panorama.
#1. Is InTrade being manipulated?
– Nate Silver shows that there are abrupt downward pressures on the Barack Obama event derivative, while we also see some abrupt upward pressures on the Hillary Clinton event derivative.
However, you can see by yourself that InTrade is resilient enough and does a great job of going back to normal [*], after just a few hours of trading:
– At Portfolio, blogger Zubin Jelveh blows the incidents out of proportion.
– Professor Lance Fortnow has a more careful analysis and notes that the price of the Barack Obama bounces back quickly enough.
– Quick thought: Maybe the media should use an average of event derivate prices for the last 5 work days…- so that the abrupt perturbations would be eliminated.
Professor Eric Zitzewitz:
I’m not sure you can conclude from Silver’s graphs that the market goes “back to normal.” You can conclude that it moves back in the opposite direction of the impact those large trades. Back when the Hillary for President market looked like it was being manipulated, it appeared that the manipulator was both placing a large purchase and then placing limit orders to provide price support and slow down the reversion of the price.
UPDATE: Are we witnessing manipulation attempts on the “-Florida to vote Republican”- prediction market at InTrade?
#2. Why does InTrade give a discounted probability for Barack Obama as US president?
– As you remember, Emile Servan-Schreiber of NewsFutures believes that it’-s a Republican conspiracy all over.
– Professor Justin Wolfers puts up an hypothesis: it’-s legally impossible for US traders to arbitrage on BetFair.
– InTrade put up a crappy excuse: the industry is still too “-young”-. How lame. How stupid. The industry was younger in the previous elections, where arbitrage opportunities didn’-t exist according to professors Justin Wolfers and Eric Zitzewitz (see their 2004 paper and their other publications).
– Blogger Zubin Jelveh swallows the InTrade P.R. line, and adds another crappy InTrade P.R. line: More arbitrage opportunities are being exposed in open air because much more observers are hunting down arbitrage opportunities in 2008 than in previous elections. That’-s a second blatant cretinery, uncorrected by the Portfolio blogger. Re-read Justin Wolfers’- blog post. Professor Justin Wolfers states that:
The current variation in price is larger than I have ever seen in my years of studying prediction markets. The forces of arbitrage that would typically eliminate these differences have been handicapped by the legal restrictions preventing U.S.-based traders from using overseas markets.
– Finally, professor Lance Fortnow says nothing about the arbitrage opportunities between InTrade and BetFair, but does offer some technical points about the issue of polls versus the prediction markets, centered around the question of state correlations. Read on.
UPDATE: Eric Crampton (a Canadian exiled in New Zealand) says he has managed to turn a buck by arbitraging between InTrade and iPredict New Zealand. He also makes 2 theoretical points. Go read it.
UPDATE: Greg Mankiw just linked to Nate Silver.
These prediction exchanges present prices as probabilities (expressed in percentages):
– InTrade .NET …- [*] …- would get the full point if they were to switch the label “-price”- for “-probability”- on their charts.
– NewsFutures …- gets half a point. No mention of “-probabilities”- on their charts.
– Inkling Markets …- gets a quarter of a point.
– TradeFair …- gets an honorable mention, but won’-t show its charts to the non-registered public.
[*] Which prefigures what InTrade .COM is going to be, soon, if I understood well my Deep Throat’-s tip.
As for the ultra innovative YooPick, is it yet another case of “-do what I say, not what I do“-?…-
APPENDIX: Lance Fortnow is PMA compatible:
UPDATE: See the comments…-
Previously: The prediction market approach
Prices as Probabilities in Election Markets – 2007 presentation by Lance Fortnow
Discussion continues here…-.
UPDATE: Follow up here.
Prediction market analyst Lance Fortnow in an e-mail to me:
Right now the electoral college markets are tracking the polls pretty closely. I think we’-ll see some divergence when we get close to the election since the polls can’-t keep up. In past elections the markets were much better than the polls within a few days before the election (though not on election day itself which has too many rumors).
– There is a long-shot bias —-states which are above 85% (for one candidate or the other) reflect a probability closer to 100%.
– The state markets are strongly correlated. There is a small but non-trivial chance that many states will be way off this year. And then people will be reluctant to trust the electoral college markets in the future.
So, I have (at least) one answer to my series of provocative questions: Electoral college prediction markets are more useful than the state polls towards the very end of the presidential campaign (but not on Election Day). Interesting. Thanks.
PS: The discussion about this post goes on in the comment area of another post.
Interesting blog post from Lance Fortnow on the VP prediction markets. (I will soon blog about those.)
InTrade – Electoral Markets Map
Their brand-new widget:
ELECTORAL COLLEGE MARKETS: Probabilistic predictions for the 2008 US presidential elections based on market data from InTrade Ireland —-(electoralmarkets.com).
By Lance Fortnow, David Pennock, and Yiling Chen.
For more on probabilistic predictions, go to our “-Predictions”- page, or visit the prediction exchanges.
Alternatively, if you want an electoral map made of polls, go to electoral-vote.com.