Reading the Markets – Forecasting Prediction Markets By News Content Analysis

Reading the Markets – Forecasting Prediction Markets By News Content Analysis – (PDF file) – by Ari Gilder and Kevin Lerman – 2007-xx-xx


We present a system for predicting price fluctuations in Prediction Markets, such as TradeSports and the Iowa Electronic Markets. Our approach utilizes both market history and public news articles, published before the beginning of trading each day, to produce a set of recommended investment actions. Since there is evidence that prediction markets are very good indicators of future events, we hypothesize that the converse is true: past/present events can potentially assist in predicting future prices in these markets. We empirically show that these markets are surprisingly predictable, even by purely market-historical techniques. Furthermore, analyzing relevant news articles captures information independent of the market’s history, and combining the two methods significantly improves results. Capturing this signal from news articles requires some linguistic sophistication – the standard naive bag-of-words approach does not yield predictive features. Instead, we use part-of-speech tagging, dependency parsing and semantic role labeling to generate features that improve system accuracy.

We evaluate our system on eight political markets from 2004 and show that we can make effective investment decisions based on our system’s predictions, whose profits greatly exceed those generated by a baseline system. Additionally, our market prediction system can be applied to any Prediction Market with a known end date and for which a set of relevant entities (people, places, or things) can be defined.

Previously: Today&#8217-s prediction markets are far from being efficient.

Author Profile&nbsp-Editor and Publisher of Midas Oracle .ORG .NET .COM &#8212- Chris Masse&#8217-s mugshot &#8212- Contact Chris Masse &#8212- Chris Masse&#8217-s LinkedIn profile &#8212- Chris Masse&#8217-s FaceBook profile &#8212- Chris Masse&#8217-s Google profile &#8212- Sophia-Antipolis, France, E.U. Read more from this author&#8230-

Read the previous blog posts by Chris. F. Masse:

  • Car manufacturer Renault (Nissan’s twin) is now a NewsFutures client.
  • Nokia’s Enterprise Prediction Markets = Competitive Advantage
  • Comments are now completely open on Midas Oracle.
  • Albert Einstein, Chairman of the Midas Oracle Advisory Board
  • Erratic –but not Stochastic– Charts
  • Barack Obama is the 44th US president.
  • We already have prediction markets in future tax rates. It’s called the municipal bond yield curve.

One thought on “Reading the Markets – Forecasting Prediction Markets By News Content Analysis

  1. Jason Ruspini said:

    Interesting paper but in a quick read I could not see if they accounted for transaction costs and bid/ask slippage.

Leave a Reply

Your email address will not be published. Required fields are marked *