Collective Prediction – Combining human and machine intelligence in prediction economies

No Gravatar

MIT&#8217-s CCI:

Think of a domain in which you would like accurate predictions of future events: sales volumes for a company&#8217-s products, outcomes of sporting events or military conflicts, crime rates by neighborhood, terrorist actions, new products introduced by a company&#8217-s competitors, or the clinical outcomes of different medical treatments someone you know might receive for cancer.

Now imagine a network of humans and computers that makes predictions in this domain&#8211-not perfectly, but better than was possible before. And imagine that these predictions get better and better over time as the network learns from its own experience. We propose to do some of the essential research needed to help create such networks.

A number of researchers have recently developed prediction markets in which participants buy and sell predictions about uncertain future events and are paid only if their predictions are correct. Such prediction markets have been found to be surprisingly accurate in a wide range of situations (including forecasting product sales and US Presidential elections).

We propose to build on this previous work to develop prediction economies &#8212- networks of people and computers paid (either in currency or points) for accurate predictions about future events. A prediction economy can include (a) one or more prediction markets (b) markets for various other kinds of information relevant to the events being predicted, and (c) markets for services by people (such as image analysis) or by machines (such as multiple regression, machine learning, and data mining).

Importantly, both people and their automated agents will be allowed to participate in any part of the economy. For instance, automated agents can do &#8220-program trading&#8221- in two related prediction markets whenever they see inconsistent prices in the two markets. In this way, prediction economies provide a flexible new approach to integrating human and machine expertise: People have an incentive to create new automated agents whenever they can codify useful expertise algorithmically, and they have an incentive to participate in markets directly when they can do a better job than the existing automated agents. But when people can&#8217-t improve on what the automated agents are already doing, then they have no incentive to intervene.

Drawing on theories in organization science, computer science, cognitive science, and economics, this work will develop new forecasting and collaboration tools that blend human and machine capabilities to more accurately forecast risks and opportunities, thus helping to build more agile systems in many domains.

Hummm&#8230- More meta than the prediction markets? Is that possible?&#8230- Will their proposal fly? Humm&#8230-

Read the previous blog posts by Chris F. Masse:

  • Ratted by his bank, sex-addict New York governor Eliot Spitzer (alias “Client 9”) resigns.
  • BBC’s coverage of politics is dull like taxes, death and German sausages.
  • Never talk when you can nod, and never nod when you can wink, and never write an e-mail because it’s death. You’re giving prosecutors all the evidence we need.
  • Is Justin Wolfers a libertarian? Probably not.
  • The information technology that caught Eliot Spitzer
  • Eric Zitzewitz’s 10 minutes of fame
  • Fun with conditional probabilities

Whose side are you on?

No Gravatar

Mike Arrington

Michael Arrington refers to this blog post, which I have already linked to.

I&#8217-m rather in the Mike Arrington camp, but I&#8217-m not necessarily proud of it. (Ducan Riley would tell me to &#8220-get fu****&#8220-. :-D )

I would be interested to have Adam Siegel or David Perry&#8217-s opinion on all that. Or Mat Fogarty&#8230- Or Emile Servan-Schreiber. Or John Delaney. Or else.

BLEG: Maine data

No GravatarHas somebody saved the InTrade expired charts for Maine, on the Republican side, some time ago? Desperately seeking. Contact me. Thanks a lot.

Read the previous blog posts by Chris F. Masse:

  • Ratted by his bank, sex-addict New York governor Eliot Spitzer (alias “Client 9”) resigns.
  • BBC’s coverage of politics is dull like taxes, death and German sausages.
  • Never talk when you can nod, and never nod when you can wink, and never write an e-mail because it’s death. You’re giving prosecutors all the evidence we need.
  • Is Justin Wolfers a libertarian? Probably not.
  • The information technology that caught Eliot Spitzer
  • Eric Zitzewitz’s 10 minutes of fame
  • Fun with conditional probabilities

Meet bettor/trader Harry Findlay.

No Gravatar

Harry Findlay

&#8220-Nowadays, some casinos even have two zeroes on the roulette wheel. Anyone playing them should be certified. But gambling on a Champions League match, a Premier League match, you can win.&#8221- This, he explains, is because modern betting exchanges take a far lower proportion of their punters&#8217- stakes in profit. &#8220-There is no margin, it&#8217-s about 2 per cent.&#8221-

&#8220-If I were leaving school now, the chances of ending up behind bars are the same as me skiing for Britain in the London Olympics. It only happened because of all the lies and kidology that used to go on with betting. Nobody can get [bets] on with bookmakers, because when you win you get closed down. Now it&#8217-s all up front. We&#8217-re now living in the real world. Press that button on Betfair and let&#8217-s see how good you are. Simple. There&#8217-s no myths or lies any more, it&#8217-s all fact.&#8221-

He also believes that direct, accountable trading via the internet betting exchanges is taking the carpet up on the cheats, and he colourfully repaints some of the turf&#8217-s most honoured names as arrant frauds. &#8220-At the end of the day, it don&#8217-t matter how big your house is,&#8221- he says. &#8220-Nurses and teachers working for nothing, they&#8217-re the real legends. If you cheat, what kind of buzz is there, conning all that lot?&#8221-

Read the previous blog posts by Chris F. Masse:

  • Ratted by his bank, sex-addict New York governor Eliot Spitzer (alias “Client 9”) resigns.
  • BBC’s coverage of politics is dull like taxes, death and German sausages.
  • Never talk when you can nod, and never nod when you can wink, and never write an e-mail because it’s death. You’re giving prosecutors all the evidence we need.
  • Is Justin Wolfers a libertarian? Probably not.
  • The information technology that caught Eliot Spitzer
  • Eric Zitzewitz’s 10 minutes of fame
  • Fun with conditional probabilities

Towards a prediction market label?

No Gravatar

Our good doctor Emile Servan-Schreiber of NewsFutures (some time ago):

[…] create a “Prediction Market” label that we could use to differentiate our products and our approach from the growing number of &#8220-wisdom of crowds&#8221- barbarians (eg, blubet, guessnow, etc.) who are shamelessly exploiting the &#8220-prediction market&#8221- brand even while their offerings have little resemblance to such a thing. […]

Maybe not such a bad idea. But who would define the prediction markets, who would apply this prediction market label, and would the media care about all that??

InTrade should disclose what market-making automatism they are using to liquify the WSJ and FT play-money prediction markets.

No Gravatar

BetFair:

Betfair Robot on Exchange Games

Betfair Customer Services 13 Dec 16:51

From December 2007 Betfair has started employing its own software or “robots” to provide liquidity into the exchange games markets.
It has been evident for some time that the activity of 3rd Party bots is essential to ensure that there is enough liquidity in the markets to provide an attractive customer proposition. For commercial reasons we have decided that rather than rely solely on 3rd party bots, Betfair will itself provide liquidity.

Our robot has no advantages over any other in price terms. That is, if anyone (whether electronically or manually) offers a better price, the Betfair robot will not try to better that price- and we are not market-making on the back of being able to see what everyone else is doing. Customers will be equally likely to be matched by a 3rd party as by the Betfair bot.

Our robots cannot cheat, they place bets through the same channel as other robots, have no access to privileged information and cannot influence the result. The architecture of the system has been passed by our regulator and approved.

BetFair Games

Once again, we see that BetFair are ethical and disclose&#8230- whereas InTrade-TradeSports are not and do not.

Read the previous blog posts by Chris F. Masse:

  • I get a kick each morning out of spying on the rich, famous, and powerful people updating their LinkedIn profile and connections. (Go to “InBox”, and click on “Network Updates”.)
  • ??? BetFair bet-matching logic ???
  • Eliot Spitzer has simply demonstrated once again that those who rise to the top of organizations are very often the most demented, conflicted individuals in any group.
  • Business Risks & Prediction Markets
  • Brand-new BetFair bet-matching logic proves to be very controversial with some event derivative traders.
  • Jimmy Wales accused of editing Wikipedia for donations.
  • What the prediction market experts said on Predictify

Enterprise Prediction Markets … Without Office Politics

No Gravatar

Google&#8217-s Bo Cowgill, as reported by IT Business:

[&#8230-] If you let people bet on things anonymously, they will tell you what they really believe because they have money at stake. This is a conversation that&#8217-s happening without politics. Nobody knows who each other is, and nobody has any incentive to kiss up. [&#8230-]

[In one example,] the market was predicting that [a project] was behind. A manager says what&#8217-s going on here, &#8230-starts investigating and finds some glitches. [&#8230-]

Read the previous blog posts by Chris F. Masse:

  • Ratted by his bank, sex-addict New York governor Eliot Spitzer (alias “Client 9”) resigns.
  • BBC’s coverage of politics is dull like taxes, death and German sausages.
  • Never talk when you can nod, and never nod when you can wink, and never write an e-mail because it’s death. You’re giving prosecutors all the evidence we need.
  • Is Justin Wolfers a libertarian? Probably not.
  • The information technology that caught Eliot Spitzer
  • Eric Zitzewitz’s 10 minutes of fame
  • Fun with conditional probabilities

How InTrade-TradeSports and BetFair-TradeFair should reach out

No Gravatar

Fred Wilson (a famous NY-based venture capitalist, a &#8220-VC&#8221-):

Really think about if you need that $15,000 a month PR firm. – There are some really good PR firms out there and if you can get one of them to work with your company, then it may be worth considering it. But a mediocre PR firm is not worth it for sure. I encourage our portfolio companies to hire a person inside the company to be an &#8220-evangelist&#8221-. That job includes blogging actively, reading and commenting and linking to other blogs, reaching out to the media and industry analysts and gurus, going to conferences and events, and generally getting the word out. That person can be young and not particularly expensive, certainly nowhere near $15,000 a month. And they have two things that a PR firm cannot offer. They work for you and they represent your company exclusively.

Exactly.

As of today, the BetFair blogging is appalling and works in reverse. The BetFair blog is a digital cockroach that repels the prediction market aficionados. Over the time, the BetFair blog will generate bad publicity for BetFair-TradeFair.

As for InTrade-TradeSports, their little &#8220-bulletin&#8221- is totally uninteresting. It&#8217-s not awful, but it&#8217-s not clever either. It&#8217-s money wasted.

Read the previous blog posts by Chris F. Masse:

  • Collective Prediction – Combining human and machine intelligence in prediction economies
  • BLEG: Maine data
  • Al Gore is off his rocket, going thru the roof.
  • Enterprise Prediction Markets … Without Office Politics
  • Meet bettor/trader Harry Findlay.
  • Uh oh.
  • 3 fundamental aspects that will determine the success of a company

FREE BO COWGILL. CALL IN JOHN RAMBO.

No Gravatar

Our testosteroned Grandizer [JOKE] is trapped in communist China:

Sadly, I&#8217-m not able to read the announcement on the Google Analytics blog thanks to the Great Firewall. I&#8217-m in Shanghai until the end of the month with Google.

Great Wall

Shangai

Google Analytics blog post:

Benchmarking now available plus additional opt-in settings
Wednesday, March 05, 2008

We&#8217-re happy to announce the launch of two related new Google Analytics features: a beta version of industry benchmarking and a data-sharing settings page. Both are designed to give our customers more choice and better control over their data. We are also launching an integration with Audio Ads today, which we&#8217-ll discuss in more detail in tomorrow&#8217-s post. All of these features will begin appearing in customer accounts today, though benchmarking reports may take up to a couple weeks to show data.

Industry benchmarking is a commonly requested new service that enables customers to see how their site data compares to sites in any available industry vertical. We believe this data will provide actionable insights by providing context for users to understand how their site is doing. For example, if you have a travel website and you get a spike in traffic on Mondays, you may want to know whether other travel sites get that same spike on Mondays.

You can also compare your site against an industry vertical different than your own. For example, you might see that your industry&#8217-s traffic dips at certain times of the year while another industry&#8217-s traffic increases. Based on that information, you may wish to explore cross promotional opportunities to drive traffic back and forth.

[Link to their screen shot.]

For more information, take a look at the benchmarking FAQs in the Google Analytics help center.

Of course, benchmarking only works if people can opt to share their data into the system, so we&#8217-re also introducing a new data-sharing settings page. On this page, customers can choose whether to opt in or opt out of sharing their Analytics data. To be clear, we are not sharing individual data with competitors- we bucket data into industry verticals and then anonymize and aggregate the data. Once you opt in, it may take a couple weeks for the reports to populate.

You can also elect to share your data with other Google services. This setting will allow us to provide you with additional advanced new features. For example, many of you have asked us to integrate Conversion Optimizer (which is currently only available to AdWords Conversion Tracking users) into Google Analytics. By opting to share your data with Google, you&#8217-ll be able to take advantage of these related new features as they become available. For more information, take a look at the data-sharing options FAQs in the help center.

Look for tomorrow&#8217-s post on the Audio Ads integration.

Posted by Brett Crosby, Group Manager, Google Analytics

Read the previous blog posts by Chris F. Masse:

  • Is Justin Wolfers a libertarian? Probably not.
  • The information technology that caught Eliot Spitzer
  • Eric Zitzewitz’s 10 minutes of fame
  • Fun with conditional probabilities
  • Wrongly Crafted Headlines Of The Day
  • an American, petite, very pretty brunette, 5 feet 5 inches, and 105 pounds
  • Mississippi: Is it a primary or a caucus?