Tag Archives: David Pennock Edition David Pennock

David Pennock:
[...] So what is the “right” way to evaluate probabilistic predictions? There is no single absolute best way, though several tests are appropriate, and probably can be considered stronger tests than the calibration test. In our paper “Does Money Matter?” we use four evaluation metrics:
1. Absolute error: The average over many events of lose_PR, [...]