Overview

Proper scoring rules are losses for probabilistic predictions, such as the Brier score, log score, and continuous ranked probability score (CRPS); a strictly proper rule is minimized in expectation by reporting the true probabilities. Researchers use these rules to assess calibration and uncertainty, decompose forecast error, and develop guarantees for online forecasting and regret. They also tailor scores and training objectives to settings such as censored survival data, weather prediction, causal inference, and decisions with unequal costs. A key tension is that rules with the same truth-telling guarantee can produce different finite-sample model behavior and rankings, so the best score depends on both the data and the intended use of the forecast.

Latest papers

CardsList

34 papers6 papers in the last four weeks, up 100% on the four weeks before. 0.0% of all new papers.

  1. Decomposing Probabilistic Scores: Reliability, Information Loss and Uncertainty

    Mar 16, 2026Arthur Charpentier, Agathe Fernandes MachadoProbability CalibrationUncertainty Decomposition

  2. Distributional Regression with Tabular Foundation Models: Evaluating Probabilistic Predictions via Proper Scoring Rules

    Mar 9, 2026Jonas Landsgesell, Pascal Knoll, Tizian WenzelTabular Foundation ModelsProper Scoring Rules

  3. An intuitive rearranging of the Yates covariance decomposition for probabilistic verification of forecasts with the Brier score

    Mar 4, 2026Bruno Hebling VieiraProbability CalibrationProbabilistic Forecasting

  4. A Proper Scoring Rule for Virtual Staining

    Feb 26, 2026Samuel Tonks, Steve Hood, Ryan Musso +5Information GainVirtual Staining