Prediction-Powered Inference

Overview

Prediction-Powered Inference combines abundant model predictions or unlabeled data with a smaller set of trusted labels to estimate quantities while correcting for prediction errors. Common approaches include calibration, residual-based control variates, cross-fitting, active label sampling, and combining multiple predictors. These methods support estimates and tests for means, risks, causal effects, rankings, and other quantities, including in AI evaluation and dependent time-series settings. The central tension is that noisy predictions can improve precision, but gains depend on their relationship to true outcomes and methods must preserve valid uncertainty estimates under finite samples, model error, or domain shift.

Latest papers

CardsList

30 papers6 papers in the last four weeks, up 20% on the four weeks before. 0.0% of all new papers.

  1. Conducting Reliable Keyword Estimation with Unreliable ASR in Police Audio Data

    Oct 19, 2026Robert Cole Molloy, Rhiannon N. Miller, Stephen Morgan +1Supervised LearningAutomatic Speech Recognition

  2. Prediction-Powered Data Fusion for Treatment Effect Estimation

    Oct 8, 2026Yonghan Jung, Shu YangCausal Effect EstimationConditional Average Treatment Effect Estimation

  3. Prediction-powered inference for time series across space

    Oct 6, 2026Shahzar Rizvi, David Burt, Vishwak Srinivasan +3Spatiotemporal ForecastingPrediction-Powered Inference

  4. Prediction-powered Neural Architecture Search

    Oct 1, 2026Pascal Janetzky, Yuxin Wang, Michael Klar +1Neural Architecture SearchPrediction-Powered Inference

  5. ABC-Align: Prediction-Powered Alignment with Adaptive Bias Control

    Sep 28, 2026Eric Frankel, Banghua Zhu, Sewoong Oh +1RL for Language ModelsLLM Alignment

  6. Transfer Calibrated Prediction Powered Inference

    Sep 28, 2026Aditya T. Vadlamani, Jae Ho Chang, Srinivasan Parthasarathy +1Cross-FittingDomain Adaptation

  7. How Synthetic Labels Improve Conformal Prediction: A Perspective on Conditional Coverage

    Sep 27, 2026Qianyi Chen, Bo LiQuantile RegressionConformal Prediction

  8. Augmented Hypothesis Testing with Persona-Based LLM Simulations

    Sep 21, 2026Ziyad Benomar, Aymen Al Marjani, Paul Missault +1A/b TestingLearning-Augmented Algorithms

  9. How to Run Statistics over LLM Judges and Trust the Results: Calibrated Inference for Small-Sample AI Evaluation with evalstats

    Sep 20, 2026Ian ArawjoStatistical Hypothesis TestingLLM Evaluation

  10. Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation

    Sep 17, 2026Sho Kawano, Zehang Richard Li, Paul A. ParkerAI Agent EvaluationPrediction-Powered Inference

  11. Calibrating Small Language Models for Claim Check-Worthiness Detection

    Aug 31, 2026Pratuat Amatya, V Venktesh, Vinay SettyClaim VerificationSmall Language Models

  12. Which Metrics Save the Most Human Annotation? Prediction-Powered Evaluation and Meta-Evaluation

    Aug 27, 2026Mingqi Gao, Anthony Sicilia, Weiyan ShiAutomated EvaluationMT Evaluation

  13. The Measurement Revolution? Credible Measurement and Inference in the Age of AI

    Aug 24, 2026Melissa Dell, Ashesh RambachanPrediction-Powered Inference

  14. Prediction-Powered Active Testing

    Jul 9, 2026Kianoosh Ashouritaklimi, Valentin Kilian, Daolang Huang +2Confidence Region EstimationVariance Reduction

  15. Industrializing Prediction-Powered Inference: The GLIDE Library for Reliable GenAI and Agentic Systems Evaluation

    May 29, 2026Grégoire Martinon, Ibrahim Merad, Mohammed RakiLLM-Assisted AnnotationLLM Agent Evaluation

  16. Active Multiple-Prediction-Powered Inference

    May 8, 2026Nicholas Brawand, Nima Leclerc, Anhthy Ngo +4Adaptive InferenceCost-Aware Inference

  17. Prediction-powered Inference by Mixture of Experts

    Apr 30, 2026Yanwu Gu, Linglong Kong, Dong XiaUncertainty QuantificationMixture-of-Experts Models

  18. Calibeating Prediction-Powered Inference

    Apr 23, 2026Lars van der Laan, Mark Van Der LaanInverse Probability WeightingParameter Estimation

  19. Revisiting Active Sequential Prediction-Powered Mean Estimation

    Apr 20, 2026Maria-Eleni Sfyraki, Jun-Kun WangParameter EstimationActive Learning

  20. Allocating Human Oversight in AI-Enabled Analytics

    Apr 14, 2026Zikun Ye, Jiameng Lyu, Rui TaoHuman Oversight of AIHuman-in-the-Loop Annotation

  21. Multiple-Prediction-Powered Inference

    Mar 28, 2026Charlie Cowen-Breen, Alekh Agarwal, Stephen Bates +4Prediction-Powered Inference

  22. Power Analysis for Prediction-Powered Inference

    Mar 17, 2026Yiqun T. Chen, Moran Guo, Shengy LiStatistical Power AnalysisPrediction-Powered Inference

  23. Prediction-Powered Conditional Inference

    Mar 5, 2026Yang Sui, Jin Zhou, Hua Zhou +1Prediction-Powered InferenceConfidence Region Estimation

  24. No Free Lunch: Non-Asymptotic Analysis of Prediction-Powered Inference

    May 26, 2025Pranav Mani, Peng Xu, Zachary C. Lipton +1Adaptive InferenceStatistical Learning Theory