Statistical Hypothesis Testing

Overview

Statistical hypothesis testing asks whether observed data are sufficiently inconsistent with a null claim, while balancing false positives, missed effects, and sample cost. Methods range from likelihood and rank tests to permutation and bootstrap calibration, kernel and classifier-based tests for distributional or conditional differences, and sequential e-value or betting procedures for ongoing monitoring. Multiple-testing correction and selective inference address many comparisons and data-dependent analyses, while robust and semi-supervised methods handle contamination, covariates, and limited labels; applications include causal effects, model evaluation, and scientific discovery. A central challenge is preserving reliable error control in small samples, high dimensions, adaptive workflows, and complex data without sacrificing power or computational efficiency.

Latest papers

CardsList

109 papers8 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. Inference after coding agents

    Nov 17, 2026Florian Gunsilius, David Van Dijcke, Kaspar WüthrichSelective InferenceStatistical Hypothesis Testing

  2. Structural Conditional Independence Test via Neural Quantile Resolution

    Nov 4, 2026Khoa Nguyen, Bao Duong, Thin NguyenConditional Independence TestingStatistical Hypothesis Testing

  3. Stand-In Effects and Pooling Amplification: Lessons from Biological World Models for Testing Action Effects

    Nov 1, 2026Bowen Xu, Boyu Chen, Jiaying LiWorld Model EvaluationStatistical Hypothesis Testing

  4. Localizing predictive concepts encoded in neural representations via hierarchical testing

    Oct 29, 2026Viktoriia Huryn, Marco Simnacher, Jim Berend +4Neuron-Level InterpretabilityStatistical Hypothesis Testing

  5. Testimony from Timelines: Evidence-Grounded Significance Testing of Temporal Clinical Hypotheses

    Oct 29, 2026Chengyang He, Wenlong Zhang, Koduvayur Subbalakshmi +1Scientific Claim VerificationClinical Language Model Evaluation

  6. Detecting Temporal Concepts in Video Transformers via a No-False-Positives Test

    Oct 23, 2026Jianghuai Li, Andrew Ren, Greg ShakhnarovichSpatiotemporal TransformersStatistical Hypothesis Testing

  7. Asymmetric Likelihood-Free Hypothesis Testing

    Oct 21, 2026Gunjan Kumar, Yash Pote, Jonathan ScarlettStatistical Hypothesis TestingSample Complexity

  8. Equivalence testing and run-count design for stochastic machine-learning experiments

    Oct 16, 2026Dmytro Knopov, Nadiya ShvaiStatistical Hypothesis TestingStatistical Power Analysis

  9. Strategic Multi-Agent Resource Allocation via Statistical Contracts

    Oct 13, 2026Ben Chugg, Michael I. Jordan, Aaditya RamdasMechanism DesignStatistical Hypothesis Testing

  10. Selective Inference for Clustering Under Unknown Covariance

    Oct 12, 2026Yiqun T. Chen, Lucy L. GaoSelective InferenceStatistical Hypothesis Testing

  11. Testing Central Structure for Complex Networks

    Oct 11, 2026Qilong Wu, Yuxiao Li, Simeng Zhang +3Statistical Hypothesis Testing

  12. From Imbalance to Evidence: Deep Nonparametric Testing for Complex Data under Severe Sample Imbalance

    Oct 9, 2026Guanhao Zhou, Xiufan YuTwo-Sample TestingStatistical Hypothesis Testing

  13. Conditional Kernel Stein Discrepancy

    Oct 8, 2026Federico Matteucci, Florian KalinkeKernel Stein DiscrepancyGoodness-of-Fit Testing

  14. What Can a Gaussian Process Design Test

    Oct 7, 2026Ivan De Boi, Marnix Van SoomGoodness-of-Fit TestingGaussian Processes

  15. Two-Sample Testing via Generative Processes

    Oct 6, 2026Eshant English, Kenji Fukumizu, Taiji SuzukiTwo-Sample TestingStatistical Hypothesis Testing

  16. Finding Gaussian Structure in Bosonic States

    Oct 5, 2026Alvan Arulandu, Sitan Chen, Ziyun Chen +2Quantum State TomographyStatistical Hypothesis Testing

  17. Two-Sample Testing via Path-based Inference

    Oct 5, 2026Eshant English, Wei-Cheng Lai, Yanfeng Yang +3Two-Sample TestingPermutation Testing

  18. Cheap and Powerful Tests for Supervised Subspaces: Per-Component Inference for PLS

    Sep 28, 2026Paweł Lenartowicz, Hubert PlisieckiPermutation TestingStatistical Hypothesis Testing

  19. When 10,000 Windows Are Not 10,000 Tests: Auditing Statistical Confidence in Sliding-Window Time-Series Classification

    Sep 25, 2026Xinze Shi, Litian Zhang, Binrui ShiTime Series ClassificationBenchmark Validity

  20. Robust Detection of LLM-Generated Text under Contamination

    Sep 24, 2026Jiaxun Li, Saptarshi Chakraborty, Ambuj TewariAI-Generated Text DetectionLanguage Model Robustness

  21. Selective Inference for Deep Clustering in Latent Spaces

    Sep 23, 2026Eina Mizui, Tomohiro Shiraishi, Shunichi Nishino +1Selective InferenceClustering

  22. How to Run Statistics over LLM Judges and Trust the Results: Calibrated Inference for Small-Sample AI Evaluation with evalstats

    Sep 20, 2026Ian ArawjoStatistical Hypothesis TestingLLM Evaluation

  23. Certifying Model Upgrades with Slice-Wise Non-Regression and Incumbent Fallback

    Sep 12, 2026Shengwei Zhang, Tao Wu, Fei QianModel SelectionAutomated Evaluation

  24. When Validation Stops Learning: Auditing Update Admission for Continual Embodied Agents

    Sep 9, 2026Qinzhen Ma, Ruihai WuContinual Robot LearningSafe RL

  25. Embedded Conditional Independence Tests for Large Language Model Generated Text with an Application to German Parliament Speeches

    Sep 1, 2026Marco Simnacher, Georg Keilbar, Benjamin König +2LLM EvaluationPrivacy Leakage in Language Models