Distribution Shift Robustness

Overview

The field asks how models can remain accurate, calibrated, and fair when data change across time, locations, populations, or conditions, including shifts in inputs, labels, and their relationships. Approaches include distributionally robust optimization, invariant and causal representations, targeted data augmentation, test-time adaptation, and conformal methods that adjust predictions or quantify uncertainty. Evaluation increasingly uses temporal and cross-domain tests, realistic corruption benchmarks, and worst-group measures rather than relying only on random train-test splits. A central tension is that adapting to a new domain can improve its performance but also cause instability or forget earlier capabilities, while guarantees that cover broad shifts may produce overly conservative predictions.

Latest papers

CardsList

285 papers34 papers in the last four weeks, up 31% on the four weeks before. 0.2% of all new papers.

  1. Adaptive Scenario Generation for KL-DRO Around a Learned Density Model

    Oct 29, 2026Aron Brenner, Saurabh AminDistributionally Robust OptimizationDistribution Shift Robustness

  2. Topology Survives Shuffling: Robust Long-Context Memory Access Prediction for Graph Analytics

    Oct 29, 2026Dongyan Sun, Neelesh Gupta, Rajgopal Kannan +1Long-Context ModelingDistribution Shift Robustness

  3. Evaluating Bayesian deep learning for robust biomedical time-series classification under distribution shift: A sleep scoring case study

    Oct 26, 2026Mads Birch Sørensen, Ulrike Richter, Francois Gastambide +1Distribution Shift RobustnessTime Series Classification

  4. Benchmarking uncertainty quantification for engineering regression under graded distribution shift

    Oct 26, 2026Ahmad Lawal, Rahim Pasbanigoloojeh, Asmau Lawal BilbisUncertainty QuantificationRegression Prediction Intervals

  5. Counterfactual Model Testing Under Distribution Shift

    Oct 24, 2026Joran Leest, Ilias Gerostathopoulos, Claudia Raibulet +1Distribution Shift RobustnessCounterfactual Evaluation

  6. SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web Agents

    Oct 24, 2026Bo-Yu Chen, Zhi Zhou, Yu-Feng LiAgent Skill LearningWeb Agent Benchmarks

  7. When to Trust Memory: Retrieval-Guided Probabilistic Spatiotemporal Forecasting under Distribution Shift

    Oct 23, 2026Haochen Lv, Jianhao Zhang, Zhichen Lei +5Spatiotemporal ForecastingProbabilistic Forecasting

  8. BatchBench: Benchmarking AI Robustness to Batch Effects and Domain Shift in Biomedical Images - A JUMP Cell Painting Leaderboard

    Oct 21, 2026Sonja Topf, Ana Sanchez-Fernandez, Günter KlambauerDistribution Shift RobustnessMedical Image Benchmarks

  9. Distributionally-Robust Policy Learning with Observational Data

    Oct 18, 2026Debmalya MandalPolicy LearningDistribution Shift Robustness

  10. TrustAgent-RFF: Agentic Diagnostic Planning for Reliable RF Fingerprinting under Domain Shift

    Oct 18, 2026Chuan Liu, Tianya Zhao, Yiting Wang +2RF Fingerprint IdentificationDistribution Shift Robustness

  11. LIBERO-Pro2.0: A Benchmark for Evaluating the Robustness of Embodied Foundation Models

    Oct 17, 2026Xueyang Zhou, Yangming Xu, Qianjiang Li +10Distribution Shift RobustnessEmbodied Agent Benchmarks

  12. Beyond Invariance: Factor-wise Selective Treatment of Shifts for Multimodal Learning

    Oct 15, 2026Guimin Hu, Qiwei Peng, Boyan Xu +1Distribution Shift RobustnessMultimodal Robustness

  13. INCONVENIENT: A Benchmark to Assess LLM Generalization Capabilities from Convenience Samples

    Oct 15, 2026Sara Rezaeimanesh, Chad Klochko, Kundan Thind +1Distribution Shift RobustnessTabular ML

  14. SafeAdapt-Poker: Counterfactual Risk Calibration for Budgeted Adaptation under Opponent Shift

    Oct 14, 2026Miaobo Hu, Shuhao Hu, Xiaobo Guo +4Imperfect-Information GamesDistribution Shift Robustness

  15. Euclidean Distance-Based Flow Matching

    Oct 13, 2026Paul-Henrik Heilmann, Peter OchsFlow MatchingFlow-Based Generative Modeling

  16. Why Linear Models Can Still Work in a Complex and Changing World

    Oct 9, 2026Fangzhou Lin, Dengzhe Hou, Yinxing Li +1Model SelectionLinear Regression

  17. ProtocolMatch: Protocol-Dependent Model Selection for Scientific Dynamics Forecasting

    Oct 7, 2026Lu Wei, Yufeng Wang, Haibin LingModel SelectionPhysics-Informed ML

  18. Machine Learning for German Redispatch Forecasting under Data Delays and Temporal Distribution Shift

    Oct 6, 2026Faraz Shamim, Faris ShamimDistribution Shift RobustnessTime Series Forecasting

  19. Detecting a Shift Is Not Enough: Exact Minimax Limits of Linear Representation Repair

    Oct 6, 2026Anuar Aimoldin, Yankai Chen, Ayana Mussabayeva +1Distribution Shift RobustnessMinimax Estimation

  20. Risk-Sensitive Crowd Navigation with Adaptive Ellipsoidal Conformal Prediction

    Oct 5, 2026Ruihan A. Li, Ziyao Guo, Yingying LiDistribution Shift RobustnessRobot Navigation

  21. SIFT: Robust Meta-Faithfulness Verification of Chain-of-Thought Reasoning Under Distribution Shift

    Oct 3, 2026Noor Islam S. Mohammad, Md. Basim Al Zabir Shammo, Hasan Siddiki +3CoT FaithfulnessLanguage Model Auditing

  22. Diffusion-Based Stress Testing of Overload Monitoring for Resilient Emergency Cellular Networks Using Internet CDR Proxies

    Oct 3, 2026Bilal Hussain, Xiao Tang, Tan Li +3Distribution Shift RobustnessWireless Communications

  23. Distributionally Robust Survival Models under Subpopulation Shift and Outlier Contamination

    Oct 2, 2026Seonghwi Kim, Sung Ho Jo, Minwoo ChaeSubgroup RobustnessDistribution Shift Robustness

  24. Distributionally Robust Schrödinger Bridge

    Oct 1, 2026Jinhwan Sul, Panagiotis Theodoropoulos, Vincent Pacelli +2Distribution Shift RobustnessSchrödinger Bridges