Overview

Model selection studies how to choose among candidate models or configurations so predictions generalize while meeting goals such as interpretability, cost, or speed. Common approaches include cross-validation, information criteria such as AIC, BIC, and minimum description length, Bayesian methods, and regularization for selecting features or model complexity. For large model pools, active evaluation, bandits, meta-learning, and routing systems allocate tests or queries to identify promising models, ensembles, or task-specific specialists. A central challenge is that selection can overfit validation data, and rankings can change with the evaluation protocol or deployment setting, so no single criterion works everywhere.

Latest papers

CardsList

101 papers10 papers in the last four weeks, down 47% on the four weeks before. 0.1% of all new papers.

  1. Interpreting Random Forests: Comparing Surrogate Models and Rule Extraction Methods

    Nov 14, 2026Lea L. Mairhöfer, Jonathan B. Krause, Björn-Hergen Laabs +1Interpretable MLSurrogate Modeling

  2. When evaluation becomes intervention in clinical AI

    Nov 13, 2026Anthony Abou Mrad, Aviona Conti, Samuel Schmidgall +10LLM-as-a-JudgeClinical Language Model Evaluation

  3. Surrogate Quality Score: A Novel Composite Performance Metric for Model Selection

    Nov 6, 2026Maaz Ahmad, Iftekhar A. KarimiModel SelectionSurrogate Modeling

  4. Threshold Compatibility and Support-Selection Diagnostics in Neural Discovery of Partial Differential Equations

    Oct 27, 2026Zeen SongPDE DiscoveryModel Selection

  5. Energy and Latency First: How Deployment Constraints Reverse Time-Series Model Selection

    Oct 22, 2026Shruti Bothe, Illyyne Saffar, Ayush K. VarshneyModel SelectionEnergy-Efficient ML

  6. Astro2Method: Benchmarking LLMs on Machine Learning Method Selection in Astronomy

    Oct 21, 2026Xingzhong Fan, Hangfeng He, Fatemeh NargesianModel SelectionLLM Evaluation

  7. BRIDGE: An Acceptance Gate to Block False Improvements in Model Updates, with a Retrospective Clinical Evaluation

    Oct 21, 2026Dwi SunaryonoCross-FittingModel Selection

  8. EGiME: Entropy-Guided Model Evaluation in Few-Shot Learning

    Oct 19, 2026Dequan Jin, Tao Li, Lifeng Xing +2Model SelectionFew-Shot Learning

  9. Rethinking BPE: Merge Selection as Model Selection

    Oct 19, 2026Vijini Liyanage, François YvonTokenization in Language ModelsTokenization

  10. Predictable Scaling: Efficient Model Exploration via Scaling-Law Prediction

    Oct 16, 2026Aishwarya Wesanekar, Sheng-Tao Yang, Jiawei Zang +20Model SelectionScaling Laws

  11. Retrieval Over Training: Similarity search-based Model Selection for Time Series Anomaly Detection

    Oct 14, 2026Christos Panourgias, Roberto Stanzione, Adrien Petralia +2Model SelectionTime-Series Anomaly Detection

  12. Choosing LLMs for Strategic Agent Interactions

    Oct 13, 2026Arastun Mammadli, Herbert Woisetschläger, Jawad Fayaz +1Model SelectionLLM Decision-Making

  13. Why Linear Models Can Still Work in a Complex and Changing World

    Oct 9, 2026Fangzhou Lin, Dengzhe Hou, Yinxing Li +1Model SelectionLinear Regression

  14. Efficient and Generalizable Archetypal Analysis for Discrete Data

    Oct 8, 2026A. Emilie J. Wedenborg, Jesper Løve Hinrich, Morten MørupModel Selection

  15. Coefficient Calibration as Selection Pressure in Symbolic Regression

    Oct 7, 2026Mattia Billa, Veronica Guidetti, Federica MandreoliSymbolic RegressionModel Selection

  16. ProtocolMatch: Protocol-Dependent Model Selection for Scientific Dynamics Forecasting

    Oct 7, 2026Lu Wei, Yufeng Wang, Haibin LingModel SelectionPhysics-Informed ML

  17. LinearPFN: Amortized Variable Selection for Linear Models with Interactions

    Oct 5, 2026Louis Schiekiera, Max Zimmer, Christophe Roux +3Model SelectionPrior-Data Fitted Networks

  18. Beyond Successor Accuracy: State Retention for Recursive Self-Improvement in Recommendation

    Oct 5, 2026Jinfeng Xu, Zheyu Chen, Ziyue Peng +5Recursive Self-ImprovementModel Selection

  19. On Hyperparameter Tuning on the Test Set

    Oct 5, 2026Matteo Fregonara, Tom Viering, Jan van GemertModel SelectionBenchmark Validity

  20. The Effect of Missingness-Pattern Mismatch on Method Selection for Time-Series Classification: A Controlled Empirical Study

    Oct 4, 2026Ruiqi Zhao, Zishun Yuan, Zhentao Wang +3Model SelectionTime Series Classification

  21. Which LLM to pick? Online Active Model Selection for Large Language Models

    Oct 1, 2026Alessandro Turrin, Patrik Okanovic, Torsten Hoefler +1Model SelectionLLM Evaluation

  22. ArchitectureIQ: On the Measure of Training Intuition

    Sep 30, 2026Zirui Ren, Shaoyang Guo, Chencheng Tang +9Model SelectionLLM Evaluation

  23. A Generalisation Signal Need Not Be a Model-Selection Signal

    Sep 30, 2026Aditya Nagarsekar, M P Ashish Bhat, Aadi Nesarkar +5Model SelectionNeural Network Generalization

  24. Agentic Relative Camera Pose Estimation via Learned Ranking and Verification

    Sep 30, 2026Zhining Gu, Shangjie Du, Weimin Qiu +3Model SelectionRelative Pose Estimation

  25. From Checkpoint Variation to Selection Gains in Supervised Fine-Tuning

    Sep 29, 2026Yupeng Chang, Wenxuan Zhang, Yuan WuModel SelectionSupervised Fine-Tuning

  26. How Reusable Are Benchmarks with Richer Feedback?

    Sep 26, 2026Youssef Allouah, John Duchiadaptive data analysisBenchmark Validity

  27. Teacher-Anchored Selection of Post-Training Quantized Models under Domain Shift

    Sep 25, 2026Alejandro Rodriguez Dominguez, Muhammad Shahzad, Xia HongModel SelectionPost-Training Quantization

  28. Target alignment, dilution and forecast selection when cross-sectional forecasts share a common target

    Sep 22, 2026Masoud SoleimaniModel SelectionFinancial Forecasting