Model Selection

Ask about this topic

Overview

Model selection studies how to choose among candidate models or configurations so predictions generalize while meeting goals such as interpretability, cost, or speed. Common approaches include cross-validation, information criteria such as AIC, BIC, and minimum description length, Bayesian methods, and regularization for selecting features or model complexity. For large model pools, active evaluation, bandits, meta-learning, and routing systems allocate tests or queries to identify promising models, ensembles, or task-specific specialists. A central challenge is that selection can overfit validation data, and rankings can change with the evaluation protocol or deployment setting, so no single criterion works everywhere.

Latest papers

CardsList

96 papers21 papers in the last four weeks, up 133% on the four weeks before. 0.1% of all new papers.

  1. The Trust Paradox: How CS Researchers Engage LLM Leaderboards

    May 27, 2026Pouya Sadeghi, Anamaria Crisan, Jimmy LinModel SelectionLLM Evaluation

    University of Waterloo Waterloo, Canada

  2. Bridging Maximum Likelihood and Optimal Transport for Efficient Inference and Model Selection in Stochastic Block Models

    May 27, 2026Simon Queric, Cédric Vincent-Cuaz, Charles Bouveyron +1Model SelectionLatent Variable Models

    Universit´e Cˆote d’Azur, Inria, CNRS LJAD, Maasai Nice, France · EPFL Lausanne, Switzerland · Universit´e Cˆote d’Azur, Inria, CNRS CEPAM, Maasai Nice, France

  3. Large Language Model Selection with Limited Annotations

    May 24, 2026Yavuz Durmazkeser, Patrik Okanovic, Andreas Kirsch +2Model SelectionLLM Evaluation

    TU Delft · ETH Zurich

  4. MedicalRec: Medical recommender system for image classification without retraining

    May 23, 2026Roghayeh Taghavi, Aysa Hasanazde Bashkandi, Amir Ali Bengari +5Model SelectionHealthcare

  5. LAST-RAG: Literature-Anchored Stochastic Trajectory Retrieval-Augmented Generation for Knowledge-Conditioned Degradation Model Selection

    May 18, 2026Hanbyeol Park, Hyerim BaeModel SelectionRetrieval-Augmented Generation

    Department of Industrial Engineering · Pusan National University · Busan, Republic of Korea

  6. Automatic Unsupervised Ensemble Outlier Model Selection--Extended Version

    May 15, 2026Hong-Phuc Phan, Tuan-Anh Vu, Tung Kieu +3Model SelectionUnsupervised Learning

    Department of Software Engineering, FPT University, Vietnam · Department of Information Technology, Can Tho University of Technology, Vietnam · Department of Computer Science, Aalborg University, Denmark +2

  7. A Comparative Study of Model Selection Criteria for Symbolic Regression

    May 11, 2026Ali Soltani, Gabriel Kronberger, Fabricio Olivetti de Franca +2Model SelectionSymbolic Regression

    Aarhus University Department of Mechanical Engineering Aarhus, Denmark · Heuristic and Evolutionary Algorithms Laboratory (HEAL) University of Applied Sciences Upper Austria Hagenberg, Austria · Federal University of ABC Center for Mathematics, Computing, and Cognition Brazil +1

  8. Valid Best-Model Identification for LLM Evaluation via Low-Rank Factorization

    May 11, 2026Elad Tolochinsky, Yaniv Tenzer, Yaniv RomanoModel SelectionMulti-Armed Bandits

    Department of Computer Science, Technion – Israel Institute of Technology · Department of Electrical and Computer Engineering, Technion – Israel Institute of Technology

  9. ModelLens: Finding the Best for Your Task from Myriads of Models

    May 8, 2026Rui Cai, Weijie Jacky Mo, Xiaofei Wen +5Model SelectionLLM Routing

    University of California, Davis · Arizona State University · Morgan Stanley

  10. Kernel Selection is Model Selection: A Unified Complexity-Penalized Approach for MMD Two-Sample Tests

    May 7, 2026Yijin Ni, Xiaoming HuoModel SelectionTwo-Sample Testing

    H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology Atlanta, GA 30332, USA

  11. Linear Models, Variable Selection, Artificial Intelligence

    Apr 29, 2026By Riyadh Alrawkan, Edward Boone, Ryad Ghanam +1Model SelectionLinear Regression

    1Statistical Sciences and Operations Research, Virginia Commonwealth University, Richmond, Virginia, USA · 2Liberal Arts and Sciences, Virginia Commonwealth University School of the Arts in Qatar, Doha, Qatar · 3Research School of Finance, Actuarial Studies and Statistics, Australian National University, Canberra, AUS

  12. Occam's Razor is Only as Sharp as Your ELBO

    Apr 28, 2026Ethan Harvey, Geoff Pleiss, Michael C. HughesModel SelectionBayesian Inference

    Tufts University

  13. Designing a double deep reinforcement learning selection tool for resilient demand prediction

    Apr 12, 2026Bilel Abderrahmane Benziane, Benoit Lardeux, Ayoub Mcharek +1Model SelectionTime Series Forecasting

    DataLab, Generix Group, 8 Rue Simone IFF, 75012, Paris, France

  14. Choosing the Right Regularizer for Applied ML: Simulation Benchmarks of Popular Scikit-learn Regularization Frameworks

    Apr 4, 2026Benjamin S. Knight, Ahsaas BajajRidge RegressionModel Selection

  15. Asymptotic Optimism for Tensor Regression Models with Applications to Neural Network Compression

    Mar 27, 2026Haoming Shi, Eric C. Chi, Hengrui LuoModel SelectionTensor Decomposition

    Department of Statistics, Rice University · School of Statistics, University of Minnesota

  16. Epistemic Compression: The Case for Deliberate Ignorance in High-Stakes AI

    Mar 26, 2026Steffen LukasDistribution Shift RobustnessModel Selection

    Charité – Universitätsmedizin Berlin, Germany

  17. Cluster-Specific Predictive Modeling: A Scalable Solution for Resource-Constrained Wi-Fi Controllers

    Mar 23, 2026Gianluca Fontanesi, Luca Barbieri, Lorenzo Galati Giordano +2Time Series ForecastingModel Selection

    Radio Systems Research, Nokia Bell Labs, Stuttgart, Germany · Nokia Spain, Madrid

  18. Minimum-Action Learning: Energy-Constrained Symbolic Model Selection for Physical Law Identification from Noisy Data

    Mar 16, 2026Martin G. FraschScientific DiscoveryModel Selection

    Institute on Human Development and Disability, University of Washington, Seattle, WA 98195, USA · Health Stream Analytics, LLC, Seattle, WA, USA

  19. Hypothesis Class Determines Explanation: Why Accurate Models Disagree on Feature Attribution

    Mar 16, 2026Thackshanaramana BFeature AttributionExplainability Evaluation

    SRM Institute of Science and Technology, India

  20. Scalable Simulation-Based Model Inference with Test-Time Complexity Control

    Mar 16, 2026Manuel Gloeckler, J. P. Manzano-Patrón, Stamatios N. Sotiropoulos +2Model SelectionSimulation-Based Inference

    Machine Learning in Science, University of Tübingen and Tübingen AI Center, Tübingen, Germany · Sir Peter Mansfield Imaging Centre, School of Medicine, University of Nottingham, UK · National Institute for Health Research (NIHR) Nottingham Biomedical Research Centre, Queens Medical Centre, Nottingham, United Kingdom +1

  21. When Bigger is Worse: A Practitioner's Guide to Model Selection Under Data Scarcity

    Mar 2, 2026Kwame Mbobda-Kuate, Gabriel KasmiModel SelectionEfficient Object Detection

    ENSAE Paris, Palaiseau, 91120, France. · Centre O.I.E., Mines Paris – PSL University, Sophia-Antipolis, 06904, France.

  22. Takeuchi's Information Criteria as Generalization Measures for DNNs Close to NTK Regime

    Feb 26, 2026Hiroki Naganuma, Taiji Suzuki, Rio Yokota +3Neural Network GeneralizationModel Selection

    Department of Computer Science and Operations Research, Université de Montréal, Canada · Mila – Quebec AI Institute, Canada · Department of Mathematical Informatics, The University of Tokyo, Japan +4

  23. Relatron: Automating Relational Machine Learning over Relational Databases

    Feb 26, 2026Zhikai Chen, Han Xie, Jian Zhang +3Relational Deep LearningModel Selection

    Michigan State University · Amazon

  24. Beyond Accuracy: A Unified Random Matrix Theory Diagnostic Framework for Crash Classification Models

    Feb 23, 2026Ibne Farabi Shihab, Sanjeda Akter, Anuj SharmaModel SelectionClassification

    Department of Computer Science, Iowa State University, Ames, IA 50010 · Department of Civil, Construction and Environmental Engineering, Iowa State University, Ames, IA 50010

  25. IDSelect: A RL-Based Cost-Aware Selection Agent for Video-based Multi-Modal Person Recognition

    Feb 22, 2026Yuyang Ji, Yixuan Shen, Kien Nguyen +2Efficient Multimodal InferenceModel Selection

    Department of Computer Science, Drexel University · School of Electrical Engineering and Robotics, Queensland University of Technology · Department of Electrical and Computer Engineerin, Drexel University

  26. Bayesian Online Model Selection

    Feb 20, 2026Aida Afshar, Yuke Zhang, Aldo PacchianoMarkovian BanditsModel Selection

    Boston University · Broad Institute of MIT and Harvard

  27. Picking the Right Specialist: Attentive Neural Process-based Selection of Task-Specialized Models as Tools for Agentic Healthcare Systems

    Feb 16, 2026Pramit Saha, Joshua Strong, Mohammad Alsharid +2Tool SelectionModel Selection

    Department of Engineering Science, University of Oxford, United Kingdom · Department of Computer Science, Khalifa University, Abu Dhabi, United Arab Emirates

  28. EvoXplain: When Machine Learning Models Agree on Predictions but Disagree on Why -- Measuring Mechanistic Multiplicity Across Training Runs

    Dec 23, 2025Chama BensmailCancer GenomicsModel Selection

    University of Hertfordshire

  29. REMSA: Foundation Model Selection for Remote Sensing via a Constraint-Aware Agent

    Nov 21, 2025Binger Chen, Tacettin Emre Bök, Behnood Rasti +2Model SelectionGeospatial Foundation Models

    Humboldt-Universität zu Berlin, Berlin, Germany · 5U AI, Munich, Germany · Technische Universität Berlin & BIFOLD, Berlin, Germany

  30. Survival of the fittest Cox model: Pivotal variable selection for time-to-event data

    Oct 22, 2025Maxime van Cutsem, Sylvain SardyModel SelectionSurvival Analysis

    Department of Mathematics, University of Geneva