cs.LGNov 6, 2026

Surrogate Quality Score: A Novel Composite Performance Metric for Model Selection

Authors: Maaz Ahmad, Iftekhar A. Karimi

Organizations: Department of Chemical & Biomolecular Engineering National University of Singapore 4 Engineering Drive 4, Singapore 117585

Abstract

The growing reliance on high-fidelity, state-of-the-art machine learning based models for engineering decision-making necessitates robust and systematic approaches for model selection. While high predictive accuracy at untrained points is a necessary trait in the final model, other attributes such as model complexity, forecastability, explainability, scalability, and physics-awareness may be equally important or relevant criteria depending on application context and user requirements. In this work, we propose a novel composite performance metric, Surrogate Quality Score (SQS) for model selection based on predictive accuracy and model complexity simultaneously. SQS heuristically integrates these two attributes through a weighted product of normalized measures, yielding a unified score to reflect overall model quality. A user-specified parameter in SQS enables explicit control over the accuracy-complexity trade-off, thereby incorporating human judgement and preference in the model selection process. We extensively discuss and justify the formulation of SQS and demonstrate its utility through an illustrative example. By combining predictive accuracy and model complexity, SQS offers a systematic and objective approach for model selection based on both attributes.

Explore similar work

CardsList
  1. Model selection with proper scoring rules on data sets of time series: prefer the mean scaled score

    Jun 23, 2026Giorgio Corani, Stefano Damato, Dario Azzimonti +1Model SelectionTime Series Forecasting

  2. When May a Model Replace the Experiment? Audits, Licenses, and the Price of Trust in Surrogate-Driven Design

    Aug 2, 2026Shuangxiu, Ma, Wenhe +1Surrogate ModelingSurrogate-Assisted Optimization

  3. HugSelect: An Explainable Multi-Criteria Decision-Support Framework for foundation-model selection

    Aug 8, 2026Alireza Joonbakhsh, Arda Canser Adalı, Slinger Jansen +2Model SelectionRecommender Systems