cs.LGNov 3, 2026

The Confidence Score: a New Measure on Kernels

Authors: Elizabeth Hofer, Martin v. Mohrenschildt

Organizations: Department of Computing and Software, McMaster University, Hamilton, Ontario, Canada

Abstract

Across a wide range of applications, kernel measures are used to tune hyperparameters, select among candidate kernels, and assess the suitability of kernels for specific learning tasks. For classification, kernel measures are used to predict which kernels may produce accurate kernel classifiers. Many existing kernel measures, such as alignment to the ideal kernel, are designed to reward kernels which captures all samples from the same class as similar. While effective in many settings, this requirement is unnecessarily restrictive for classification, where classes may exhibit substantial internal structure. In this work, the "Confidence Score", a new kernel measure, is proposed. Unlike alignment-to-the-ideal kernel measures, the Confidence Score measures the alignment between an encoding of the ground truth and that ground truth projected by the kernel, allowing kernels that preserve intra-class structure to achieve high scores. Through experiments, it is demonstrated that the Confidence Score exhibits a higher correlation with classification accuracy across a variety of kernels on both real-world and synthetic datasets, compared to select other kernel measures.

Figures & tables

Explore similar work

CardsList
  1. Estimation of Confidence Bounds in Binary Classification using Wilson Score Kernel Density Estimation

    Feb 24, 2026Thorbjørn Mosekjær Iversen, Zebin Duan, Frederik HagelskjærBinary ClassificationConfidence Region Estimation