Empirical Evaluation of Quantum Kernel Methods for Classification: A Comparative Study with Classical Kernels
Organizations: Independent Researcher
Abstract
Quantum kernel methods are the most concrete near-term proposal for quantum machine learning on classical data, yet published benchmarks disagree on whether they outperform tuned classical kernels, and the disagreement cannot be resolved from the literature because the comparisons are not protocol-controlled. We argue that the obstacle is one of measurement, not theory: the usual setup fixes the quantum feature map's data scaling while grid-searching the classical kernel's hyperparameters, recomputes nothing per fold, and reports cost in simulator time. We therefore treat the comparison itself as the object of study and impose three controls. The bandwidth is tuned on the same grid budget as the classical , the kernel is recomputed inside every fold from fold-fitted preprocessing, and cost is counted in hardware circuit evaluations. On top of these we run a factorial design of 324 cells in which dimensionality, training size, class separability and data structure are explicit covariates, together with four standard datasets, a shots-versus-gate-noise ablation, and a cost sweep. The dominant effect we measure is not quantum: tuning the feature map's bandwidth is worth 0.120 accuracy on synthetic data and 0.339 on real data, exceeding every quantum-classical difference we observe. Tuned quantum kernels are then statistically indistinguishable from a tuned RBF on all four real datasets. The advantage on synthetic data is confined almost entirely to data generated by the feature map itself, and it shrinks with dimensionality (-0.0045 per qubit) while growing with sample size. Finite sampling costs an order of magnitude more accuracy than gate and readout noise, and a fidelity kernel needs circuits at n = 10,000. Protocol variance is thus sufficient to explain the field's contradictory conclusions.
Figures & tables
| method | grid size |
|---|---|
| quantum (13 bandwidths 7 ) | 91 |
| SVM-RBF (11 7 ) | 77 |
| SVM-poly | 28 |
| SVM-linear | 7 |
| HistGradientBoosting | 6 |
| structure | mean | median | win rate | cells |
|---|---|---|---|---|
| adhoc | +0.058 | +0.03 | 65.7% | 108 |
| linear | -0.002 | 0.00 | 3.7% | 108 |
| xor | -0.026 | -0.02 | 21.3% | 108 |
| term | coef | std err | t | p |
|---|---|---|---|---|
| intercept | +0.0230 | 0.0342 | 0.67 | .502 |
| (qubits) | -0.0045 | 0.0018 | -2.57 | .011 |
| +0.0152 | 0.0069 | 2.19 | .029 | |
| Bayes error | -0.1048 | 0.0397 | -2.64 | .009 |
| structure[linear] | -0.0601 | 0.0096 | -6.25 | <.001 |
| structure[xor] | -0.0836 | 0.0096 | -8.69 | <.001 |
| arm | Tier A accuracy | Tier B accuracy |
|---|---|---|
| tuned bandwidth | 0.726 | 0.956 |
| untuned ( c = 1 ) | 0.606 | 0.617 |
| gap | +0.120 | +0.339 |
| dataset | best quantum | best classical | p (corrected) | |
|---|---|---|---|---|
| breast_cancer | 0.9811 | 0.9800 | +0.0011 | .245 |
| wine | 0.9872 | 0.9846 | +0.0026 | .884 |
| iris | 0.9433 | 0.9533 | -0.0100 | .354 |
| ionosphere | 0.9267 | 0.9389 | -0.0122 | .305 |
| method | mean rank |
|---|---|
| svm_rbf | 3.18 |
| svm_poly | 3.34 |
| hgb | 4.05 |
| quantum_fidelity_iqp | 4.78 |
| quantum_projected_z | 4.85 |
| svm_linear | 4.88 |
| structure | iqp | z |
|---|---|---|
| adhoc | 0.639 | 0.604 |
| linear | 0.868 | 0.868 |
| xor | 0.668 | 0.706 |
| qubits | off-diagonal variance | alignment | accuracy |
|---|---|---|---|
| 2 | 0.0552 | 0.236 | 0.779 |
| 4 | 0.0164 | 0.158 | 0.651 |
| 6 | 0.0131 | 0.147 | 0.620 |
| 8 | 0.0148 | 0.147 | 0.612 |
| kernel | circuits (fitted) | simulator (fitted) | depth | 2-qubit gates | circuits at n=800 |
|---|---|---|---|---|---|
| fidelity | 98 | 120 | 319,600 | ||
| projected | 49 | 60 | 800 |
| shots | noise | accuracy | vs exact | PSD repair |
|---|---|---|---|---|
| exact | none | 0.690 | n/a | 0.000 |
| exact | readout 0.02 | 0.690 | +0.000 | 0.002 |
| exact | depolarising 0.001 | 0.700 | +0.010 | 0.000 |
| exact | depolarising 0.01 | 0.700 | +0.010 | 0.000 |
| 1024 | none | 0.630 | -0.060 | 2.583 |
| 1024 | readout 0.02 | 0.620 | -0.070 | 2.822 |
| ID | Hypothesis | Verdict | Evidence |
|---|---|---|---|
| H1 | Untuned quantum underperforms tuned classical | Supported | untuned 0.606 vs svm_rbf 0.726 (Tier A) |
| H2 | Bandwidth tuning closes most of the gap | Supported | +0.120 Tier A, +0.339 Tier B |
| H3 | Even tuned, no consistent advantage on natural data | Supported | no significant delta on any Tier B dataset |
| H4 | Kernel values concentrate with qubit count | Partial | 3.7 decay, but flattens after |
| H5 | Cost gap is orders of magnitude | Supported | , 58 days at |
Quantum Kernel Methods
Quantum kernel methods use quantum feature maps and similarity measures to learn patterns, with potential benefits for structured data and quantum systems.
See all 54 papers