ECG Biometrics with ArcFace-Inception: External Validation on MIMIC and HEEDB
Abstract
ECG biometrics has been studied mainly on small cohorts and short inter-session intervals, leaving open how identification behaves under large galleries, external domain shift, and multi-year temporal gaps. We evaluated a 1D Inception-v1 model trained with ArcFace on an internal clinical corpus of 164,440 12-lead ECGs from 53,079 patients and tested it on larger cohorts derived from MIMIC-IV-ECG and HEEDB. The study used a unified closed-set leave-one-out protocol with Rank@K and TAR@FAR metrics, together with scale, temporal-stress, reranking, and confidence analyses. Under general comparability, the system achieved Rank@1 of 0.9506 on ASUGI-DB, 0.8291 on MIMIC-GC, and 0.6884 on HEEDB-GC. In the temporal stress test at constant gallery size, Rank@1 declined from 0.7853 to 0.6433 on MIMIC and from 0.6864 to 0.5560 on HEEDB from 1 to 5 years. Scale analysis on HEEDB showed monotonic degradation as gallery size increased and recovery as more examinations per patient became available. On HEEDB-RR, post-hoc reranking further improved retrieval, with AS-norm reaching Rank@1 = 0.8005 from a 0.7765 baseline. ECG identity information therefore remains measurable under externally validated large-scale closed-set conditions, but its operational quality is strongly affected by domain heterogeneity, longitudinal drift, gallery size, and second-stage score processing.
Figures & tables
| Step | Criterion | Rationale |
|---|---|---|
| 1 | Valid PatientID | Fundamental requirement for constructing genuine and impostor pairs |
| 2 | At least 2 ECGs per patient; minimum distance of 30 days between consecutive examinations | Ensures intra-subject comparisons with real temporal variability |
| 3 | Maximum cap of 10 ECGs per patient | Limits imbalance due to patients with very frequent examinations |
| Step | Description | ECGs | Patients |
|---|---|---|---|
| 1 | Initial base with valid PatientID | 687,147 | 191,355 |
| 2 | Multi-exam filter + temporal constraint ( 30 days between consecutive examinations) | 395,095 | 92,523 |
| 3 | Outlier cleaning on fiducial features + maximum 10 ECGs/patient | 168,999 | 54,218 |
| 4 | Device harmonization (ELI250 only) | 164,440 | 53,079 |
| Split | ECGs | Patients | Min ECG/pat. | Mean ECG/pat. | Max ECG/pat. |
|---|---|---|---|---|---|
| Train | 60,153 | 11,647 | 4 | 5.16 | 10 |
| Validation | 51,988 | 20,716 | 2 | 2.51 | 10 |
| Test | 52,299 | 20,716 | 2 | 2.52 | 10 |
| Dataset | Mean ( ) | Variance ( ) | Skewness ( ) | Kurtosis ( ) | Excess kurtosis |
|---|---|---|---|---|---|
| HEEDB-GC (full) | 3.2426 | 2.9533 | 1.7000 | 5.6226 | 2.6226 |
| HEEDB-RR ( ) | 3.2428 | 2.9552 | 1.7006 | 5.6246 | 2.6246 |
| 0.0002 | 0.0019 | 0.0005 | 0.0020 | 0.0020 |
| Stage | Type | Configuration | Out ch. |
|---|---|---|---|
| Stem | Conv1D-BN-ReLU 2 | kernel 7, stride 1; 12 64 64 | 64 |
| Inception 1 | 4 branches concat dropout | / / / MaxPool ; | 128 |
| Downsample 1 | Conv1D stride 2 | kernel 3 | 128 |
| Inception 2 | 4 branches concat dropout | same structure; | 192 |
| Downsample 2 | Conv1D stride 2 | kernel 3 | 192 |
| Inception 3 | 4 branches concat dropout | same structure; | 256 |
| Dataset | Rank@1 | Rank@5 | Rank@10 | TAR@FAR=1e-3 | TAR@FAR=1e-4 |
|---|---|---|---|---|---|
| ASUGI-DB | 0.9506 | 0.9670 | 0.9718 | 0.9675 | 0.9448 |
| MIMIC-GC | 0.8291 | 0.8768 | 0.8916 | 0.8188 | 0.7079 |
| HEEDB-GC | 0.6884 | 0.7593 | 0.7807 | 0.7210 | 0.6002 |
| Discriminability | Calibration | Selective prediction | |||||
|---|---|---|---|---|---|---|---|
| Dataset | Brier | ECE | [email protected] | [email protected] | |||
| ASUGI-DB | 0.9702 | 0.4820 | 0.4882 | 0.0207 | 0.0185 | 0.8805 | 0.0014 |
| MIMIC-GC | 0.8916 | 0.5185 | 0.3731 | 0.0849 | 0.0340 | 0.5889 | 0.0166 |
| HEEDB-GC | 0.8173 | 0.3969 | 0.4204 | 0.1185 | 0.0286 | 0.3573 | 0.0331 |
| Gallery | Ex=2 | Ex=3 | Ex=4 | Ex=5 | Ex=6 | Ex=7 | Mean |
|---|---|---|---|---|---|---|---|
| 500 | 0.7517 | 0.8568 | 0.8967 | 0.9083 | 0.9205 | 0.9224 | 0.8761 |
| 1000 | 0.7286 | 0.8354 | 0.8798 | 0.8940 | 0.9057 | 0.9116 | 0.8592 |
| 1500 | 0.7173 | 0.8255 | 0.8699 | 0.8856 | 0.8973 | 0.9052 | 0.8501 |
| 2000 | 0.7063 | 0.8162 | 0.8652 | 0.8809 | 0.8934 | 0.9011 | 0.8438 |
| 2500 | 0.6959 | 0.8108 | 0.8596 | 0.8759 | 0.8891 | 0.8978 | 0.8382 |
| 3000 | 0.6864 | 0.8052 | 0.8549 | 0.8716 | 0.8854 | 0.8940 | 0.8329 |
| Gap | MIMIC-TST ( ) | HEEDB-TST ( ) |
|---|---|---|
| 1y | 0.7853 | 0.6864 |
| 2y | 0.7473 | 0.6452 |
| 3y | 0.7157 | 0.6047 |
| 4y | 0.6834 | 0.5776 |
| 5y | 0.6433 | 0.5560 |
| Algorithm | Rank@1 | Rank@5 | Rank@10 | [email protected] | Brier | ECE | [email protected] | [email protected] |
|---|---|---|---|---|---|---|---|---|
| baseline | 0.7765 | 0.8304 | 0.8471 | – | – | – | – | – |
| asnorm | 0.7931 | 0.8417 | 0.8573 | 0.9216 | 0.0572 | 0.0319 | 0.6429 | 0.0031 |
| snorm | 0.7817 | 0.8358 | 0.8537 | 0.8633 | 0.1038 | 0.0349 | 0.4614 | 0.0362 |
| znorm | 0.7765 | 0.8304 | 0.8471 | 0.8508 | 0.1122 | 0.0492 | 0.4073 | 0.0411 |
| tnorm | 0.7644 | 0.8238 | 0.8416 | 0.8538 | 0.1039 | 0.0377 | 0.4817 | 0.0327 |
| QE | 0.7626 | 0.8174 | 0.8259 | 0.8609 | 0.0975 | 0.0439 | 0.5128 | 0.0201 |
| Rank@1 | Rank@5 | Rank@10 | [email protected] | Brier | ECE | [email protected] | [email protected] | |
|---|---|---|---|---|---|---|---|---|
| 1 | 0.7943 | 0.8387 | 0.8552 | 0.9623 | 0.0391 | 0.0690 | 0.6573 | 0.0000 |
| 2 | 0.7977 | 0.8326 | 0.8472 | 0.7974 | 0.1580 | 0.0332 | 0.0182 | 0.0000 |
| 3 | 0.8003 | 0.8371 | 0.8527 | 0.9499 | 0.0653 | 0.1403 | 0.5124 | 0.0000 |
| 4 | 0.8005 | 0.8386 | 0.8541 | 0.9682 | 0.0536 | 0.1051 | 0.5710 | 0.0000 |
| 5 | 0.7999 | 0.8389 | 0.8543 | 0.9653 | 0.0482 | 0.0970 | 0.6009 | 0.0000 |
| 6 | 0.7995 | 0.8393 | 0.8549 | 0.9648 | 0.0460 | 0.0885 | 0.6140 | 0.0000 |
Appendix figures & tables31 assets
Supplementary material from the paper’s appendix.
Appendix
| Corpus | Short name | Protocol | N datasets | Purpose |
| ASUGI | ASUGI-DB | Training / Validation / Internal test | 3 | Patient-disjoint splits in three configurations (db1000/1001/1002); db1001 adopted as reference. |
| MIMIC | MIMIC-GC | General Comparability | 1 | Closed-set evaluation on the entire eligible pool of the MIMIC corpus (231,329 ECGs, 63,895 patients). |
| MIMIC-TST | Temporal Stress Test | 5 | One pair per patient for each of the 5 temporal targets (1–5 years 3 months), with constant gallery at . | |
| HEEDB | HEEDB-GC | General Comparability | 1 | Closed-set evaluation on the entire eligible pool of the HEEDB/i0006 corpus, 500 Hz ECGs only (385,079 ECGs, 118,756 patients). |
| HEEDB-TST | Temporal Stress Test | 5 | One pair per patient for each of the 5 temporal targets (1–5 years 3 months), with constant gallery at . | |
| HEEDB-scale | Scale analysis | Stratified sample with full grid of gallery size (500–7000, 14 values) exams per patient (2–7, 6 values) = 84 configurations. |
| Dataset ID | Split | ECGs | Patients | Min ECG/pat. | Mean ECG/pat. | Max ECG/pat. |
|---|---|---|---|---|---|---|
| 1000 | Train | 89,576 | 21,407 | 3 | 4.18 | 10 |
| 1000 | Validation | 37,352 | 15,836 | 2 | 2.36 | 10 |
| 1000 | Test | 37,512 | 15,836 | 2 | 2.37 | 10 |
| 1001 | Train | 60,153 | 11,647 | 4 | 5.16 | 10 |
| 1001 | Validation | 51,988 | 20,716 | 2 | 2.51 | 10 |
| 1001 | Test | 52,299 | 20,716 | 2 | 2.52 | 10 |
| Parameter | Value |
|---|---|
| Manufacturer | Mortara Instrument (Milwaukee, WI, USA) |
| Leads | 12 simultaneous (I, II, III, aVR, aVL, aVF, V1–V6) |
| Sampling frequency | 1000 Hz (recording); 40,000 Hz (pacemaker detection) |
| ADC resolution | 20 bit, 1.17 V/LSB |
| Frequency response | 0.05–300 Hz |
| Input impedance | 50 M (ANSI/AAMI EC11) |
| Gallery | Ex=2 | Ex=3 | Ex=4 | Ex=5 | Ex=6 | Ex=7 | Mean |
|---|---|---|---|---|---|---|---|
| 500 | 0.8107 | 0.9036 | 0.9327 | 0.9360 | 0.9456 | 0.9465 | 0.9125 |
| 1000 | 0.7937 | 0.8825 | 0.9186 | 0.9271 | 0.9361 | 0.9387 | 0.8994 |
| 1500 | 0.7824 | 0.8747 | 0.9103 | 0.9216 | 0.9294 | 0.9342 | 0.8921 |
| 2000 | 0.7731 | 0.8673 | 0.9064 | 0.9170 | 0.9270 | 0.9318 | 0.8871 |
| 2500 | 0.7646 | 0.8634 | 0.9017 | 0.9141 | 0.9239 | 0.9290 | 0.8828 |
| 3000 | 0.7568 | 0.8581 | 0.8976 | 0.9104 | 0.9211 | 0.9264 | 0.8784 |
| Gallery | Ex=2 | Ex=3 | Ex=4 | Ex=5 | Ex=6 | Ex=7 | Mean |
|---|---|---|---|---|---|---|---|
| 500 | 0.8292 | 0.9173 | 0.9426 | 0.9453 | 0.9542 | 0.9549 | 0.9239 |
| 1000 | 0.8158 | 0.8993 | 0.9305 | 0.9369 | 0.9447 | 0.9476 | 0.9125 |
| 1500 | 0.8046 | 0.8888 | 0.9229 | 0.9324 | 0.9397 | 0.9434 | 0.9053 |
| 2000 | 0.7954 | 0.8833 | 0.9193 | 0.9291 | 0.9374 | 0.9414 | 0.9010 |
| 2500 | 0.7862 | 0.8802 | 0.9151 | 0.9259 | 0.9346 | 0.9391 | 0.8969 |
| 3000 | 0.7793 | 0.8752 | 0.9115 | 0.9226 | 0.9324 | 0.9367 | 0.8929 |
| Gallery | Ex=2 | Ex=3 | Ex=4 | Ex=5 | Ex=6 | Ex=7 | Mean |
|---|---|---|---|---|---|---|---|
| 500 | 0.8910 | 0.9516 | 0.9650 | 0.9690 | 0.9764 | 0.9750 | 0.9547 |
| 1000 | 0.8758 | 0.9385 | 0.9585 | 0.9640 | 0.9699 | 0.9703 | 0.9462 |
| 1500 | 0.8674 | 0.9316 | 0.9532 | 0.9598 | 0.9661 | 0.9675 | 0.9409 |
| 2000 | 0.8599 | 0.9276 | 0.9505 | 0.9577 | 0.9634 | 0.9656 | 0.9374 |
| 2500 | 0.8521 | 0.9253 | 0.9479 | 0.9556 | 0.9611 | 0.9640 | 0.9343 |
| 3000 | 0.8459 | 0.9220 | 0.9458 | 0.9534 | 0.9594 | 0.9626 | 0.9315 |
| Gallery | Ex=2 | Ex=3 | Ex=4 | Ex=5 | Ex=6 | Ex=7 | Mean |
|---|---|---|---|---|---|---|---|
| 500 | 0.9128 | 0.9593 | 0.9712 | 0.9753 | 0.9815 | 0.9804 | 0.9634 |
| 1000 | 0.8928 | 0.9487 | 0.9652 | 0.9700 | 0.9753 | 0.9757 | 0.9546 |
| 1500 | 0.8836 | 0.9420 | 0.9605 | 0.9664 | 0.9720 | 0.9729 | 0.9496 |
| 2000 | 0.8778 | 0.9375 | 0.9583 | 0.9647 | 0.9697 | 0.9712 | 0.9465 |
| 2500 | 0.8709 | 0.9351 | 0.9558 | 0.9630 | 0.9680 | 0.9697 | 0.9437 |
| 3000 | 0.8642 | 0.9329 | 0.9534 | 0.9612 | 0.9661 | 0.9687 | 0.9411 |
| Gap | #Patients | #ECGs | Rank@1 | Rank@10 | TAR@1e-3 | TAR@1e-4 |
|---|---|---|---|---|---|---|
| 1y | 32,373 | 64,746 | 0.7583 | 0.8395 | 0.8546 | 0.7503 |
| 2y | 25,380 | 50,760 | 0.7305 | 0.8196 | 0.8260 | 0.7107 |
| 3y | 21,021 | 42,042 | 0.7010 | 0.7984 | 0.8022 | 0.6724 |
| 4y | 17,494 | 34,988 | 0.6732 | 0.7792 | 0.7751 | 0.6353 |
| 5y | 14,521 | 29,042 | 0.6433 | 0.7537 | 0.7436 | 0.5914 |
| Gap | #Patients | #ECGs | Rank@1 | Rank@10 | TAR@1e-3 | TAR@1e-4 |
|---|---|---|---|---|---|---|
| 1y | 53,959 | 107,918 | 0.6351 | 0.7305 | 0.7586 | 0.6489 |
| 2y | 39,742 | 79,484 | 0.6060 | 0.7078 | 0.7283 | 0.6076 |
| 3y | 29,484 | 58,968 | 0.5784 | 0.6852 | 0.6984 | 0.5625 |
| 4y | 21,529 | 43,058 | 0.5601 | 0.6701 | 0.6738 | 0.5314 |
| 5y | 14,763 | 29,526 | 0.5560 | 0.6693 | 0.6559 | 0.5090 |
| Feature | Min | Max | Unit | Description |
|---|---|---|---|---|
| VentricularRate | 40 | 120 | bpm | Ventricular rate |
| PRInterval | 100 | 240 | ms | PR interval duration |
| QRSDuration | 60 | 150 | ms | QRS complex duration |
| QTInterval | 300 | 500 | ms | QT interval duration |
| QTCorrected | 300 | 500 | ms | Corrected QT (Bazett formula) |
| PAxis | 30 | 90 | ° | P-wave axis |
| Gap | Rank@1 | Rank@5 | Rank@10 | TAR@1e-3 | TAR@1e-4 |
|---|---|---|---|---|---|
| 1y | 0.7853 | 0.8420 | 0.8608 | 0.8551 | 0.7483 |
| 2y | 0.7473 | 0.8112 | 0.8340 | 0.8247 | 0.7097 |
| 3y | 0.7157 | 0.7894 | 0.8120 | 0.8055 | 0.6756 |
| 4y | 0.6834 | 0.7600 | 0.7873 | 0.7767 | 0.6369 |
| 5y | 0.6433 | 0.7263 | 0.7537 | 0.7436 | 0.5914 |
| Gap | Rank@1 | Rank@5 | Rank@10 | TAR@1e-3 | TAR@1e-4 |
|---|---|---|---|---|---|
| 1y | 0.6864 | 0.7501 | 0.7725 | 0.7646 | 0.6555 |
| 2y | 0.6452 | 0.7164 | 0.7397 | 0.7288 | 0.6053 |
| 3y | 0.6047 | 0.6806 | 0.7075 | 0.6946 | 0.5679 |
| 4y | 0.5776 | 0.6584 | 0.6873 | 0.6761 | 0.5363 |
| 5y | 0.5560 | 0.6382 | 0.6693 | 0.6559 | 0.5090 |
| Cohort size | Method | Rank@1 | Rank@5 | Rank@10 | Rank@100 | Rank@200 |
|---|---|---|---|---|---|---|
| – | baseline | 0.7765 | 0.8304 | 0.8471 | 0.8940 | 0.9051 |
| 100 | asnorm | 0.7767 | 0.8330 | 0.8518 | 0.8980 | 0.9091 |
| 100 | cnorm | 0.7383 | 0.8151 | 0.8385 | 0.8962 | 0.9086 |
| 100 | snorm | 0.7767 | 0.8330 | 0.8518 | 0.8980 | 0.9091 |
| 100 | tnorm | 0.7383 | 0.8151 | 0.8385 | 0.8962 | 0.9086 |
| 100 | znorm | 0.7765 | 0.8304 | 0.8471 | 0.8940 | 0.9051 |
| Cohort size | Method | Rank@1 | Rank@5 | Rank@10 | Rank@100 | Rank@200 |
|---|---|---|---|---|---|---|
| – | baseline | 0.7765 | 0.8304 | 0.8471 | 0.8940 | 0.9051 |
| 100 | asnorm | 0.7628 | 0.8235 | 0.8412 | 0.8933 | 0.9052 |
| 100 | cnorm | 0.7106 | 0.7963 | 0.8227 | 0.8875 | 0.9031 |
| 100 | snorm | 0.7628 | 0.8235 | 0.8412 | 0.8933 | 0.9052 |
| 100 | tnorm | 0.7106 | 0.7963 | 0.8227 | 0.8875 | 0.9031 |
| 100 | znorm | 0.7765 | 0.8304 | 0.8471 | 0.8940 | 0.9051 |
| Algorithm | Configuration | Rank@1 | Rank@5 | Rank@10 | Rank@100 | Rank@200 |
|---|---|---|---|---|---|---|
| Baseline | – | 0.7765 | 0.8304 | 0.8471 | 0.8940 | 0.9051 |
| Diffusion | K200_lk10_ 0.950_it5 | 0.7659 | 0.8241 | 0.8430 | 0.8928 | 0.9051 |
| Diffusion | K200_lk15_ 0.950_it8 | 0.7488 | 0.8164 | 0.8372 | 0.8914 | 0.9051 |
| Diffusion | K300_lk20_ 0.970_it10 | 0.7488 | 0.8160 | 0.8373 | 0.8913 | 0.9033 |
| Diffusion | K400_lk30_ 0.990_it20 | 0.6894 | 0.7908 | 0.8197 | 0.8864 | 0.9009 |
| AQE/ QE | K3, =1.0 | 0.7358 | 0.8148 | 0.8210 | 0.8582 | 0.8738 |
| Format | Parameters | Description |
|---|---|---|
| K400_C500_S42 | K, C, S | = shortlist size; = cohort size; = seed. Used for S-norm, Z-norm, and C-norm. |
| K400_N200_scan2000 | K, N, scan | = shortlist size; = number of top-cohort samples used for adaptive statistics; scan = candidates scanned to estimate the statistics. Used for AS-norm. |
| K3_a2.0 | K, | = number of neighbors for query expansion; = QE weight exponent. Used for AQE/ QE. |
| K200_lk10_a0p950_it5 | K, lk, , it | = shortlist; lk = local_k of the k-NN graph; a0p950 = ; it = diffusion iterations. Used for diffusion. |
| baseline / -- | – | No reranking; original ranking from cosine embeddings. |
| Method | Configuration | Rank@1 | Rank@5 | Rank@10 | Rank@100 | Rank@200 |
|---|---|---|---|---|---|---|
| baseline | – | 0.7765 | 0.8304 | 0.8471 | 0.8940 | 0.9051 |
| asnorm | K400_N200_scan2000 | 0.7931 | 0.8417 | 0.8573 | 0.8994 | 0.9099 |
| snorm | K400_C500_S42 | 0.7766 | 0.8317 | 0.8490 | 0.8960 | 0.9071 |
| znorm | K400_C500_S42 | 0.7485 | 0.8168 | 0.8384 | 0.8931 | 0.9046 |
| cnorm | K400_C500_S42 | 0.7489 | 0.8175 | 0.8395 | 0.8932 | 0.9045 |
| diffusion | K200_lk10_ 0.950_it5 | 0.7659 | 0.8241 | 0.8430 | 0.8928 | 0.9051 |
| Algorithm | Config | R@1 | R@5 | R@10 | [email protected] | Brier | ECE | [email protected] | [email protected] |
|---|---|---|---|---|---|---|---|---|---|
| baseline | – | 0.7765 | 0.8304 | 0.8471 | – | – | – | – | – |
| asnorm | internal_K400_N200_scan2000 | 0.7931 | 0.8417 | 0.8573 | 0.9216 | 0.0572 | 0.0319 | 0.6429 | 0.0031 |
| snorm | ext_heedb_size3000_K400_N100_seed42 | 0.7817 | 0.8358 | 0.8537 | 0.8633 | 0.1038 | 0.0349 | 0.4614 | 0.0362 |
| znorm | ext_heedb_size100_K400_N100_seed42 | 0.7765 | 0.8304 | 0.8471 | 0.8508 | 0.1122 | 0.0492 | 0.4073 | 0.0411 |
| tnorm | ext_internal_size3000_K400_N100_seed42 | 0.7644 | 0.8238 | 0.8416 | 0.8538 | 0.1039 | 0.0377 | 0.4817 | 0.0327 |
| alphaqe | K3_a3.0 | 0.7626 | 0.8174 | 0.8259 | 0.8609 | 0.0975 | 0.0439 | 0.5128 | 0.0201 |
| Rank@1 | Rank@5 | Rank@10 | [email protected] | Brier | ECE | Conf mean | Conf mean y1 | Conf mean y0 | [email protected] | [email protected] | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 0.7943 | 0.8387 | 0.8552 | 0.9623 | 0.0391 | 0.0690 | 0.7862 | 0.9291 | 0.2372 | 0.6573 | 0.0000 |
| 2 | 0.7977 | 0.8326 | 0.8472 | 0.7974 | 0.1580 | 0.0332 | 0.7990 | 0.8017 | 0.7882 | 0.0182 | 0.0000 |
| 3 | 0.8003 | 0.8371 | 0.8527 | 0.9499 | 0.0653 | 0.1403 | 0.7907 | 0.8847 | 0.4152 | 0.5124 | 0.0000 |
| 4 | 0.8005 | 0.8386 | 0.8541 | 0.9682 | 0.0536 | 0.1051 | 0.7908 | 0.9017 | 0.3479 | 0.5710 | 0.0000 |
| 5 | 0.7999 | 0.8389 | 0.8543 | 0.9653 | 0.0482 | 0.0970 | 0.7904 | 0.9106 | 0.3123 | 0.6009 | 0.0000 |
| 6 | 0.7995 | 0.8393 | 0.8549 | 0.9648 | 0.0460 | 0.0885 | 0.7903 | 0.9148 | 0.2962 | 0.6140 | 0.0000 |
| Config | R@1 | dR@1 | Acc | Brier | ECE | Cov90 | Err90 | ||
|---|---|---|---|---|---|---|---|---|---|
| internal_K400_N200_scan2000 | 0.7931 | +0.0166 | 0.9225 | 0.0572 | 0.0257 | 0.9139 | 0.2883 | 0.6355 | 0.0031 |
| ext_heedb_size100_K400_N100_seed42 | 0.7767 | +0.0002 | 0.8616 | 0.1087 | 0.0536 | 0.8510 | 0.5287 | 0.4182 | 0.0417 |
| ext_heedb_size250_K400_N100_seed42 | 0.7787 | +0.0022 | 0.8656 | 0.1009 | 0.0390 | 0.8582 | 0.4901 | 0.4571 | 0.0296 |
| ext_heedb_size500_K400_N100_seed42 | 0.7798 | +0.0033 | 0.8810 | 0.0868 | 0.0276 | 0.8801 | 0.4220 | 0.5324 | 0.0210 |
| ext_heedb_size1000_K400_N100_seed42 | 0.7821 | +0.0056 | 0.8884 | 0.0804 | 0.0166 | 0.8901 | 0.3825 | 0.5735 | 0.0154 |
| ext_heedb_size2000_K400_N100_seed42 | 0.7850 | +0.0085 | 0.8903 | 0.0789 | 0.0126 | 0.8931 | 0.3706 | 0.5922 | 0.0139 |
| Config | R@1 | dR@1 | Acc | Brier | ECE | Cov90 | Err90 | ||
|---|---|---|---|---|---|---|---|---|---|
| internal_K400_C500_S42 | 0.7766 | +0.0001 | 0.8604 | 0.1061 | 0.0373 | 0.8545 | 0.5069 | 0.4420 | 0.0354 |
| ext_heedb_size100_K400_N100_seed42 | 0.7767 | +0.0002 | 0.8616 | 0.1087 | 0.0536 | 0.8510 | 0.5287 | 0.4182 | 0.0417 |
| ext_heedb_size250_K400_N100_seed42 | 0.7795 | +0.0030 | 0.8622 | 0.1074 | 0.0486 | 0.8535 | 0.5278 | 0.4270 | 0.0430 |
| ext_heedb_size500_K400_N100_seed42 | 0.7807 | +0.0042 | 0.8624 | 0.1065 | 0.0419 | 0.8551 | 0.5223 | 0.4364 | 0.0383 |
| ext_heedb_size1000_K400_N100_seed42 | 0.7812 | +0.0047 | 0.8640 | 0.1042 | 0.0357 | 0.8604 | 0.5116 | 0.4573 | 0.0374 |
| ext_heedb_size2000_K400_N100_seed42 | 0.7815 | +0.0050 | 0.8633 | 0.1042 | 0.0355 | 0.8586 | 0.5099 | 0.4544 | 0.0359 |
| Config | R@1 | dR@1 | Acc | Brier | ECE | Cov90 | Err90 | ||
|---|---|---|---|---|---|---|---|---|---|
| internal_K400_C500_S42 | 0.7485 | 0.0280 | 0.8380 | 0.1220 | 0.0395 | 0.8332 | 0.5191 | 0.3724 | 0.0432 |
| ext_heedb_size100_K400_N100_seed42 | 0.7765 | 0.0000 | 0.8537 | 0.1111 | 0.0513 | 0.8443 | 0.5344 | 0.3973 | 0.0406 |
| ext_heedb_size250_K400_N100_seed42 | 0.7765 | 0.0000 | 0.8568 | 0.1101 | 0.0504 | 0.8455 | 0.5302 | 0.3999 | 0.0402 |
| ext_heedb_size500_K400_N100_seed42 | 0.7765 | 0.0000 | 0.8545 | 0.1100 | 0.0412 | 0.8464 | 0.5248 | 0.4109 | 0.0364 |
| ext_heedb_size1000_K400_N100_seed42 | 0.7765 | 0.0000 | 0.8581 | 0.1081 | 0.0387 | 0.8492 | 0.5150 | 0.4228 | 0.0363 |
| ext_heedb_size2000_K400_N100_seed42 | 0.7765 | 0.0000 | 0.8556 | 0.1086 | 0.0374 | 0.8488 | 0.5172 | 0.4212 | 0.0335 |
| Config | R@1 | dR@1 | Acc | Brier | ECE | Cov90 | Err90 | ||
|---|---|---|---|---|---|---|---|---|---|
| internal_K400_C500_S42 | 0.7489 | 0.0276 | 0.8383 | 0.1196 | 0.0370 | 0.8376 | 0.5089 | 0.3930 | 0.0429 |
| ext_heedb_size100_K400_N100_seed42 | 0.7383 | 0.0382 | 0.8263 | 0.1297 | 0.0497 | 0.8219 | 0.5297 | 0.3374 | 0.0570 |
| ext_heedb_size250_K400_N100_seed42 | 0.7344 | 0.0421 | 0.8319 | 0.1235 | 0.0415 | 0.8259 | 0.4956 | 0.3641 | 0.0445 |
| ext_heedb_size500_K400_N100_seed42 | 0.7427 | 0.0338 | 0.8500 | 0.1074 | 0.0237 | 0.8489 | 0.4328 | 0.4476 | 0.0292 |
| ext_heedb_size1000_K400_N100_seed42 | 0.7490 | 0.0275 | 0.8662 | 0.0960 | 0.0153 | 0.8690 | 0.3944 | 0.5103 | 0.0221 |
| ext_heedb_size2000_K400_N100_seed42 | 0.7535 | 0.0230 | 0.8732 | 0.0903 | 0.0113 | 0.8754 | 0.3691 | 0.5334 | 0.0183 |
| Config | R@1 | dR@1 | Acc | Brier | ECE | Cov90 | Err90 | ||
|---|---|---|---|---|---|---|---|---|---|
| ext_heedb_size100_K400_N100_seed42 | 0.7383 | 0.0382 | 0.8263 | 0.1297 | 0.0497 | 0.8219 | 0.5297 | 0.3374 | 0.0570 |
| ext_heedb_size250_K400_N100_seed42 | 0.7503 | 0.0262 | 0.8361 | 0.1236 | 0.0484 | 0.8317 | 0.5300 | 0.3655 | 0.0537 |
| ext_heedb_size500_K400_N100_seed42 | 0.7547 | 0.0218 | 0.8399 | 0.1192 | 0.0416 | 0.8374 | 0.5183 | 0.3886 | 0.0446 |
| ext_heedb_size1000_K400_N100_seed42 | 0.7564 | 0.0200 | 0.8430 | 0.1165 | 0.0398 | 0.8429 | 0.5119 | 0.4066 | 0.0429 |
| ext_heedb_size2000_K400_N100_seed42 | 0.7556 | 0.0208 | 0.8432 | 0.1162 | 0.0338 | 0.8410 | 0.5046 | 0.4059 | 0.0413 |
| ext_heedb_size3000_K400_N100_seed42 | 0.7566 | 0.0199 | 0.8448 | 0.1159 | 0.0362 | 0.8415 | 0.5073 | 0.4037 | 0.0413 |
| Config | R@1 | dR@1 | Acc | Brier | ECE | Cov90 | ||
|---|---|---|---|---|---|---|---|---|
| K200_lk10_ 0.950_it5 | 0.2391 | 0.5374 | 0.8609 | 0.1069 | 0.0533 | 0.5349 | 0.1471 | 0.0000 |
| K200_lk15_ 0.950_it8 | 0.2567 | 0.5198 | 0.8571 | 0.1105 | 0.0566 | 0.5516 | 0.1543 | 0.0000 |
| K300_lk20_ 0.970_it10 | 0.2097 | 0.5668 | 0.8775 | 0.0963 | 0.0503 | 0.5168 | 0.1291 | 0.0000 |
| K400_lk30_ 0.990_it20 | 0.1895 | 0.5870 | 0.8854 | 0.0911 | 0.0502 | 0.4964 | 0.1173 | 0.0000 |
| Config | R@1 | dR@1 | Acc | Brier | ECE | Cov90 | Err90 | ||
|---|---|---|---|---|---|---|---|---|---|
| K3, =1.0 | 0.7358 | 0.0407 | 0.8323 | 0.1163 | 0.0423 | 0.8366 | 0.4585 | 0.3896 | 0.0247 |
| K3, =2.0 | 0.7534 | 0.0231 | 0.8536 | 0.1022 | 0.0439 | 0.8571 | 0.4319 | 0.4660 | 0.0210 |
| K3, =3.0 | 0.7626 | 0.0139 | 0.8644 | 0.0962 | 0.0412 | 0.8650 | 0.4195 | 0.5005 | 0.0190 |
| K5, =1.0 | 0.6830 | 0.0935 | 0.8005 | 0.1371 | 0.0376 | 0.7962 | 0.4479 | 0.2683 | 0.0303 |
| K5, =2.0 | 0.7189 | 0.0576 | 0.8327 | 0.1159 | 0.0410 | 0.8345 | 0.4353 | 0.3770 | 0.0233 |
| K5, =3.0 | 0.7404 | 0.0361 | 0.8505 | 0.1043 | 0.0414 | 0.8529 | 0.4222 | 0.4465 | 0.0196 |
| Metric | Mean half-width | Min | Max |
|---|---|---|---|
| Rank@1 | 0.0043 | 0.0007 | 0.0143 |
| Rank@5 | 0.0034 | 0.0006 | 0.0138 |
| Rank@10 | 0.0033 | 0.0003 | 0.0132 |
| Rank@100 | 0.0025 | 0.0005 | 0.0109 |
| Rank@200 | 0.0023 | 0.0003 | 0.0087 |
| Rank@1 | [email protected] | conf_brier | conf_ece | |
|---|---|---|---|---|
| 1 | 0.7943 | 0.9623 [0.9574, 0.9672] | 0.0391 [0.0388, 0.0395] | 0.0690 [0.0637, 0.0742] |
| 2 | 0.7977 | 0.7974 [0.7934, 0.8014] | 0.1580 [0.1455, 0.1704] | 0.0332 [ 0.0729, 0.1394] |
| 3 | 0.8003 | 0.9499 [0.9441, 0.9556] | 0.0653 [0.0641, 0.0665] | 0.1403 [0.1375, 0.1432] |
| 4 | 0.8005 | 0.9682 [0.9657, 0.9706] | 0.0536 [0.0507, 0.0566] | 0.1051 [0.1013, 0.1089] |
| 5 | 0.7999 | 0.9653 [0.9635, 0.9670] | 0.0482 [0.0475, 0.0490] | 0.0970 [0.0939, 0.1000] |
| 6 | 0.7995 | 0.9648 [0.9613, 0.9682] | 0.0460 [0.0450, 0.0471] | 0.0885 [0.0837, 0.0932] |
| DB | Rank@1 | Rank@5 | Rank@10 | TAR@FAR1e-4 | TAR@FAR1e-3 | [email protected] | Brier | ECE | Conf mean | Conf mean y1 | Conf mean y0 | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ASUGI | 0.9506 | 0.9670 | 0.9718 | 0.9448 | 0.9675 | 0.9713 | 0.0207 | 0.0185 | 0.9461 | 0.9702 | 0.4820 | 0.9335 | 0.0076 | 0.9149 | 0.0040 | 0.8805 | 0.0014 | 0.8369 | 0.0009 |
| MIMIC | 0.8291 | 0.8768 | 0.8916 | 0.7079 | 0.8188 | 0.8756 | 0.0849 | 0.0340 | 0.8278 | 0.8916 | 0.5185 | 0.7940 | 0.0567 | 0.7236 | 0.0349 | 0.5889 | 0.0166 | 0.4175 | 0.0090 |
| HEEDB | 0.6884 | 0.7593 | 0.7807 | 0.6002 | 0.7210 | 0.8366 | 0.1185 | 0.0286 | 0.6865 | 0.8173 | 0.3969 | 0.5835 | 0.0727 | 0.4992 | 0.0528 | 0.3573 | 0.0331 | 0.2269 | 0.0252 |
| Dataset | [email protected] | Brier | ECE | |||
|---|---|---|---|---|---|---|
| ASUGI-DB | 0.9991 [0.9991, 0.9992] | 0.0008 [0.0007, 0.0009] | 0.0058 [0.0050, 0.0066] | 0.9939 [0.9935, 0.9943] | 0.9940 [0.9936, 0.9943] | 0.9226 [0.8856, 0.9595] |
| MIMIC-GC | 0.9733 [0.9727, 0.9739] | 0.0173 [0.0171, 0.0175] | 0.0216 [0.0214, 0.0218] | 0.9574 [0.9569, 0.9580] | 0.9729 [0.9725, 0.9732] | 0.5481 [0.5413, 0.5550] |
| HEEDB-GC | 0.9652 [0.9645, 0.9659] | 0.0250 [0.0248, 0.0252] | 0.0250 [0.0243, 0.0256] | 0.9370 [0.9362, 0.9377] | 0.9631 [0.9626, 0.9637] | 0.5022 [0.4953, 0.5091] |
| Dataset | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] |
|---|---|---|---|---|---|---|---|---|
| ASUGI-DB | 1.0000 [1.000, 1.000] | 1.0000 [1.000, 1.000] | 0.9994 [0.9986, 1.000] | 0.9973 [0.9951, 0.9995] | 0.0009 [0.0008, 0.0009] | 0.0009 [0.0008, 0.0009] | 0.0006 [0.0002, 0.0010] | 0.0003 [ 0.0000, 0.0007] |
| MIMIC-GC | 0.9504 [0.9490, 0.9519] | 0.9324 [0.9317, 0.9332] | 0.9000 [0.8991, 0.9008] | 0.8528 [0.8514, 0.8541] | 0.0058 [0.0047, 0.0069] | 0.0018 [0.0016, 0.0020] | 0.0005 [0.0005, 0.0005] | 0.0003 [0.0003, 0.0003] |
| HEEDB-GC | 0.9171 [0.9164, 0.9179] | 0.8945 [0.8937, 0.8954] | 0.8529 [0.8520, 0.8538] | 0.8016 [0.8003, 0.8028] | 0.0065 [0.0062, 0.0068] | 0.0034 [0.0033, 0.0035] | 0.0018 [0.0017, 0.0019] | 0.0012 [0.0011, 0.0013] |
Biometric Identification
Biometric identification matches or verifies people and animals using distinctive physical, physiological, or behavioral signals.
See all 128 papers