DOSE: Dominance-Guided Ordinal Severity Estimation from Sparse Relative Annotations
Organizations: The University of Osaka, Japan
Abstract
Medical severity estimation commonly relies on absolute grade annotations, which are fundamentally ordinal, yet existing methods often treat the grades as independent categories. Learning-to-rank methods, which can be trained using relative annotations based on severity comparisons of image pairs, can provide continuous severity rankings but cannot directly predict discrete severity grades. We propose Dominance-guided Ordinal Severity Estimation from Sparse Relative Annotations (DOSE), a framework for learning ordinal medical severity from sparse pairwise comparisons without using absolute annotations. DOSE aggregates the observed comparisons through a global comparison graph to estimate a dominance score for each image. Differences between dominance scores set cumulative margins in the embedding space, so that pairs with larger estimated severity differences are separated more strongly, and also generate pseudo-pairs that supervise a scalar severity head alongside the observed comparisons. The learned continuous severity axis is converted into discrete grades via label-free score calibration, with tie-anchored segmentation as the main calibration method. In the experiment, DOSE consistently outperformed pairwise-ranking baselines on ACNE04, IDRiD, and LIMUC under different pair budgets. Code is available at https://github.com/TushirSahu/DOSE
Figures & tables
| Method | Supervision | Budget | ACNE ( ) | IDRiD ( ) | LIMUC ( ) | |||
| Accuracy | QWK | Accuracy | QWK | Accuracy | QWK | |||
| Cross-entropy | Absolute | 100% | 78.6 0.8 | 0.822 0.013 | 86.6 0.4 | 0.914 0.008 | 78.0 0.6 | 0.848 0.011 |
| MarginRank | Relative | 5% | 68.6 1.5 | 0.743 0.009 | 73.6 7.8 | 0.812 0.107 | 55.7 0.2 | 0.252 0.020 |
| 10% | 69.5 3.4 | 0.755 0.043 | 80.5 1.1 | 0.882 0.008 | 70.3 1.1 | 0.671 0.046 | ||
| 30% | 71.2 0.3 | 0.788 0.009 | 81.2 0.5 | 0.878 0.002 | 73.9 0.8 | 0.844 0.008 | ||
| 50% | 72.6 2.4 | 0.799 0.020 | 81.1 0.1 | 0.878 0.004 | 74.0 0.6 | 0.847 0.005 | ||
| Dataset | Budget | Label-free | Oracle | ||
| Tie-seg | GMM | Est-prior | Known-prior | ||
| ACNE | 30% | 72.6 1.2 | 73.6 1.2 | 73.6 0.0 | 73.3 0.9 |
| 50% | 74.8 0.3 | 75.0 1.0 | 75.7 0.6 | 75.5 0.9 | |
| 70% | 74.1 2.0 | 75.1 0.8 | 74.4 0.8 | 74.9 1.3 | |
| IDRiD | 30% | 84.5 0.7 | 84.2 0.5 | 84.3 1.1 | 84.7 0.3 |
| 50% | 84.0 0.4 | 83.6 1.0 | 83.9 0.7 | 84.7 0.8 | |
| Dataset | Budget | Tie-seg | Known-prior | ||||
| Acc. (%) | QWK | Acc. (%) | |||||
| Multi | Single | Multi | Single | Multi | Single | ||
| ACNE | 30% | 72.6 1.2 | 69.4 2.6 | 0.807 | 0.768 | 73.3 0.9 | 70.3 1.7 |
| 50% | 74.8 0.3 | 71.3 2.5 | 0.821 | 0.785 | 75.5 0.9 | 71.1 1.5 | |
| 70% | 74.1 2.0 | 71.6 1.2 | 0.807 | 0.786 | 74.9 1.3 | 71.1 1.7 | |
| IDRiD | 30% | 84.5 0.7 | 82.8 1.3 | 0.909 | 0.897 | 84.7 0.3 | 82.6 0.8 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Backbone | Budget | Tie-seg | GMM | Est-prior | Known-prior | ||||||||
| Acc | QWK | MAE | Acc | QWK | MAE | Acc | QWK | MAE | Acc | QWK | MAE | |||
| ACNE ( ) | ConvNeXt-T | 30% | 72.6 1.2 | 0.807 0.011 | 0.274 0.012 | 73.6 1.2 | 0.821 0.012 | 0.264 0.012 | 73.6 0.0 | 0.818 0.003 | 0.264 0.000 | 73.3 0.9 | 0.819 0.010 | 0.267 0.009 |
| 50% | 74.8 0.3 | 0.821 0.001 | 0.252 0.003 | 75.0 1.0 | 0.824 0.007 | 0.252 0.009 | 75.7 0.6 | 0.818 0.003 | 0.248 0.003 | 75.5 0.9 | 0.826 0.008 | 0.248 0.009 | ||
| 70% | 74.1 2.0 | 0.807 0.021 | 0.263 0.023 | 75.1 0.8 | 0.825 0.005 | 0.251 0.008 | 74.4 0.8 | 0.813 0.007 | 0.260 0.010 | 74.9 1.3 | 0.820 0.014 | 0.256 0.016 | ||
| ResNet-50 | 30% | 72.7 1.8 | 0.785 0.020 | 0.280 0.020 | 74.0 2.0 | 0.810 0.018 | 0.266 0.020 | 73.1 0.9 | 0.793 0.007 | 0.276 0.006 | 73.7 1.1 | 0.798 0.012 | 0.271 0.012 | |
| 50% | 73.9 1.7 | 0.804 0.012 | 0.266 0.017 | 74.3 1.1 | 0.812 0.007 | 0.264 0.011 | 74.0 1.6 | 0.799 0.015 | 0.266 0.014 | 75.0 0.9 | 0.812 0.011 | 0.257 0.010 | ||
| Dataset | Backbone | Budget | Tie-seg | Known-prior | ||||||
| Accuracy (%) | QWK | MAE | Accuracy (%) | |||||||
| Multi | Single | Multi | Single | Multi | Single | Multi | Single | |||
| ACNE ( ) | ConvNeXt-T | 30% | 72.6 1.2 | 69.4 2.6 | 0.807 | 0.768 | 0.274 | 0.309 | 73.3 0.9 | 70.3 1.7 |
| 50% | 74.8 0.3 | 71.3 2.5 | 0.821 | 0.785 | 0.252 | 0.294 | 75.5 0.9 | 71.1 1.5 | ||
| 70% | 74.1 2.0 | 71.6 1.2 | 0.807 | 0.786 | 0.263 | 0.289 | 74.9 1.3 | 71.1 1.7 | ||
| ResNet-50 | 30% | 72.7 1.8 | 68.7 2.3 | 0.785 | 0.742 | 0.280 | 0.317 | 73.7 1.1 | 70.4 1.6 | |
Medical Image Analysis
Medical image analysis uses computational methods to interpret clinical images, measure anatomy and disease, and support diagnosis and treatment.
See all 295 papers