On the use of Aggregation Operators to improve Human Identification using Dental Records
Authors: Antonio D. Villegas-Yeguas, Guillermo R-García, Tzipi Kahana, Jorge Pinares Toledo, Esi Sharon, Oscar Ibañez, Oscar Cordón
Organizations: Department of Computer Science and Artificial Intelligence, University of Granada, Granada, Spain · Panacea Cooperative Research S. Coop, Ponferrada, Spain · Institute of Criminology, The Faculty of Law, Hebrew University of Jerusalem, Jerusalem, Israel · Forensic Odontology Unit, Division of Identification and Forensic Science, Israel Police, Jerusalem, Israel · Faculty of Dentistry, University of Chile, Santiago de Chile, Chile · Department of Prosthodontics, Faculty of Dental Medicine, Hebrew University of Jerusalem, Jerusalem, Israel · Department of Computer Science and Information Technologies, University of Coruña, A Coruña, Spain
The comparison of dental records is a standardized technique in forensic dentistry used to speed up the identification of individuals in multiple-comparison scenarios. Specifically, the odontogram comparison is a procedure to compute criteria that will be used to perform a ranking. State-of-the-art automatic methods either make use of simple techniques, without utilizing the full potential of the information obtained from a comparison, or their internal behavior is not known due to the lack of peer-reviewed publications. This work aims to design aggregation mechanisms to automatically compare pairs of dental records that can be understood and validated by experts, improving the current methods. To do so, we introduce different aggregation approaches using the state-of-the-art codification, based on seven different criteria. In particular, we study the performance of i) data-driven lexicographical order-based aggregations, ii) well-known fuzzy logic aggregation methods and iii) machine learning techniques as aggregation mechanisms. To validate our proposals, 215 forensic cases from two different populations have been used. The results obtained show how the use of white-box machine learning techniques as aggregation models (average ranking from 2.02 to 2.21) are able to improve the state-of-the-art (average ranking of 3.91) without compromising the explainability and interpretability of the method.
Figures & tables
Comparison result by AM code
PM Code
Match
Mismatch
Possible
V
V
F, S, X, I
P
F
F
S, X, I
V, P
S
S
X, I
F, V, P
X
X
V, F, S, I, P
I
I
V, F, S, X, P
Table 1: Classification matrix for each possible PM-AM comparison in SCS.
Comparison result by PM code
AM Code
Match
Mismatch
Possible
V
V
F, S, X, I, P
F
F
V
S, X, I, P
S
S
V, F
X, I, P
X
X
V, F, S, P
I
I
I
V, F, S, P
X
Table 2: Classification matrix for each possible AM-PM comparison in SCS.
Israel
Chile
Total
Training
83
56
139
Validation
20
14
34
Test
25
17
42
Total
128
87
215
Table 3: Data split by number of cases. Training and validation refers to the numbers of cases in one fold.
Average
Q1
Q2
Q3
P95
P99
Max
AA
3.91
1
1
1
30
34
36
LO
2.14
1
1
1
6
16
34
Table 4: Comparison of ranking performance between Adams and Aschheim’s proposal (AA) and our LO aggregation mechanism.
Figure 1: CMC plot comparing the results of our LO aggregation mechanism and Adams and Aschheim’s proposal in the test dataset.
Average
Q1
Q2
Q3
P95
P99
Max
AA
3.91
1
1
1
30
34
36
OWA-Maximum
5.9
1
4
7
18
25
35
OWA-Minimum
4.99
1
1
3
27
37
39
OWA-Average
3.27
1
1
1
15
26
36
OWA-Linear
2.86
1
1
1
11
22
36
Table 5: Comparison of ranking performance between Adams and Aschheim’s proposal (AA) and our approach using the OWA operator with different weights.
Figure 2: CMC plot comparing the results of our proposal of the OWA operator with Adams and Aschheim’s proposal in the test dataset.
Average
Q1
Q2
Q3
P95
P99
Max
AA
3.91
1
1
1
30
34
36
OWHM-Average
6.51
1
2
6
28
36
39
OWHM-Linear
6.02
1
2
5
28
36
38
Table 6: Comparison of ranking performance between Adams and Aschheim’s proposal (AA) and our approach using the OWHM aggregator with different weights.
Figure 3: CMC plot comparing the results of our proposal of the OWHM aggregator with Adams and Aschheim’s proposal in the test dataset. Notice that differently to previous CMC plots, the Y axis range is 0-100%.
Average
Q1
Q2
Q3
P95
P99
Max
AA
3.91
1
1
1
30
34
36
Choquet integral: μ : Cardinality
3.26
1
1
1
15
26
36
Choquet integral: μ : λ
3.14
1
1
1
16
33
35
Table 7: Comparison of ranking performance between Adams and Aschheim’s proposal (AA) and the Choquet integral.
Figure 4: CMC plot comparing the results of our proposal of the Choquet integral aggregator with Adams and Aschheim’s proposal in the test dataset.
Average
Q1
Q2
Q3
P95
P99
Max
AA
3.91
1
1
1
30
34
36
Sugeno integral: μ : Cardinality
6.06
1
1
6
27
34
40
Sugeno integral: μ : λ
5.28
1
3
5
18
25
35
Table 8: Comparison of ranking performance between Adams and Aschheim’s proposal (AA) and the Sugeno integral.
Figure 5: CMC plot comparing the results of our proposal of the Sugeno integral aggregator with Adams and Aschheim’s proposal in the test dataset.
Fold
Training
Validation
Average
Maximum
Average
Maximum
1
0,0061
0,3478
0,0041
0,0857
2
0,0058
0,3043
0,0055
0,1429
3
0,0041
0,1449
0,0139
0,3714
4
0,0065
0,3381
0,0009
0,0294
5
0,0074
0,3165
0,0013
0,0294
Table 9: Normalized results of the average and maximum ranking obtained using a genetic algorithm to learn the weights of a linear regression. In bold the best validation results.
Average
Q1
Q2
Q3
P95
P99
Max
AA
3.91
1
1
1
30
34
36
LR
2.21
1
1
1
6
23
24
SR
2.02
1
1
1
4
23
30
MLP
1.94
1
1
1
4
18
28
Table 10: Comparison of ranking performance between Adams and Aschheim’s proposal (AA) and our machine learning-based aggregation mechanisms.
Figure 6: CMC plot comparing the results of our proposal of machine learning-based aggregation mechanisms as score generator with Adams and Aschheim’s proposal in the test dataset.
Fold
Training
Validation
Average
Maximum
Average
Maximum
1
0,0059
0,3188
0,0069
0,1429
2
0,0047
0,2754
0,0101
0,3429
3
0,0039
0,1594
0,0184
0,9714
4
0,0048
0,2662
0,0009
0,0294
5
0,0049
0,2374
0,0013
0,0294
Table 11: Normalized results of the average and maximum ranking obtained using a genetic algorithm to learn a symbolic regression-based aggregation mechanism. In bold the best validation results.
Fold
Training
Validation
Average
Maximum
Average
Maximum
1
0,0030
0,1159
0,0061
0,1429
2
0,0030
0,1014
0,0105
0,3714
3
0,0022
0,0725
0,0155
0,6286
4
0,0034
0,0791
0,0004
0,0294
5
0,0039
0,0935
0,0013
0,0294
Table 12: Normalized results of the average and maximum ranking obtained using a genetic algorithm to train a multilayer perceptron-based aggregation mechanism. In bold the best validation results.
Average
Q1
Q2
Q3
P95
P99
Max
AA
3.91
1
1
1
30
34
36
LO
2.14
1
1
1
6
16
34
OWA-Linear
2.86
1
1
1
11
22
36
OWHM-Linear
6.02
1
2
5
28
36
38
Choquet integral: μ : λ
3.14
1
1
1
16
33
35
Sugeno integral: μ : λ
5.28
1
3
5
18
25
35
Table 13: Comparison of ranking performance between all the proposals.
Figure 7: CMC plot comparing the results of the best fuzzy aggregators and Adams and Aschheim’s proposal in the test dataset.
Figure 8: CMC plot comparing the results of the machine learning aggregators, our LO aggregation mechanism proposal and the Adams and Aschheim’s proposal in the test dataset.
Dental comparison is considered a primary identification method, at the level of fingerprints and DNA profiling. One crucial but time-consuming step of this method is the morphological comparison. One of the main challenges to apply this method is the lack of ante-mortem medical records, specially on scenarios such as migrant death at the border and/or in countries where there is no universal healthcare. The availability of photos on social media where teeth are visible has led many odontologists to consider morphological comparison using them. However, state-of-the-art proposals have significant limitations, including the lack of proper modeling of perspective distortion and the absence of objective approaches that quantify morphological differences. Our proposal involves a 3D (post-mortem scan) - 2D (ante-mortem photos) approach. Using computer vision and optimization techniques, we replicate the ante-mortem image with the 3D model to perform the morphological comparison. Two automatic approaches have been developed: i) using paired landmarks and ii) using a segmentation of the teeth region to estimate camera parameters. Both are capable of obtaining very promising results over 20,164 cross comparisons from 142 samples, obtaining mean ranking values of 1.6 and 1.5, respectively. These results clearly outperform filtering capabilities of automatic dental chart comparison approaches, while providing an automatic, objective and quantitative score of the morphological correspondence, easily to interpret and analyze by visualizing superimposed images.
Antonio D. Villegas-Yeguas, Xavier Abreau-Freire, Guillermo R-García +5
Department of Computer Science and Artificial Intelligence of the University of Granada (DECSAI), Spain · Panacea Cooperative Research S. Coop., Ponferrada, Spain · Associate Laboratory i4HB - Institute for Health and Bioeconomy, University Institute of Health Sciences (IUCS), CESPU, 4585-116 Gandra, Portugal +7
Orthopantomograms (OPGs) are the standard panoramic radiograph in dentistry, used for full-arch screening across multiple diagnostic tasks. While Vision Language Models (VLMs) now allow multi-task OPG analysis through natural language, they underperform task-specific models on most individual tasks. Agentic systems that orchestrate specialized tools offer a path to both versatility and accuracy, this approach remains unexplored in the field of dental imaging. To address this gap, we propose OPGAgent, a multi-tool agentic system for auditable OPG interpretation. OPGAgent coordinates specialized perception modules with a consensus mechanism through three components: (1) a Hierarchical Evidence Gathering module that decomposes OPG analysis into global, quadrant, and tooth-level phases with dynamically invoking tools, (2) a Specialized Toolbox encapsulating spatial, detection, utility, and expert zoos, and (3) a Consensus Subagent that resolves conflicts through anatomical constraints. We further propose OPG-Bench, a structured-report protocol based on (Location, Field, Value) triples derived from real clinical reports, which enables a comprehensive review of findings and hallucinations, extending beyond the limitations of VQA indicators. On our OPG-Bench and the public MMOral-OPG benchmark, OPGAgent outperforms current dental VLMs and medical agent frameworks across both structured-report and VQA evaluation. Code will be released upon acceptance.
Zhaolin Yu, Litao Yang, Ben Babicka +7
AIM for Health Lab, Faculty of Information Technology, Monash University, Melbourne, Australia · Faculty of Information Technology, Monash University, Melbourne, Australia · Curae Health, Melbourne, Australia +4
Dental image analysis plays a pivotal role in supporting accurate diagnosis and treatment planning in oral healthcare. Although recent advances have produced dental AI models for specific tasks and individual imaging modalities, their isolated designs limit practical use in real-world clinical workflows. In this paper, we present OralAgent, the first dental-specialized AI agent that unifies multimodal reasoning, tool-based decision-making, and knowledge-grounded retrieval within an end-to-end automated framework. It integrates 22 visual analysis tools and 368 widely-used classical dental textbooks, enabling autonomous reasoning, planning, tool use, knowledge retrieval, and multi-step workflow execution. Furthermore, we introduce OralCorpus, a large-scale, high-quality bilingual textual resource containing 134.8M tokens curated for dental retrieval-augmented generation (RAG). To evaluate models' multidisciplinary dental knowledge, we construct OralQA-ZH, a Chinese multiple-choice question benchmark consisting of 798 items across eleven oral subspecialties. Extensive experiments demonstrate that OralAgent achieves state-of-the-art performance on the MMOral-Uni, MMOral-OPG, and OralQA-ZH benchmarks, highlighting its effectiveness, interpretability, and adaptability in real-world clinical settings. The code and models are publicly available at https://github.com/isjinghao/OralAgent.
Jing Hao, Siyuan Dai, Yongxin Zhang +13
Faculty of Dentistry, the University of Hongkong, Hong Kong SAR, China · Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA · Shenzhen University, China +6