cs.CVOct 6, 2024
SaveOptimising for the Unknown: Domain Alignment for Cephalometric Landmark Detection
Organizations: Department of Computer Science, University of Oxford
Abstract
Cephalometric Landmark Detection is the process of identifying key areas for cephalometry. Each landmark is a single GT point labelled by a clinician. A machine learning model predicts the probability locus of a landmark represented by a heatmap. This work, for the 2024 CL-Detection MICCAI Challenge, proposes a domain alignment strategy with a regional facial extraction module and an X-ray artefact augmentation procedure. The challenge ranks our method's results as the best in MRE of 1.186mm and third in the 2mm SDR of 82.04% on the online validation leaderboard. The code is available at https://github.com/Julian-Wyatt/OptimisingfortheUnknown.
Figures & tables
Figure 1: Abstraction of the RCNN regional face extraction module.
Figure 2: ConvNeXt V2 MLP feature pyramid prediction architecture.
Figure 3: Ablation studies trained with the nano encoder. (a) Impact of RCNN padding around landmarks for bounding box generation during training from 16-128 pixels. Models are trained on patients 1-400 and evaluated on 401-600. Here, y is a deterministic image pad and crop method and z is a standard pad to aspect ratio and resize. (b) Effect of varying the frequency of X-ray artefact simulation on model performance (Fold 1). (c) Influence of the number of hottest heatmap values averaged to determine the final coordinates (Fold 1).
Figure 4: Qualitative results for four cases: the worst overall SDR for the tiny encoder ( 062.bmp ), the worst for the baseline ( 194.bmp ), and two hand-picked failure cases ( 447.bmp & 535.bmp ). Blue dots represent predictions within , red dots are outside , and green dots are ground truth, with yellow lines connecting predictions to ground truth. The top-left number indicates the MRE for each image, and all images are cropped to square to highlight landmarks rather than by the RCNN module.
| Method | Fold 1 | Fold 2 | Fold 3 | Fold 4 | Ensemble | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| MRE | SDR | MRE | SDR | MRE | SDR | MRE | SDR | MRE | SDR | |
| Baseline [ 11 ] (CHH) | 1.20 | 83.12 | 1.21 | 82.44 | 1.29 | 81.56 | 1.25 | 82.19 | 1.22 | 82.42 |
| Nano Encoder | 1.16 | 84.13 | 1.16 | 83.87 | 1.24 | 82.78 | 1.20 | 83.40 | 0.97 | 87.85 |
| Tiny Encoder | 1.18 | 84.13 | 1.16 | 83.68 | 1.24 | 82.49 | 1.20 | 83.20 | 0.93 | 88.61 |
Table 1: Four fold cross validation performance with ensembling performance across every training image.
Explore similar work
Manual cephalometric landmark annotation is important for craniofacial assessment but is labor-intensive and difficult to scale. We introduce CephViT, a Vision Transformer-based model for automated 2D lateral cephalometric landmark localization, and evaluate its use in downstream skeletal malocclusion classification. CephViT was trained and benchmarked on a public lateral cephalogram dataset, achieving a mean radial error of 1.28 +/- 1.42 mm and a successful detection rate of 92.0% at 3.0 mm. Because the private evaluation cohort consisted of 3D CBCT scans, lateral cephalogram-like digitally reconstructed radiographs (DRRs) were generated from each volume and used as 2D inputs to the landmark localization model. Landmark coordinates were normalized into a common coordinate frame, and skeletal malocclusion classification was performed using landmarks shared between the reference and DRR-based pipelines. Classification performance using DRR-localized landmarks was comparable to that obtained using manually annotated reference landmarks, with accuracies of 70.0% and 68.3%, respectively. These results support the feasibility of automated cephalometric analysis on CBCT-derived DRRs for skeletal malocclusion assessment.
Towards Unified Dynamic Face Landmark Detection
Although advancements in face landmark detection (FLD) methods continue to push performance boundaries, they overlook two major functional limitations: (1) different network parameters need to be trained independently for each
$N$-point'' benchmark dataset, and (2) a model trained on an -point'' dataset reliably outputs only the landmarks. In our work, we first conceptualize Face Part-Anchored Landmark Positions (FPALPs), wherein each landmark is treated as a progression value between zero (start) and one (end) along a face part's contour. Every landmark can be expressed in the FPALP format, irrespective of its source dataset, hence unlocking the ability to unify all $N$-point'' datasets into a single dataset. Secondly, we represent each landmark with an FPALP-based query, refine it progressively with a cross-modality decoder, and predict its coordinates based on the final representation. Our approach, called Unified Dynamic FLD, embodies these two design choices and streamlines the landmark detection pipeline by enabling (1) a single model to learn on any number of -point'' datasets, and (2) yield any number of specific landmark predictions by loading the designated landmark queries at runtime. Extensive experiments on multiple benchmark datasets show that our method delivers these benefits while remaining competitive with, and in several cases outperforming existing state-of-the-art methods.CDPM-Align: Multi-Scale Guidance-Aligned Diffusion Pretraining for Robust Few-Shot Anatomical Landmark Detection
Anatomical landmark detection is a fundamental task in medical image analysis supporting a wide range of diagnostic and interventional workflows. Although recent methods have achieved sub-millimetric localisation, accuracy alone is not sufficient for clinical deployment, requiring reliability and robustness in prediction. Despite its clinical relevance, the impact of representation learning in this context is still underexplored. In this work, we introduce CDPM-align, a multi-scale guidance-aligned conditional diffusion pre-training for anatomical landmark detection. Our experimental setup focuses on a few images and a few annotation regimes. Specifically, we employ three popular heterogeneous small-scale benchmark datasets for representation learning via conditional generative pre-training. Furthermore, we consider low-annotation scenarios for the downstream task of landmark detection, with 10 and 25 annotated images, reflecting realistic trade-offs between clinical effort and resource constraints for annotations. Our results confirm that generative pre-training enables the model to learn a robust representation. This improves both accuracy and uncertainty on the downstream tasks, advancing towards safe and efficient clinical deployment.