RDFace: A Benchmark Dataset for Rare Disease Facial Image Analysis under Extreme Data Scarcity and Phenotype-Aware Synthetic Generation
Organizations: Western University · Concordia University · University of Toronto · University of Winnipeg
Abstract
Rare diseases often manifest with distinctive facial phenotypes in children, offering valuable diagnostic cues for clinicians and AI-assisted screening systems. However, progress in this field is severely limited by the scarcity of curated, ethically sourced facial data and the high similarity among phenotypes across different conditions. To address these challenges, we introduce RDFace, a curated benchmark dataset comprising 456 pediatric facial images spanning 103 rare genetic conditions (average 4.4 samples per condition). Each ethically verified image is paired with standardized metadata. RDFace enables the development and evaluation of data-efficient AI models for rare disease diagnosis under real-world low-data constraints. We benchmark multiple pretrained vision backbones using cross-validation and explore synthetic augmentation with DreamBooth and FastGAN. Generated images are filtered via facial landmark similarity to maintain phenotype fidelity and merged with real data, improving diagnostic accuracy by up to 13.7% in ultra-low-data regimes. To assess semantic validity, phenotype descriptions generated by a vision-language model from real and synthetic images achieve a report similarity score of 0.84. RDFace establishes a transparent, benchmark-ready dataset for equitable rare disease AI research and presents a scalable framework for evaluating both diagnostic performance and the integrity of synthetic medical imagery.
Figures & tables
| Acc (%) | Top-1 | Top-5 | Top-10 | Top-30 |
|---|---|---|---|---|
| ResNet | 6.90 (1.45) | 18.58 (3.00) | 28.50 (3.67) | 54.34 (2.39) |
| DenseNet | 15.93 (2.34) | 33.63 (3.70) | 43.01 (2.63) | 64.42 (1.92) |
| FaceNet | 9.91 (1.81) | 24.60 (5.43) | 34.87 (4.75) | 58.23 (5.06) |
| VGG | 11.68 (1.58) | 29.91 (2.68) | 38.41 (1.34) | 60.88 (2.02) |
| Swin-T | 14.34 (2.61) | 26.19 (2.04) | 35.93 (3.17) | 58.41 (3.81) |
| CLIP | 3.01 (1.48) | 12.74 (2.84) | 19.12 (5.18) | 42.30 (4.40) |
| Acc (%) | 5-way 1-shot | 10-way 1-shot | 15-way 1-shot |
|---|---|---|---|
| ResNet | 24.18 (2.56) | 18.15 (2.58) | 17.99 (1.26) |
| DenseNet | 26.20 (2.01) | 17.36 (1.66) | 17.30 (3.45) |
| FaceNet | 25.16 (4.89) | 12.93 (2.23) | 8.03 (1.40) |
| VGG | 21.54 (3.72) | 10.82 (2.14) | 9.05 (2.20) |
| Swin-T | 22.24 (2.88) | 10.94 (2.59) | 8.03 (2.41) |
| CLIP | 23.48 (5.28) | 12.33 (1.96) | 7.30 (1.90) |
| ACC (%) | Real only | Real+DB | Real+FG | Real+DB+FG |
|---|---|---|---|---|
| ResNet | 6.90 (1.45) | 12.21 (1.70) | 8.50 (1.48) | 8.32(1.73) |
| DenseNet | 15.93 (2.34) | 17.52 (2.29) | 13.27 (3.13) | 16.46 (2.63) |
| FaceNet | 9.91 (1.81) | 15.04 (2.87) | 6.55 (2.48) | 10.97 (2.55) |
| VGG | 11.68 (1.58) | 16.64 (4.07) | 7.26 (2.37) | 12.92(2.84) |
| Swin-T | 14.34 (2.61) | 16.81 (1.40) | 10.44 (1.70) | 14.34 (1.70) |
| CLIP | 3.01 (1.48) | 9.03 (2.29) | 1.42 (1.34) | 4.25 (1.58) |
| 5-way 1-shot ACC (%) | Real only | Real + DB |
|---|---|---|
| ResNet | 24.18 (2.56) | 25.72 (1.62) |
| DenseNet | 26.20 (2.01) | 29.88 (1.51) |
| FaceNet | 25.16 (4.89) | 23.60 (4.06) |
| VGG | 21.54 (3.72) | 21.02 (5.85) |
| Swin-T | 22.24 (2.88) | 26.72 (4.34) |
| CLIP | 23.48 (5.28) | 22.30 (2.63) |
Appendix figures & tables29 assets
Supplementary material from the paper’s appendix.
Appendix
| Disease Name | Abbr | Gene | Subcategory | Orphanet Code | # Img |
|---|---|---|---|---|---|
| Aarskog-Scott syndrome | AAR | FGD1 | Delayed puberty | 915 | 5 |
| Aicardi-Goutieres | AIC | TREX1 | ? | 51 | 5 |
| Triple A syndrome | ALL | AAAS | multisystem disease | 869 | 5 |
| Allan-herndon-dudley Syndrome | ALLA | SLC16A2 | Ataxia | 59 | 5 |
| Alport syndrome | ALP | ? | Abnormal retinal morphology | 63 | 4 |
| Alpha-thalassemia | ALPH | ? | Cholestasis | 846 | 5 |
| Plausibility Rating | DreamBooth | FastGAN | ||
|---|---|---|---|---|
| MD1 | MD2 | MD1 | MD2 | |
| Plausible | 38 | 31 | 14 | 5 |
| Implausible | 2 | 3 | 15 | 30 |
| Uncertain | 10 | 16 | 21 | 15 |
| Label | Plausible | Implausible | Uncertain | Total |
|---|---|---|---|---|
| Plausible | 31 / 2 | 0 / 0 | 0 / 3 | 31 / 5 |
| Implausible | 0 / 7 | 2 / 11 | 1 / 12 | 3 / 30 |
| Uncertain | 7 / 5 | 0 / 4 | 9 / 6 | 16 / 15 |
| Total | 38 / 14 | 2 / 15 | 10 / 21 | 50 / 50 |
| Method | Observed Agreement (%) | Cohen’s | SE | 95% CI |
|---|---|---|---|---|
| DB | 84.0 (42/50) | 0.654 | 0.106 | [0.446, 0.862] |
| FG | 38.0 (19/50) | 0.069 | 0.091 | [–0.110, 0.248] |
| ACC (%) | Top- | ResNet | DenseNet | FaceNet | VGG | Swin-T | CLIP |
|---|---|---|---|---|---|---|---|
| Top-1 | Real only | 6.90 (1.45) | 15.93 (2.34) | 9.91 (1.81) | 11.68 (1.58) | 14.34 (2.61) | 3.1 (1.48) |
| Top-1000 | 12.21 (1.70) | 17.52 (2.29) | 15.04 (2.87) | 16.64 (4.07) | 16.81 (1.40) | 9.03 (2.29) | |
| Top-2000 | 12.57 (2.61) | 20.35 (1.40) | 14.51 (1.34) | 14.69 (1.61) | 18.76 (2.20) | 15.22 (4.35) | |
| Top-4000 | 13.27 (2.26) | 19.65 (0.74) | 16.46 (1.01) | 17.35 (4.18) | 18.76 (2.29) | 16.81 (1.25) | |
| Top-6000 | 13.63 (1.61) | 21.06 (2.53) | 16.28 (2.91) | 16.64 (2.61) | 18.94 (2.70) | 15.75 (2.58) | |
| Top-5 | Real only | 18.58 (3.00) | 33.63 (3.70) | 24.60 (5.43) | 29.91 (2.68) | 26.19 (2.68) | 12.74 (2.84) |
| ACC (%) | Top- | ResNet | DenseNet | FaceNet | VGG | Swin-T | CLIP |
|---|---|---|---|---|---|---|---|
| Top-1 | Real only | 6.90 (1.45) | 15.93 (2.34) | 9.91 (1.81) | 11.68 (1.58) | 14.34 (2.61) | 3.1 (1.48) |
| Top-1000 | 8.50 (1.48) | 13.27 (3.13) | 6.55 (2.84) | 7.26 (2.37) | 10.44 (1.70) | 1.42 (1.34) | |
| Top-2000 | 6.55 (2.13) | 10.44 (0.40) | 5.13 (0.74) | 6.37 (3.67) | 8.50 (2.63) | 1.06 (1.15) | |
| Top-4000 | 4.07 (1.48) | 8.14 (1.45) | 4.96 (1.19) | 7.96 (2.26) | 9.73 (1.40) | 0.71 (0.74) | |
| Top-6000 | 4.78 (0.79) | 9.73 (2.08) | 4.78 (1.34) | 5.49 (2.61) | 9.20 (1.84) | 1.42 (1.01) | |
| Top-5 | Real only | 18.58 (3.00) | 33.63 (3.70) | 24.60 (5.43) | 29.91 (2.68) | 26.19 (2.68) | 12.74 (2.84) |
| ACC (%) | 5-way | 10-way | 15-way | |||
|---|---|---|---|---|---|---|
| 1-shot | 5-shot | 1-shot | 5-shot | 1-shot | 5-shot | |
| ResNet | 24.18 (2.56) | – | 18.15 (2.58) | – | 17.99 (1.26) | – |
| ResNet (dream) | 25.72 (1.62) | 33.62 (1.91) | 22.21 (2.60) | 22.63 (2.11) | 18.22 (1.91) | 20.04 (2.77) |
| DenseNet | 26.20 (2.01) | – | 17.36 (1.66) | – | 17.30 (3.45) | – |
| DenseNet (dream) | 29.88 (1.51) | 33.40 (2.02) | 19.79 (3.19) | 24.43 (3.82) | 16.06 (2.77) | 18.35 (2.24) |
| FaceNet | 25.16 (4.89) | – | 12.93 (2.33) | – | 8.03 (1.40) | – |
| Region | BioBERT Similarity Score | TF-IDF Similarity Score |
|---|---|---|
| Overall | 0.8404 (0.0748) | 0.7630 (0.0707) |
| Left Eye | 0.7485 (0.1228) | 0.4364 (0.1358) |
| Right Eye | 0.7535 (0.1423) | 0.4578 (0.1352) |
| Nose | 0.7712 (0.1344) | 0.4315 (0.1432) |
| Mouth/Lips | 0.7355 (0.1376) | 0.4612 (0.1321) |
| LLaVA (Real) | LLaVA (Synthetic) | |
|---|---|---|
| Qwen (Real) | 0.7053 (0.0711) | 0.7176 (0.0691) |
| Qwen (Synthetic) | 0.7204 (0.0726) | 0.7355 (0.0730) |
| Parameter | Value |
|---|---|
| Optimizer | Adam |
| Learning rate | |
| Batch size | 32 |
| Training folds | 5-fold class split |
| Number of epochs | 50 |
| Loss function | CrossEntropyLoss |
| Parameter | Value |
|---|---|
| Optimizer | Adam |
| Learning rate | |
| Batch size | 1 |
| Training folds | 5-fold class split |
| Episodes per fold | 600 train / 100 val / 200 test |
| Loss function | CrossEntropyLoss |
| Parameter | Value / Description |
|---|---|
| Base model | SG161222/Realistic_Vision_V5.1_noVAE |
| Training setting | Class-conditioned (per disease) |
| Text prompt | "a child with [DISEASE] disease" |
| Training steps | 800 per class |
| Batch size | 1 |
| Learning rate |
| Parameter | Value / Description |
|---|---|
| Architecture | Original FastGAN (skip-layer excitation) |
| Training setting | Unconditional (no class labels) |
| Iterations | 80,000 |
| Batch size | 8 |
| Optimizer | Adam |
| Learning rate |