Organizations: Dwarkadas J Sanghvi College of Engineering, Mumbai, India · University of Amsterdam, Amsterdam, Netherlands · National University of Singapore, Singapore · Georgia Institute of Technology, Atlanta, USA
Fracture detection and its clinical interpretability see notable improvements when deep vision models are integrated with agentic AI architectures. While deep learning models achieve high diagnostic performance, their black-box nature limits clinical adoption. We propose FRAC-MAS, an agentic AI system for automated, explainable, and safe bone fracture detection. The framework combines a stacked ensemble of four vision models with conformal prediction to produce statistically grounded differential diagnoses, while a multi-agent workflow performs independent verification, retrieves clinical guidelines, and generates patient-friendly reports. A pipeline-depth ablation study confirms that our multi-agent critic triages 86.6% of cases into a high-confidence auto-confirmed cohort while escalating uncertain cases, outperforming a single-agent baseline. Patient preference studies against Llama, MedGemma, and Gemini further demonstrate significantly more comprehensible clinical reports. These results suggest that integrating multi-agent critics with conformal guarantees enables safer radiology triage while preserving clinician oversight. More broadly, FRAC-MAS demonstrates how cooperative agentic architectures can serve as auditable, human-in-the-loop decision support systems for safety-critical healthcare. Our code is available at https://github.com/hardik1712/FRAC-MAS, and the website is available at https://frac-mas.vercel.app.
Figures & tables
Figure 1: End-to-end system architecture: integrating ensemble inference, Grad-CAM localization, multi-agent reasoning, and conformal prediction for verifiable clinical report generation.
Configuration
Acc. (%)
Conf. Acc. (%)
Escalation Rate (%)
Set Size
Coverage (%)
Know/Educ (%)
Single-agent baseline
91.1
—
100.0
—
—
—
Ensemble only
91.1
—
1 0.0
—
—
—
+Conformal ( α=0.10 )
91.1
—
1 0.0
1.08
92.0
—
+Conformal + Critic
91.1
93.8
13.4
1.08
92.0
—
Full pipeline
91.1
93.8
13.4
1.08
92.0
100.0
Table 1: Pipeline-depth ablation on the 112-sample test set ( α=0.10 , stacking). Conf. Acc. is accuracy on cases not flagged for human escalation. † The Critic uses local MedGemma-4B-IT.
Configuration
Det. Rate
F1
sˉ
MaxViT
0.950
0.974
0.947
HC-CBAM-DenseNet169
0.900
0.947
0.903
RAD-DINO
0.914
0.955
0.901
YOLOv26m-cls
0.921
0.959
0.927
Ensemble (Wt. Avg)
0.929
0.963
0.920
Ensemble (Stacking)
0.964
0.982
0.916
Table 2: Binary fracture detection on the Roboflow dataset (140 images, all positive). Det. Rate = recall; sˉ = mean fracture score.
Class
N
Acc. (%)
Coverage (%)
α=0.05
α=0.10
Comminuted (COM)
17
100.0
100.0
100.0
Greenstick (GRN)
13
100.0
100.0
100.0
Healthy (HLT)
10
100.0
100.0
100.0
Oblique (OBL)
17
70.6
76.5
82.4
Oblique Displaced (OBL-D)
9
100.0
100.0
100.0
Table 3: Per-class ensemble accuracy and conformal coverage on the test set. Coverage failures concentrate among morphologically similar types.
Fracture
Active (%)
Mean Act.
MaxViT
HC
MaxViT
HC
Comminuted
2.4
59.8
0.04
0.55
Oblique Disp.
7.4
53.0
0.23
0.52
Spiral
7.4
66.8
0.14
0.61
Transverse
20.6
58.5
0.27
0.57
Table 4: Grad-CAM attention statistics. Active fraction is the proportion of pixels exceeding 0.3 activation. MaxViT attends to 2%-21% of an image while the HyperColumn model covers 53%-67%.
Dimension
Mean Score
Score ≥ 4 (%)
Fleiss’ κ
Technical Accuracy
4.14
75.0
0.72
Comprehensibility
3.95
68.2
0.65
Table 5: Clinician ratings of the system’s educational outputs (1–5 scale) and inter-rater agreement across three orthopedic raters.
Automated 3D radiology report generation often suffers from clinical hallucinations and a lack of the iterative verification found in human practice. While recent Vision-Language Models (VLMs) have advanced the field, they typically operate as monolithic "black-box" systems without the collaborative oversight characteristic of clinical workflows. To address these challenges, we propose MARCH (Multi-Agent Radiology Clinical Hierarchy), a multi-agent framework that emulates the professional hierarchy of radiology departments and assigns specialized roles to distinct agents. MARCH utilizes a Resident Agent for initial drafting with multi-scale CT feature extraction, multiple Fellow Agents for retrieval-augmented revision, and an Attending Agent that orchestrates an iterative, stance-based consensus discourse to resolve diagnostic discrepancies. On the RadGenome-ChestCT dataset, MARCH significantly outperforms state-of-the-art baselines in both clinical fidelity and linguistic accuracy. Our work demonstrates that modeling human-like organizational structures enhances the reliability of AI in high-stakes medical domains.
Yi Lin, Yihao Ding, Yonghui Wu +1
Weill Cornell Medicine, New York, USA · University of Western Australia, Crawley, Australia · University of Florida, Florida, USA
While Multi-Agent Systems (MAS) show potential for complex clinical decision support, the field remains hindered by architectural fragmentation and the lack of standardized multimodal integration. Current medical MAS research suffers from non-uniform data ingestion pipelines, inconsistent visual-reasoning evaluation, and a lack of cross-specialty benchmarking. To address these challenges, we present MedMASLab, a unified framework and benchmarking platform for multimodal medical multi-agent systems. MedMASLab introduces: (1) A standardized multimodal agent communication protocol that enables seamless integration of 11 heterogeneous MAS architectures across 24 medical modalities. (2) An automated clinical reasoning evaluator, a zero-shot semantic evaluation paradigm that overcomes the limitations of lexical string-matching by leveraging large vision-language models to verify diagnostic logic and visual grounding. (3) The most extensive benchmark to date, spanning 11 organ systems and 473 diseases, standardizing data from 11 clinical benchmarks. Our systematic evaluation reveals a critical domain-specific performance gap: while MAS improves reasoning depth, current architectures exhibit significant fragility when transitioning between specialized medical sub-domains. We provide a rigorous ablation of interaction mechanisms and cost-performance trade-offs, establishing a new technical baseline for future autonomous clinical systems. The source code and data is publicly available at: https://github.com/NUS-Project/MedMASLab/
Yunhang Qian, Xiaobin Hu, Jiaquan Yu +6
National University of Singapore · University of Science and Technology of China · Fudan University +3
We propose MARL-Rad, a multi-modal multi-agent reinforcement learning framework for radiology report generation that trains the entire agentic system on policy within its deployed radiology workflow. MARL-Rad addresses the limitation of post-hoc agentization, where fixed LLMs are organized into hand-designed agentic workflows without being optimized for their assigned roles. Our framework decomposes chest X-ray interpretation into region-specific agents and a global integrating agent, and jointly optimizes them using clinically verifiable rewards. Experiments on the MIMIC-CXR and IU X-ray datasets show that MARL-Rad consistently improves clinical efficacy metrics such as RadGraph, CheXbert, and GREEN scores, achieving state-of-the-art clinical efficacy performance. Further analyses show that MARL-Rad improves laterality consistency and produces more accurate and detailed reports. A blinded clinician evaluation further suggests that MARL-Rad produces reports clinically comparable to ground-truth reports.
Kaito Baba, Risa Kishikawa, Satoshi Kodera
Department of Cardiovascular Medicine The University of Tokyo Hospital, Tokyo, Japan