MATS: A Multi-Agent Framework for Controllable and Reflective Tumor Synthesis
Organizations: Fudan University, Shanghai, China · Fudan University Shanghai Cancer Center, Shanghai, China
Abstract
Synthesizing realistic tumors on medical images helps address data scarcity for clinical AI. Existing diffusion-based methods, however, lack fine-grained attribute-level controllability, closed-loop quality verification, and awareness of which morphological patterns are underrepresented in the target distribution. We present MATS, a multi-agent framework for text-controllable, cross-organ tumor synthesis. Given a target disease, MATS first profiles its morphological distribution over a fine-grained attribute space covering tumor geometry and appearance, and constructs a generation plan that amplifies underrepresented subtypes while keeping common ones dominant. It then localizes the target organ, proposes anatomically valid placement, and executes two-stage diffusion to produce the tumor mask and render texture, each conditioned on the corresponding attributes. A closed-loop reflective mechanism verifies attribute alignment at three checkpoints throughout synthesis and provides targeted feedback to guide re-generation when misalignment is detected. Trained exclusively on a single-source pancreatic neuroendocrine tumor dataset, MATS consistently improves downstream segmentation both in-domain and across LiTS, KiTS, and MSD-Pancreas benchmarks, whereas most prior generative augmentation methods fall below real-only training.
Figures & tables
| Method | nnU-Net v2 | Swin-UNETR | ||||||
|---|---|---|---|---|---|---|---|---|
| DSC | [email protected] | [email protected] | [email protected] | DSC | [email protected] | [email protected] | [email protected] | |
| Existing methods | ||||||||
| Real only (Baseline) | 58.4 | 68.9 | 56.8 | 39.2 | 50.6 | 56.1 | 41.2 | 21.0 |
| + Copy-Paste | 44.5 | 50.7 | 40.5 | 32.4 | 47.5 | 56.1 | 33.1 | 16.2 |
| + Rule-based | 40.7 | 50.0 | 39.9 | 25.0 | 45.7 | 50.7 | 33.1 | 16.9 |
| + DiffTumor [ 4 ] | 54.1 | 62.8 | 49.3 | 33.8 | 49.0 | 59.5 | 36.5 | 17.6 |
| Seg. Backbone | Synthesis Method | Liver | Kidneys | Pancreas |
|---|---|---|---|---|
| nnU-Net v2 | Real only | 80.7 | 88.3 | 61.4 |
| + DiffTumor † [ 4 ] | 73.6 | 82.5 | 63.6 | |
| + LesionDiffusion [ 5 ] | 79.6 | 87.6 | 59.3 | |
| + MATS (Ours) | 81.5 | 90.0 | 64.3 | |
| Swin-UNETR | Real only | 75.7 | 83.9 | 46.3 |
| + DiffTumor † [ 4 ] | 71.4 | 76.4 | 62.2 |
| Metric | Value |
|---|---|
| Classification accuracy | 56.3% |
| Synthetic identified as real | 72.5% |
| Real identified as synthetic | 15.0% |
| Inter-reader agreement (Fleiss’ ) | 0.18 |
Medical Image Synthesis
Medical image synthesis creates, translates, reconstructs, and edits clinical images to fill missing data and support analysis.
See all 328 papers