eess.IVNov 6, 2026

Frequency-consistent synthesis and selective transfer for medical image analysis

Authors: Zhuhui Wang, Jianwei Zuo, Xin Peng, Kai Zhong, Xuliang Deng, Jiajia Luo

Organizations: Institute of Medical Technology, Peking University Health Science Center, Beijing, 100191, China. · Biomedical Engineering Department, Institute of Advanced Clinical Medicine, Peking University, Beijing, 100191, China. · Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology, Beijing, 100081, China. · National Clinical Research Center for Oral Diseases, National Engineering Laboratory for Digital and Material Technology of Stomatology, Beijing Key Laboratory of Digital Stomatology, Beijing, 100081, China. · 

Abstract

Complementary imaging is not always available, and realistic synthesis does not necessarily improve downstream analysis. Here we introduce a training framework linking medical image synthesis to task learning through adaptive frequency consistency and selective feature transfer. Image-specific frequency constraints encourage consistency of structure and detail. Features are transferred only when a teacher using synthetic images achieves a lower task-error score than the student by a task-specific margin on a labelled training sample. Evaluations across five datasets show improved translation fidelity with three adversarial and diffusion-based translators trained without paired supervision, alongside gains in brain-tumour segmentation on tumour-containing slices and lesion centre-point detection. All 105 reported paired comparisons yielded point estimates favouring the proposed methods, including 36 external translation comparisons on post?treatment MRI without retraining. These findings support synthetic modalities as task-oriented complements to acquired scans when complementary imaging is unavailable.

Figures & tables

Explore similar work

Jul 21, 2026

Posterior Samplings are Missing Modalities Generators for Medical Image Translation

Magnetic resonance imaging comes in various modality contrasts that provide complementary anatomical and pathological information. Complete multimodal acquisitions are often unavailable due to time and protocol constraints. This leads to real-world datasets with missing modalities, where conventional medical image translation methods are typically limited to fixed source-target settings or require retraining for each observed source-target pair. We propose a unified framework that formulates missing-modality generation as a linear inverse problem under a joint distribution and solves it via posterior sampling with a flow matching model. By learning a joint prior over the complete modality set, our method can reconstruct arbitrary missing modalities at inference time by guiding the sampling trajectory to enforce measurement consistency with observed modalities. We further mitigate inter-modality error propagation in multi-target generation by adopting a many-to-one sampling strategy. Experiments on BraTS and IXI datasets show that our method achieves the best performance over baselines across most missing-modality scenarios. In downstream tumor segmentation, synthesized images from our method result in higher segmentation performance, indicating better preservation of clinically relevant structures.
Jun 23, 2026

Prob-BBDM: a Probabilistic Brownian Bridge Diffusion Model for MRI sequence image-to-image translation

AI-driven image-to-image synthesis is rapidly advancing, with growing applications in medical imaging. Multi-modal image analysis plays a crucial role in optimizing examination quality, yet acquiring multiple imaging modalities in clinical settings remains resource-intensive and time-consuming, especially for 3D imaging. To address this challenge, we propose a novel image-to-image translation model based on Brownian Bridge Diffusion Models (BBDM), which synthesizes magnetic resonance imaging (MRI) sequences from 2D axial slices. Our approach integrates a variational encoder-guided diffusion mechanism, leveraging probabilistic image distributions to enhance synthesis quality. Evaluated on the BraTS 2021 dataset, our Probabilistic-BBDM (Prob-BBDM) achieves superior performance across multiple translation tasks, reaching up to 88.46% SSIM and 26.09 dB PSNR, with consistent improvements over baselines. Notably, our diffusion process requires only 4 steps, making it computationally efficient while maintaining high-quality synthesis. To further validate generalizability, we test Prob-BBDM on an external third-party dataset, demonstrating consistent performance across domains. Additionally, we assess the clinical utility of the synthesized slices by using them as input to a pre-trained segmentation model. Tumor segmentation yields a Dice score of 88.71% and an HD95 of 3.49 mm, confirming that the synthesized slices preserve critical diagnostic information. These results highlight the potential of Prob-BBDM for high-quality, efficient, and generalizable MRI synthesis, offering a promising step toward improved medical image translation.
May 13, 2026

Cross Modality Image Translation In Medical Imaging Using Generative Frameworks

Magnetic Resonance Imaging (MRI), Computed Tomography (CT), and Positron Emission Tomography (PET) provide complementary information about tissues. Medical image-to-image (I2I) translation enables virtual scanning by synthesizing a target modality from a source one without requiring an additional acquisition. Despite growing interest, many methods operate on 2D slices, are evaluated on isolated tasks under different experimental settings, and lack clinically oriented assessment. This work presents a reproducible benchmark for 3D I2I translation in oncological imaging that compares seven generative models: three Generative Adversarial Networks (Pix2Pix, CycleGAN, and SRGAN) and four latent models (Latent Diffusion Model, Latent Diffusion Model+ControlNet, Brownian Bridge, and Flow Matching). The benchmark comprises 77 experiments across eleven configurations drawn from five datasets, covering three anatomical regions (head/neck, lung, and pelvis) and four translation directions (cone-beam CT to CT, MRI to CT, CT to PET, and T2-weighted MRI to T2-FLAIR). Under the evaluated configurations, SRGAN achieves the highest quantitative image fidelity across all tasks, while latent models perform less well, due to information loss introduced by the variational autoencoder. A tumor-level analysis reveals that all models struggle with small lesions and that, in CT to PET synthesis, models reproduce tumor shape more reliably than tracer uptake values. A Visual Turing test involving 17 physicians, including 15 radiologists, shows near-chance classification accuracy (56.7%), suggesting that experts struggle to distinguish real from synthetic volumes under the viewing conditions of the study. Expert preferences do not follow quantitative rankings, exposing a dissociation between quantitative metrics and clinical preference.