Organizations: Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China · Faculty of Biomedical Engineering, Shenzhen University of Advanced Technology, Shenzhen, China · School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China · Faculty of Computility Microelectronics, Shenzhen University of Advanced Technology, Shenzhen, China · Research Institute of Trustworthy Autonomous Systems, Southern University of Science and Technology, Shenzhen, China
Endpoint-only unsupervised 4D medical image interpolation synthesizes intermediate volumes from sparsely sampled sequences with only the start and end volumes available for training; however, this weakly constrained setting often yields intermediates with unstable boundaries and non-physiological motion, limiting interpretability and downstream analysis. We propose low-rank velocity fields as a structural prior, constraining motion to a structured Tucker low-rank velocity field space that decomposes motion into globally shared spatial bases and a compact sample-specific core, thereby encouraging spatially correlated, anatomy-consistent deformation while suppressing voxel-wise high-frequency artifacts. To capture global coordination and local non-rigid details, we model motion in a coarse-to-fine multi-scale scheme and compose scale-wise deformations at inference to synthesize volumes at arbitrary times. We further provide a theoretical analysis showing that, under Tucker parameterization, low-rank parameters control the smoothness energy of the velocity field, explaining why low-rank modeling promotes smoother motion. Experiments on ACDC and 4D-Lung demonstrate state-of-the-art performance, remaining competitive with methods trained with intermediate-frame supervision, and producing intermediates with improved structural coherence and more stable anatomical contours.
Figures & tables
Figure 1: Overview of the proposed framework. (a) Multi-scale endpoint features are projected into a structured low-rank velocity representation across resolutions via Tucker decomposition, aligning motion modeling with the coordinated and compact nature of anatomical dynamics. (b) Inference performs bi-directional continuous-time interpolation to produce structurally consistent intermediate volumes.
Method
Year
ACDC
4D-Lung
NMI ×10−2↑
NMSE ×10−3↓
SSIM ×10−2↑
NMI ×10−2↑
NMSE ×10−3↓
SSIM ×10−2↑
VM
2019
53.54 ±0.37
19.18 ±0.34
94.68 ±0.10
43.98 ±0.36
39.02 ±0.60
86.06 ±0.29
TM
2022
64.63 ±0.67
14.43 ±0.62
96.64 ±0.12
48.95 ±0.10
34.96 ±0.40
84.78 ±0.12
SVIN
2020
60.18 ±0.33
9.85 ±0.89
97.35 ±0.15
43.17 ±0.39
30.28 ±2.03
85.44 ±0.29
UVINet
2024
72.25 ±0.17
4.81 ±0.12
98.62 ±0.03
55.16 ±0.84
20.93 ±1.27
88.75 ±0.67
DDM
2022
64.14 ±1.35
10.36 ±0.30
97.24 ±0.87
42.54 ±0.89
33.19 ±0.73
85.23 ±0.27
Table 1: Quantitative comparison on ACDC and 4D-Lung datasets.
Figure 2: Qualitative comparison on ACDC and 4D-Lung datasets.
Figure 3: Ablation on ACDC. (a) NMI under different Tucker rank settings. (b) Velocity field Effective Rank [ 16 ] (log 10 -scaled). (c) NMI vs. scale weights (ternary diagram).
4D medical image interpolation aims to recover missing volumes from sparsely observed time points and is important for dynamic anatomical analysis in applications such as cardiac MRI and thoracic CT, where motion is often repetitive or near-periodic over clinically relevant intervals. A key challenge is that this structure is not always encoded directly in deformation representations for interpolation. In addition, physiological motion is often non-uniform, so equal temporal intervals do not necessarily correspond to equal amounts of anatomical change. To address these issues, we formulate interpolation as learning a continuous deformation process with a phase-structured prior. Given two endpoint volumes, we parameterize a phase-conditioned velocity field with a finite Fourier basis, which embeds near-periodic motion patterns directly into the deformation space and supports continuous querying at arbitrary target times. We further introduce a phase-aligned temporal reparameterization that maps normalized within-interval time to a latent motion phase according to deformation variation intensity, thereby better modeling non-uniform motion progression. Intermediate volumes are then synthesized by continuously warping both endpoints, followed by bidirectional fusion and lightweight residual refinement. Experiments on ACDC and 4D-Lung show that the proposed method achieves state-of-the-art performance over existing baselines while producing anatomically plausible and coherent intermediate volumes from sparse observations.
Haojin Li, Hengzhuo Wang, Zhiheng Ma +3
School of Computer Science and Engineering Beihang University Beijing, China
Developing robust artificial intelligence models for 4D (3D + time) medical imaging is constrained by limited annotated data, inter-device domain shifts, and privacy restrictions. To address this, we propose a 4D controllable generative framework for anatomically consistent data augmentation. A semi-supervised variational autoencoder learns a compact latent representation of anatomical volumes while jointly predicting aligned segmentation masks in a unified framework. Anatomical structure is then disentangled from temporal dynamics through a cascaded latent diffusion model (LDM). A static LDM generates subject-specific anatomy conditioned on clinical priors (diagnosis and volumes measures) and a subsequent motion LDM estimates residual latent motions, ensuring strict temporal coherence across the 4D sequence. The proposed approach was evaluated on cine cardiac MRI as a representative 4D imaging application. Experiments across multiple datasets demonstrate high controllability of static anatomy (Pearson r > 0.8) and strong temporal coherence (FVD = 288.08). In cross-vendor generalization experiments, augmenting training sets with synthetic 4D sequences significantly improves downstream segmentation performance. Using nnU-Net, the proposed augmentation strategy improves the average Dice score by 1.4% and reduces the Hausdorff Distance by 3.0mm compared to training on real data alone, for the left ventricle, Dice improves by 2.8% with a 5.4mm reduction in boundary error. Overall, this framework provides a scalable and controllable solution for 4D medical image synthesis, supporting the development of more robust models with limited annotations and cross-vendor variability. Code available on https://github.com/cyiheng/4DCardiacMRISynthesis.
Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Science, Suzhou, China · Systemes Complexes et Intelligence Artificielle, IMT Mines Ales, Ales, France · School of Artificial Intelligence and Advanced Computing, Xi’an Jiaotong-Liverpool University, Suzhou, China
Existing unified 4D reconstruction and point tracking approaches typically rely on heuristic interpolations or just predict at integer timestamps, lacking kinematic coherence and failing to model dynamics at any arbitrary timestamp. In this paper, we propose Uni4R, a framework that unifies these tasks by learning continuous velocity fields through the synergy of Optimal Transport (OT) and Ordinary Differential Equation (ODE). Importantly, this continuous velocity field acts as a kinematic prior that mutually benefits both 4D reconstruction and point tracking. Specifically, we propose the Flow Matching Guided Decoder (FMGD). A global velocity branch first extracts anchor features that capture the global dynamic state of the sequence. Then, FMGD leverages Flow Matching (FM) theory to formulate a probability path defined by OT on the anchor feature manifold, instantiating it as FM-guided velocity features for velocity prediction. This establishes a robust kinematic inductive bias. Meanwhile, a point reconstruction branch provides geometric features. The local velocity prediction module then joint above features and time embeddings, to decode velocities at arbitrary timestamps. To overcome the absence of high-quality ground-truth velocities in fractional frames, we propose an integral-consistency training strategy. This strategy uses an ODE solver to integrate velocities to recover target pointmaps, enabling the model to be supervised end-to-end directly from integer timestamps. Experimental results demonstrate that Uni4R achieves SOTA performance in both 4D reconstruction and point tracking, and achieves SOTA in our new kinematics-aware benchmark at continuous time.
Liying Yang, Hao Mo, Jialun Liu +7
SCSE, Macau University of Science and Technology · The University of Queensland · Great Bay University +3