Training deep learning models for three-dimensional (3D) medical imaging, such as Computed Tomography (CT), is fundamentally challenged by the scarcity of labeled data. While pre-training on natural images is common, it results in a significant domain shift, limiting performance. Self-Supervised Learning (SSL) on unlabeled medical data has emerged as a powerful solution, but prominent frameworks often fail to exploit the inherent 3D nature of CT scans. These methods typically process 3D scans as a collection of independent 2D slices, an approach that fundamentally discards critical axial coherence and the 3D structural context. To address this limitation, we propose the autoencoder for enhanced self-supervised medical image learning(MAESIL), a novel self-supervised learning framework designed to capture 3D structural information efficiently. The core innovation is the 'superpatch', a 3D chunk-based input unit that balances 3D context preservation with computational efficiency. Our framework partitions the volume into superpatches and employs a 3D masked autoencoder strategy with a dual-masking strategy to learn comprehensive spatial representations. We validated our approach on three diverse large-scale public CT datasets. Our experimental results show that MAESIL demonstrates significant improvements over existing methods such as AE, VAE and VQ-VAE in key reconstruction metrics such as PSNR and SSIM. This establishes MAESIL as a robust and practical pre-training solution for 3D medical imaging tasks.
Figures & tables
Fig. 1: Overview of the proposed MAESIL framework, which masks a high ratio of an input 3D superpatch, feeds only the visible portions to an encoder, and uses a decoder to reconstruct the original superpatch from the encoded information and learnable mask tokens.
Fig. 2: The 3D input processing pipeline. A full 3D CT scans is first partitioned into ‘superpatches’. Each superpatch is then densely tokenized into smaller ‘standardized patches’, which serve as the input tokens for the Transformer.
Dataset
# Scans
Region
BTCV [ 10 ]
30
Abdominal
LIDC-IDRI [ 11 ]
1,018
Thoracic
TotalSegmentator [ 12 ]
1,204
Full-body
TABLE I: Overview of the datasets used for pre-training.
Model
PSNR ( ↑ )
SSIM ( ↑ )
LPIPS ( ↓ )
AE [ 14 ]
25.23
0.97
0.39
VAE [ 15 ]
11.91
0.25
0.91
VQ-VAE [ 16 ]
20.04
0.88
0.49
MAESIL (Ours)
30.28
0.98
0.26
TABLE II: Comparison with other models.
Dataset
PSNR ( ↑ )
BTCV [ 10 ]
32.09
LIDC-IDRI [ 11 ]
22.58
TotalSegmentatorV2 [ 12 ]
18.72
TABLE III: PSNR performance of our model (MAESIL) across different datasets.
Fig. 3: Qualitative reconstruction results of MAESIL across different anatomical views. The original input and reconstruction output are compared. From left to right: Axial, Coronal and Sagittal views.