Pretrained vision-language models and diffusion generators have driven rapid progress in brain-to-image generation, while EEG-based reconstruction is still constrained by low signal-to-noise ratio and cross-subject semantic shifts. Zero-shot cross-subject reconstruction poses even greater challenges: EEG semantic embeddings learned from source subjects deviate from the manifold of image embeddings of the unseen target subject, particularly when neither target labels nor target image embeddings are available. To address this issue, we introduce the Semantic Preservation and Subspace Calibration (SPSC) framework, which first uses Object Mask Contrastive Regularization (OMCR) with object identity for backend training, and then constructs Subspace Candidate Gate (SCG) to achieve label-free semantic correction for target subjects during inference. Specifically, OMCR regularizes the conditioning space with object-level positive samples to preserve object-level feature neighborhoods within the reconstruction prior and low-level branch, while SCG exploits training image prototypes and batch statistics of unlabeled target EEG to select candidates for each task within subspaces of image prototypes. Under the leave-one-subject-out (LOSO) setting across ten subjects on the THINGS-EEG dataset, SPSC improves the cross-subject reconstruction from 0.552 to 0.713 on CLIP and from 0.612 to 0.745 on Alex.5. These significant gains indicate that the semantically calibrated conditions can better support generation for the target subjects under label-free inference.
Figures & tables
Figure 1: SPSC framework for zero-shot cross-subject EEG-to-image reconstruction. In the stage 1, we train the EEG encoder with the linear projector via constrastive learning and transform EEG to semantic vectors EE ( xi,s ). Subsequently, SCG uses training image prototypes P and LOSO EE statistics extracted from the target subject to construct semantic candidates CK in PCA subspaces of image prototypes, then selects semantic vectors in SCG-Recon or SCG-Ret through a label-free confidence gate. In the stage 2, we adopt SCG-Recon output EE for image generation, while OMCR preserves object-level neighborhoods within CLIP embeddings HI of the diffusion prior and the low-level VAE latent features VE .
Method
Metric (%)
S01
S02
S03
S04
S05
S06
S07
S08
S09
S10
Mean
NICE
Top-1
7.60
5.90
6.00
6.30
4.40
5.60
5.60
6.30
5.70
8.40
6.20
( Song et al. 2023 )
Top-5
22.8
20.5
22.3
20.7
18.3
22.2
19.7
22.0
17.6
28.3
21.4
ATM
Top-1
10.5
7.10
11.9
14.7
7.00
11.1
16.1
15.0
4.90
20.5
11.9
( Li et al. 2024 )
Top-5
26.8
24.8
33.8
39.4
23.9
35.8
43.5
40.3
22.7
46.5
33.8
AVDE
Top-1
14.1
17.0
9.10
15.2
12.5
17.3
7.40
18.5
13.2
18.0
14.3
( Dai et al. 2026 )
Top-5
32.2
38.4
21.8
32.5
32.4
38.6
20.4
40.1
33.6
39.3
32.9
Table 1: Cross-subject 200-way retrieval accuracy under ten-subject LOSO. Best and second best are highlighted.
Method
Pix. ↑
SSIM ↑
Alex.2 ↑
Alex.5 ↑
CLIP ↑
SwAV ↓
Cross-subject
Li et al.
0.079
0.374
0.640
0.649
0.556
0.638
SCG-Recon
0.174
0.389
0.684
0.726
0.723
0.618
Intra-subject
Li et al.
0.160
0.345
0.776
0.866
0.786
0.582
CogCapturer
0.175
0.366
0.760
0.610
0.744
0.577
Table 2: Subject-08 reconstruction metrics in cross- and intra-subject settings. CogCapturer abbreviates CognitionCapturer ( Zhang et al. 2025 ) .
Method
Stat
Alex.2 ↑
Alex.5 ↑
CLIP ↑
SwAV ↓
Li et al.
Mean
0.590
0.612
0.552
0.648
Std
0.025
0.021
0.032
0.006
SCG-Recon
Mean
0.706
0.745
0.713
0.618
Std
0.028
0.023
0.027
0.010
Table 3: Cross-subject reconstruction under ten-subject LOSO, reported as mean and population standard deviation.
Figure 4: Diagnostics for LOSO training subspace scale. The correction mask estimates the required correction magnitude for each PCA coordinate; semantic SNR is defined as the variance across stimuli divided by the variance across subjects for the same stimulus; abs.corr. denotes the mean absolute Pearson correlation between EEG embedding coordinate means of source subjects and paired image prototype coordinates.
Readout
Selector
Top-1 (%) ↑
Top-5 (%) ↑
SCG-Ret
Confidence
24.0
46.0
SCG-Ret
Fixed k256
23.5
46.5
SCG-Ret
Average
21.0
46.0
SCG-Ret
Oracle
27.0
47.5
Table 5: LOSO Sub-08 retrieval selector behavior.
Figure 5: LOSO Sub-08 paired semantic alignment.
Figure 6: LOSO Sub-08 prior replacement curve.
Appendix figures & tables27 assets
Supplementary material from the paper’s appendix.
Appendix
Condition
PixCorr ↑
SSIM ↑
Alex.2 ↑
Alex.5 ↑
CLIP ↑
SwAV ↓
raw image
0.199
0.284
0.858
0.949
0.995
0.423
augmentation
0.231
0.293
0.868
0.953
0.996
0.443
Appendix
Table 6: Oracle CLIP-to-SDXL-Turbo sanity check for ViT-H-14 embedding.
Figure 19: Representative difficult cases from the remaining cross-subject Sub-08 reconstructions. Rows compare the seen stimulus, Li et al., and our reconstruction.
Visual brain decoding translates neural activity into human-interpretable images. While recent EEG-to-image reconstruction methods rely on aligning EEG signals with pretrained visual embeddings to condition an image generator, we empirically demonstrate that stronger cross-modal alignment do not translate into comparable gains in reconstruction quality. This indicates that improving the input condition alone is insufficient; the generative process itself requires explicit supervision. Although Representation Alignment (REPA) offers a solution by guiding diffusion transformers with pretrained vision encoder features, we find that EEG-conditioned generators struggle to follow these fixed targets. To address this mismatch, we introduce generation-derived supervision (GDS): an image-conditioned teacher that translates static image-encoder features into the internal representation space of a diffusion transformer. Our EEG-conditioned student generator closely tracks these dynamic targets during denoising, discarding the teacher at inference. Evaluated on THINGS-EEG and THINGS-MEG, our approach consistently outperforms conditioning-centric baselines, achieving state-of-the-art reconstruction fidelity.
Sangmin Jo, Wootaek Jeong, Heung-Il Suk
Department of Artificial Intelligence, Korea University, Seoul, South Korea
Accurate visual decoding can reveal how the brain represents visual information and recover perceived content from neural signals such as electroencephalography (EEG), with potential for neural communication. However, current EEG-to-image retrieval methods perform far below their within-subject counterparts for new users without labeled calibration, limiting real-world deployment. To understand this gap, we analyze EEG features across subjects and find that different subjects preserve similar relationships among concepts but express them along different coordinate directions. We therefore propose Subject Coordinate Recovery (SCORE), a target label-free framework combining recovery-aware source training with coordinate alignment at deployment. During training, SCORE aligns source subject EEG with a common image space and simulates unseen-subject recovery through source-only episodes. At deployment, with both encoders frozen, SCORE selects reliable EEG-image landmarks through hubness-corrected matching and estimates an orthogonal transformation to recover target EEG coordinates without source data or target labels. In 200-way retrieval on two public benchmarks, SCORE outperforms the unadapted baseline for every target subject and achieves the best overall accuracy. It reaches 53.23%/83.55% and 12.01%/32.16% Top-1/Top-5 on THINGS-EEG2 and Alljoined-1.6M, respectively, surpassing the strongest baselines by 17.45/15.70 and 3.08/4.62 percentage points. Without target labels or encoder updates, SCORE brings brain-based visual decoding closer to robust, practical, low-latency deployment across users.
Zhenyao Cui, Siyuan Kan, Siyang Li +2
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China
Zero-shot EEG-to-image retrieval aims to decode perceived visual content from electroencephalography (EEG) by aligning neural responses with pretrained visual representations, providing a promising route toward scalable visual neural decoding and practical brain-computer interfaces. However, robust EEG-to-image retrieval remains challenging, because prior methods usually rely on either a single fixed visual target or a subject-invariant target construction scheme. Such designs overlook two important properties of visually evoked EEG signals: they preserve information across multiple representational scales, and the visual granularity best matched to EEG may vary across subjects. To address these issues, subject-aware multi-granularity alignment (SAMGA) framework is proposed for zero-shot EEG-to-image retrieval. SAMGA first constructs a subject-aware visual supervision target by adaptively aggregating multiple intermediate representations from a pretrained vision encoder, allowing the model to absorb subject-dependent granularity deviations during training while preserving subject-agnostic inference. Building on this adaptive target construction, a coarse-to-fine cross-modal alignment strategy is further designed with a shared encoder wherein the coarse stage stabilizes the shared semantic geometry and reduces subject-induced distribution shift, and the fine stage further improves instance-level retrieval discrimination. Extensive experiments on the THINGS-EEG benchmark demonstrate that the proposed method achieves 91.3% Top-1 and 98.8% Top-5 accuracy in the intra-subject setting, and 34.4% Top-1 and 64.8% Top-5 accuracy in the inter-subject setting, outperforming recent state-of-the-art methods.
Lin Jiang, Qingshan She, Jiale Xu +3
School of Automation, Hangzhou Dianzi University, and also with Zhejiang Provincial Key Laboratory of Brain Computer Collaborative Intelligence Technology and Applications, Hangzhou, Zhejiang 310018, China