fMRI-Based Visual Decoding

Follow this topic Ask about this topic

Latest papers

23 papers1 paper in the last four weeks, with none the four weeks before. 0.0% of all new papers.

Neurons++: A Unified Visual-Stream Framework for Image and Video Reconstruction from fMRI with Neural-to-Visual Interpretability
Oct 9, 2026Haonan Wang, Yuchen Wang, Jingyu Lu +4fMRI-Based Visual Decoding Neural Decoding
The Hong Kong University of Science and Technology · Shenzhen Loop Area Institute, Shenzhen, China
From "What-If" to "What-Is": Counterfactual Thinking-Inspired Semantic Alignment for Visual Brain Decoding
Aug 15, 2026Kaitao Yan, Chi Liu, Congcong Zhu +5Neural Decoding fMRI-Based Visual Decoding
Faculty of Data Science, City University of Macau · Zhongshan Ophthalmic Center, Sun Yat-sen University
fMRI2Face: A Full-HD fMRI-Video Dataset and Geometry-Guided Neural Decoding Framework for Dynamic Human Face Reconstruction
Jul 24, 2026Jingyang Huo, Xiangru Huang, Chentao Shen +6Video Diffusion Models Neural Decoding
Fudan University, 220 Handan Road, Yangpu District, Shanghai, 200433, China · Westlake University, No. 18 Shilongshan Road, Xihu District, Hangzhou, 310024, Zhejiang, China · Zhejiang University, No. 866 Yuhangtang Road, Xihu District, Hangzhou, 310058, Zhejiang, China +2
Real-time Reconstruction of Human Visual Perception from fMRI
Jul 23, 2026Rishab S. Iyer, Jiaxin Cindy Tu, Cesar Kadir Torrico Villanueva +10Neural Decoding Image Reconstruction
Princeton University · Medical AI Research Center (MedARC) · Dartmouth College +4
Spiking Neural Networks for fMRI-Based Visual Semantic Decoding
Jul 21, 2026Jiahong Zhang, Jinning Zhao, Sijun Shen +3Visual Representation Learning Neural Decoding
Institute of Automation, Chinese Academy of Sciences, Beijing 100045, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China · State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China
Rethinking Brain Decoding with CLIP: The Role of Adversarial Robustness
Jul 3, 2026Byeongseo Bok, Futa Waseda, Jun Liu +1Neural Decoding Adversarial Robustness
The Graduate University for Advanced Studies (SOKENDAI), Kanagawa, Japan · National Institute of Informatics, Tokyo, Japan · The University of Tokyo, Tokyo, Japan
Boosting Brain-to-Image Decoding with TRIBE v2 Data Augmentation
Jun 4, 2026Yohann Benchetrit, Marlène Careil, Simon Dahan +3Synthetic Data Augmentation Neural Decoding
Meta AI
Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction
Jun 3, 2026Hoang-Son Vo, Van-Hung Bui, Minh-Huy Mai-Duc +2Hierarchical Representation Learning Visual SSMs
Chonnam National University, Gwangju, Republic of Korea · Vietnam National University - Ho Chi Minh City, University of Science, Vietnam · Institute for Cybersecurity and Digital Technologies, Russia
Brain-IT-VQA: From Brain Signals to Answers
May 28, 2026Roman Beliy, Matias Cosarinsky, Oliver Heinimann +2Visual Question Answering Neural Decoding
Weizmann Institute of Science
NeurIPS: Neuro-anatomical Inductive Priors for Sphere-based Brain Decoding
May 24, 2026Sijin Yu, Zijiao Chen, Zhenyu Yang +7Mixture of Experts Neural Decoding
South China University of Technology · Stanford University · King’s College London +2
MindAdapter: Few-Shot Parameter-Efficient Residual Calibration of Cross-Subject Brain-to-Visual Decoding Models
May 23, 2026Jiaxiang Liu, Jiawei Du, Xupeng Chen +4Neural Decoding Cross-Modal Alignment
Guangdong Institute of Intelligence Science and Technology Hengqin, China · Agency for Science, Technology and Research Singapore · New York University Brooklyn, US +2
FPED: A Functional-Network Prior-Guided Mixture-of-Experts Framework for Interpretable Brain Decoding
May 19, 2026Yudan Ren, Pengcheng Shi, Zihan Ma +2Neural Decoding Mixture-of-Experts Inference
School of Electronic Information (School of Artificial Intelligence), Northwest University, Xi’an 710127, China
MIRAGE: Robust multi-modal architectures translate fMRI-to-image models from vision to mental imagery
May 16, 2026Reese Kneeland, Cesar Kadir Torrico Villanueva, Jordyn Ojeda +4Neural Decoding Image Reconstruction
University of Minnesota, Minneapolis, Minnesota, United States of America · Medical AI Research Center (MedARC) · Stanford University, Palo Alto, California, United States of America +2
StableMind: Source-Free Cross-Subject fMRI Decoding with Regularized Adaptation
May 4, 2026Jintao Guo, Lin Wang, Shumeng Li +5Source-Free Domain Adaptation Neural Decoding
National Key Laboratory for Novel Software Technology and the Institute of Brain-Machine Interface, Nanjing University, Nanjing 210023, China · School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798 · School of Intelligence Science and Technology, Nanjing University, Nanjing 215163, China +2
Seeing the imagined: latent functional alignment in visual imagery decoding from fMRI data
Apr 15, 2026Fabrizio Spera, Tommaso Boccato, Michal Olak +2Neural Decoding Visual Neuroscience
Department of Biomedicine and Prevention, University of Rome Tor Vergata, Rome, Italy · Tether Evo · A.A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, USA
Brain-Grasp: Graph-based Saliency Priors for Improved fMRI-based Visual Brain Decoding
Apr 12, 2026Mohammad Moradi, Morteza Moradi, Marco Grassia +1fMRI-Based Visual Decoding Neural Decoding
University of Catania, Catania, Italy
Meta-learning In-Context Enables Training-Free Cross Subject Brain Decoding
Apr 9, 2026Mu Nan, Muquan Yu, Weijian Mai +12fMRI-Based Visual Decoding Neural Decoding
University of Hong Kong · Shenzhen Loop Area Institute · Chinese University of Hong Kong +5
Decoding Functional Networks for Visual Categories via GNNs
Mar 30, 2026Shira Karmi, Galia Avidan, Tammy Riklin RavivVisual Neuroscience fMRI-Based Visual Decoding
The School of Electrical and Computer Engineering, Ben-Gurion University of the Negev · The School of Brain Sciences and Cognition, Ben-Gurion University of the Negev · Psychology Department, Ben-Gurion University of the Negev
Statistical Learning for Latent Embedding Alignment with Application to Brain Encoding and Decoding
Mar 22, 2026Shuoxun Xu, Zhanhao Yan, Lexin LiLatent Space Alignment Neural Decoding
University of California at Berkeley
Duala: Dual-Level Alignment of Subjects and Stimuli for Cross-Subject fMRI Decoding
Mar 8, 2026Shumeng Li, Jintao Guo, Jian Zhang +3fMRI-Based Visual Decoding Neural Decoding
State Key Laboratory of Novel Software Technology, Nanjing University · Institute of Brain-Machine Interface, Nanjing University
SemVideo: Reconstructs What You Watch from Brain Activity via Hierarchical Semantic Guidance
Feb 25, 2026Minghan Yang, Lan Yang, Ke Li +3fMRI-Based Visual Decoding Neural Decoding
Beijing University of Posts and Telecommunications · University of Surrey
Neuro-Symbolic Decoding of Neural Activity
Feb 22, 2026Yanchen Wang, Joy Hsu, Ehsan Adeli +1Neural Decoding fMRI-Based Visual Decoding
Columbia University · Stanford University
Hi-DREAM: Brain-Inspired Hierarchical Diffusion for fMRI-to-Image Reconstruction via ROI Encoder and VisuAl Mapping
Nov 14, 2025Guowei Zhang, Yun Zhao, Kai Sun +4Visual Neuroscience Conditional Image Generation
Dept of Data Science and AI, Monash University, Melbourne, Australia · Brain and Mind Centre, University of Sydney, Sydney, Australia · School of Psychological Sciences, Monash University, Melbourne, Australia

Oct 9, 2026J/K move · Enter open · S save

Neurons++: A Unified Visual-Stream Framework for Image and Video Reconstruction from fMRI with Neural-to-Visual Interpretability

Haonan Wang, Yuchen Wang, Jingyu Lu, Qixiang Zhang+3

The Hong Kong University of Science and Technology · Shenzhen Loop Area Institute, Shenzhen, China

fMRI-Based Visual Decoding Neural Decoding Image Reconstruction Neuroimaging Visual Neuroscience

Open paper AskPDF arXiv

Decoding visual experience from fMRI is important for understanding human perception and developing brain-computer interfaces. Recent generative decoding methods can reconstruct plausible images and videos, but visual plausibility alone does not ensure that the output is faithfully grounded in brain activity. In this work, we propose Neurons++, a visual-stream fMRI reconstruction framework for both static image and dynamic video reconstruction. Compared with our conference version Neurons, Neurons++ extends the paradigm from video-only reconstruction to visual-stream reconstruction for both images and videos, and replaces parallel task conditioning with serial cortex-inspired decoding. The model first uses image-fMRI pretraining to obtain a stable spatial-semantic initialization, and then performs subject-specific fine-tuning for image and video reconstruction separately. The serial design organizes fMRI-derived representations into explicit spatial, semantic, language-level, and temporal cues. Extensive experiments show that Neurons++ achieves state-of-the-art video reconstruction and competitive image reconstruction across standard benchmarks. Beyond reconstruction fidelity, neural-to-visual analyses indicate that Neurons++ exhibits qualitative directional controllability under neural perturbation, that its fMRI encoder read-out is sensitive to stimulus-relevant cortical features, and that it supports ROI-guided semantic modulation. Code and model weights are available at: https://github.com/xmed-lab/NeuronsPlusPlus.