fMRI-Based Visual Decoding

Latest papers

29 papers4 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

BrainBind: Bridging Synchronized EEG and fMRI through Long-Form Naturalistic Video Representations
Nov 3, 2026Shixiao Wang, Rining Wu, Jian K. LiuCross-Modal Alignment fMRI-Based Visual Decoding
School of Computer Science, Center for Human Brain Health, University of Birmingham, UK · School of Computer Science, University of Leeds, UK
AVID: A 5T fMRI Dataset for Benchmarking Auditory-induced Visual Mental Imagery Decoding
Nov 2, 2026Shiqi Shen, Shurui Li, Xilin Zhang +1fMRI-Based Visual Decoding Neural Decoding
ShanghaiTech University · South China Normal University · XS Vision
Latent Prediction Yields Cross-Subject Alignable Representations in Sensory-Evoked fMRI
Oct 29, 2026Serwan Jassim, Victoria Bosch, Daniel Anthes +2fMRI Representation Learning fMRI-Based Visual Decoding
Institute of Cognitive Science University of Osnabrück
DRAFT: Decoding and Reconstructing 3D Room Layouts from fMRI and Camera Trajectories
Oct 22, 2026Chi-Wei Lee, An-Kai Chen, Cheng-Han Chiang +23D Reconstruction Indoor Scene Reconstruction
National Tsing Hua University · National Yang Ming Chiao Tung University
Neurons++: A Unified Visual-Stream Framework for Image and Video Reconstruction from fMRI with Neural-to-Visual Interpretability
Oct 9, 2026Haonan Wang, Yuchen Wang, Jingyu Lu +4fMRI-Based Visual Decoding Neural Decoding
The Hong Kong University of Science and Technology · Shenzhen Loop Area Institute, Shenzhen, China
From "What-If" to "What-Is": Counterfactual Thinking-Inspired Semantic Alignment for Visual Brain Decoding
Aug 15, 2026Kaitao Yan, Chi Liu, Congcong Zhu +5Neural Decoding fMRI-Based Visual Decoding
Faculty of Data Science, City University of Macau · Zhongshan Ophthalmic Center, Sun Yat-sen University
fMRI2Face: A Full-HD fMRI-Video Dataset and Geometry-Guided Neural Decoding Framework for Dynamic Human Face Reconstruction
Jul 24, 2026Jingyang Huo, Xiangru Huang, Chentao Shen +6Video Diffusion Models Neural Decoding
Fudan University, 220 Handan Road, Yangpu District, Shanghai, 200433, China · Westlake University, No. 18 Shilongshan Road, Xihu District, Hangzhou, 310024, Zhejiang, China · Zhejiang University, No. 866 Yuhangtang Road, Xihu District, Hangzhou, 310058, Zhejiang, China +2
Real-time Reconstruction of Human Visual Perception from fMRI
Jul 23, 2026Rishab S. Iyer, Jiaxin Cindy Tu, Cesar Kadir Torrico Villanueva +10Neural Decoding Image Reconstruction
Princeton University · Medical AI Research Center (MedARC) · Dartmouth College +4
Spiking Neural Networks for fMRI-Based Visual Semantic Decoding
Jul 21, 2026Jiahong Zhang, Jinning Zhao, Sijun Shen +3Visual Representation Learning Neural Decoding
Institute of Automation, Chinese Academy of Sciences, Beijing 100045, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China · State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China
Rethinking Brain Decoding with CLIP: The Role of Adversarial Robustness
Jul 3, 2026Byeongseo Bok, Futa Waseda, Jun Liu +1Neural Decoding Adversarial Robustness
The Graduate University for Advanced Studies (SOKENDAI), Kanagawa, Japan · National Institute of Informatics, Tokyo, Japan · The University of Tokyo, Tokyo, Japan
Boosting Brain-to-Image Decoding with TRIBE v2 Data Augmentation
Jun 4, 2026Yohann Benchetrit, Marlène Careil, Simon Dahan +3Synthetic Data Augmentation Neural Decoding
Meta AI
Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction
Jun 3, 2026Hoang-Son Vo, Van-Hung Bui, Minh-Huy Mai-Duc +2Visual Neuroscience Hierarchical Representation Learning
Chonnam National University, Gwangju, Republic of Korea · Vietnam National University - Ho Chi Minh City, University of Science, Vietnam · Institute for Cybersecurity and Digital Technologies, Russia
Brain-IT-VQA: From Brain Signals to Answers
May 28, 2026Roman Beliy, Matias Cosarinsky, Oliver Heinimann +2Visual Question Answering Neural Decoding
Weizmann Institute of Science
NeurIPS: Neuro-anatomical Inductive Priors for Sphere-based Brain Decoding
May 24, 2026Sijin Yu, Zijiao Chen, Zhenyu Yang +7Mixture of Experts Neural Decoding
South China University of Technology · Stanford University · King’s College London +2
MindAdapter: Few-Shot Parameter-Efficient Residual Calibration of Cross-Subject Brain-to-Visual Decoding Models
May 23, 2026Jiaxiang Liu, Jiawei Du, Xupeng Chen +4Neural Decoding Cross-Modal Alignment
Guangdong Institute of Intelligence Science and Technology Hengqin, China · Agency for Science, Technology and Research Singapore · New York University Brooklyn, US +2
FPED: A Functional-Network Prior-Guided Mixture-of-Experts Framework for Interpretable Brain Decoding
May 19, 2026Yudan Ren, Pengcheng Shi, Zihan Ma +2Neural Decoding Mixture-of-Experts Inference
School of Electronic Information (School of Artificial Intelligence), Northwest University, Xi’an 710127, China
MIRAGE: Robust multi-modal architectures translate fMRI-to-image models from vision to mental imagery
May 16, 2026Reese Kneeland, Cesar Kadir Torrico Villanueva, Jordyn Ojeda +4Neural Decoding Image Reconstruction
University of Minnesota, Minneapolis, Minnesota, United States of America · Medical AI Research Center (MedARC) · Stanford University, Palo Alto, California, United States of America +2
StableMind: Source-Free Cross-Subject fMRI Decoding with Regularized Adaptation
May 4, 2026Jintao Guo, Lin Wang, Shumeng Li +5Source-Free Domain Adaptation Neural Decoding
National Key Laboratory for Novel Software Technology and the Institute of Brain-Machine Interface, Nanjing University, Nanjing 210023, China · School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798 · School of Intelligence Science and Technology, Nanjing University, Nanjing 215163, China +2
Seeing the imagined: latent functional alignment in visual imagery decoding from fMRI data
Apr 15, 2026Fabrizio Spera, Tommaso Boccato, Michal Olak +2Neural Decoding Visual Neuroscience
Department of Biomedicine and Prevention, University of Rome Tor Vergata, Rome, Italy · Tether Evo · A.A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, USA
Brain-Grasp: Graph-based Saliency Priors for Improved fMRI-based Visual Brain Decoding
Apr 12, 2026Mohammad Moradi, Morteza Moradi, Marco Grassia +1fMRI-Based Visual Decoding Neural Decoding
University of Catania, Catania, Italy
Meta-learning In-Context Enables Training-Free Cross Subject Brain Decoding
Apr 9, 2026Mu Nan, Muquan Yu, Weijian Mai +12fMRI-Based Visual Decoding Neural Decoding
University of Hong Kong · Shenzhen Loop Area Institute · Chinese University of Hong Kong +5
Decoding Functional Networks for Visual Categories via GNNs
Mar 30, 2026Shira Karmi, Galia Avidan, Tammy Riklin RavivVisual Neuroscience fMRI-Based Visual Decoding
The School of Electrical and Computer Engineering, Ben-Gurion University of the Negev · The School of Brain Sciences and Cognition, Ben-Gurion University of the Negev · Psychology Department, Ben-Gurion University of the Negev
Statistical Learning for Latent Embedding Alignment with Application to Brain Encoding and Decoding
Mar 22, 2026Shuoxun Xu, Zhanhao Yan, Lexin LiLatent Space Alignment Neural Decoding
University of California at Berkeley
Duala: Dual-Level Alignment of Subjects and Stimuli for Cross-Subject fMRI Decoding
Mar 8, 2026Shumeng Li, Jintao Guo, Jian Zhang +3fMRI-Based Visual Decoding Neural Decoding
State Key Laboratory of Novel Software Technology, Nanjing University · Institute of Brain-Machine Interface, Nanjing University
SemVideo: Reconstructs What You Watch from Brain Activity via Hierarchical Semantic Guidance
Feb 25, 2026Minghan Yang, Lan Yang, Ke Li +3fMRI-Based Visual Decoding Neural Decoding
Beijing University of Posts and Telecommunications · University of Surrey
Neuro-Symbolic Decoding of Neural Activity
Feb 22, 2026Yanchen Wang, Joy Hsu, Ehsan Adeli +1Neural Decoding fMRI-Based Visual Decoding
Columbia University · Stanford University
Hi-DREAM: Brain-Inspired Hierarchical Diffusion for fMRI-to-Image Reconstruction via ROI Encoder and VisuAl Mapping
Nov 14, 2025Guowei Zhang, Yun Zhao, Kai Sun +4Visual Neuroscience Conditional Image Generation
Dept of Data Science and AI, Monash University, Melbourne, Australia · Brain and Mind Centre, University of Sydney, Sydney, Australia · School of Psychological Sciences, Monash University, Melbourne, Australia
Align, Then Adapt: Few-Shot fMRI Visual Reconstruction For New Subjects
May 3, 2025Christos Zangos, Danish Ebadulla, Thomas Christopher Sprague +1fMRI-Based Visual Decoding fMRI Representation Learning
Department of Computer Science, University of California, Santa Barbara, USA · Department of Psychological and Brain Sciences, University of California, Santa Barbara, USA
MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Data
Mar 17, 2024Paul S. Scotti, Mihir Tripathy, Cesar Kadir Torrico Villanueva +8Image Reconstruction fMRI-Based Visual Decoding
Stability AI · Medical AI Research Center (MedARC) · Princeton Neuroscience Institute +3

Nov 3, 2026J/K move · Enter open · S save

BrainBind: Bridging Synchronized EEG and fMRI through Long-Form Naturalistic Video Representations

Shixiao Wang, Rining Wu, Jian K. Liu

School of Computer Science, Center for Human Brain Health, University of Birmingham, UK · School of Computer Science, University of Leeds, UK

Cross-Modal Alignment fMRI-Based Visual Decoding Neuroimaging EEG-Based Visual Decoding

Open paper AskPDF arXiv

Real-world vision is dynamic and scene-rich, while EEG and fMRI resolve it at complementary temporal and spatial scales. Most neural decoding systems, however, align one modality in isolation and mostly against static images or short clips. We study the synchronized case: EEG and fMRI are recorded during the same long-form naturalistic viewing, giving a shared stimulus but also recurring narrative context and many semantically similar candidates. We present BrainBind, a framework that maps synchronized EEG and fMRI into frozen long-form video embedding spaces and treats those spaces as common visual-semantic references, not literal neural codes. On CineBrain, a five-seed Recall@K 2 x 4 matrix across two video anchors and four system configurations shows distinct retrieval profiles. With Omni, fMRI organizes the full candidate list most strongly (MRR = 23.82, nDCG@10 = 25.31), while Joint-Dual gives the highest mean label-aware R@1 (13.52%) with a distinct rank-wide profile. The complementary episode-disjoint evaluation quantifies the contribution of repeated stimulus identity and narrative context to the random split. Across these experiments, proxy choice and system configuration produce distinct top-rank and rank-wide retrieval profiles within the present synchronized dataset. The code is available at https://github.com/Forainest789/Brainbind.