fMRI to Image

fMRI-to-image research aims to reconstruct visual stimuli or mental imagery from brain activity measured using functional magnetic resonance imaging (fMRI). Current approaches leverage powerful generative models, such as Latent Diffusion Models, often incorporating multimodal guidance (text, visual cues, layout) and contrastive learning techniques to improve reconstruction accuracy and detail, particularly for dynamic visual information. This field is significant for advancing our understanding of visual processing in the brain and holds potential applications in brain-computer interfaces and other areas requiring non-invasive decoding of visual information.

Papers