cs.LGNov 7, 2026

EEGFaceSem: An EEG Benchmark with Paired Generative Latents for Semantic Visual Modeling

Authors: Jun Ma, Michiel M. Spapé, Keith M. Davis, Tuukka Ruotsalo

Organizations: University of Helsinki Helsinki, Finland · University of Macau Macau, China · LUT University Lahti, Finland · University of Copenhagen Copenhagen, Denmark

Abstract

Electroencephalography (EEG) is widely used to measure brain activity for brain-computer interface applications for its non-invasive nature and high temporal resolution. However, progress in modeling the neural responses to visual semantics has been limited by a reliance on fixed image collections that lack the fine-grained control needed to isolate fine-grained changes in visual features and their relation to perception. In this work, we present EEGFaceSem, a large-scale dataset pairing high-quality EEG with photorealistic face images synthesized from a generative model. We provide the generative latent vector for each stimulus, enabling research into the continuous mapping between a visual latent space and neural representations. Each participant's brain responses were recorded while they attended to specific semantic features (e.g., smiling, hair color) in a rapid serial visual presentation paradigm. The dataset contains EEG signals from 30 participants, totaling 67,200 time-locked EEG recordings. We present benchmarks for single-trial semantic classification under single-subject, cross-subject, and subject-adapted settings, as well as for cross-subject voting that aggregates per-stimulus predictions across participants. We further demonstrate the dataset's unique utility with two complementary applications: deriving semantic directions in the latent space for brain-supervised image editing, and conditioning a generative model on brain-decoded labels for brain-supervised image generation. Our dataset paves the way for advancing brain-computer interfaces (BCI) for semantic-level visual saliency detection and brain-supervised generative modeling. Our dataset and code are openly released at OSF (https://osf.io/2guk3/) and at HuggingFace https://huggingface.co/datasets/yefllower/EEGFaceSem.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. See the Emotion: A Facial Emoji Proxy Modeling for EEG Emotion Recognition

    Jul 3, 2026Jingjing Hu, Guo Dan, Haofan Cheng +4Facial Expression SynthesisMultimodal Model Interpretability

  2. SENSE: Efficient EEG-to-Text via Privacy-Preserving Semantic Retrieval

    Mar 17, 2026Akshaj Murhekar, Christina Liu, Abhijit Mishra +2EEG-to-Text DecodingEEG Decoding