NeuroVolve: Evolving personalized visual stimuli toward user-defined brain response targets
Organizations: Cornell University · Cornell Tech · Weill Cornell Medicine
Abstract
A central question in neuroscience is what visual features drive brain responses across regions. Classic approaches rely on handcrafted stimuli to test specific hypotheses, limiting discovery to features defined before experiments. Here we introduce NeuroVolve, a data-driven generative framework for synthesizing images that achieve flexible, user-defined patterns of brain activation in individuals. NeuroVolve recovers established selectivity across visual cortical regions and, paired with subject-specific brain encoding models, generates personalized stimuli reflecting individual differences in neural preference. Beyond single-region selectivity, NeuroVolve uncovers multi-region response selectivity, characterizing how regions jointly represent visual content during naturalistic perception. We further demonstrate generalization beyond visual cortex: in a prospective fMRI experiment, NeuroVolve-generated stimuli targeting the amygdala, a classically non-sensory region, drove measured activation consistent with predictions in novel participants. Together, these results establish NeuroVolve as a less constrained, data-driven tool for probing individual-level neural selectivity across the brain.
Figures & tables
| Image set | FFA (face) | EBA (body) | PPA (scene) | mfs-words (text) |
|---|---|---|---|---|
| NeuroVolve top 100 (validation prediction) | ||||
| NSD top 100 (validation prediction) | ||||
| NSD top 100 (measured response) |
| Category | Prompts |
|---|---|
| Face | A face facing the camera; A photo of a face; A photo of a human face; A photo of faces; A photo of a person’s face; A person looking at the camera; People looking at the camera; A portrait of a person; A portrait photo |
| Body | A photo of a torso; A photo of torsos; A photo of limbs; A photo of bodies; A photo of a person; A photo of people |
| Scene | A photo of a bedroom; A photo of an office; A photo of a hallway; A photo of a doorway; A photo of interior design; A photo of a building; A photo of a house; A photo of nature; A photo of landscape; A landscape photo; A photo of trees; A photo of grass |
| Text | A photo of words; A photo of glyphs; A photo of a glyph; A photo of text; A photo of numbers; A photo of a letter; A photo of letters; A photo of writing; A photo of text on an object |
Visual Neuroscience
Visual neuroscience studies how retinal and brain circuits encode, interpret, and guide behavior from visual input.
See all 62 papers