cs.CVAug 24, 2026

Primate vision reveals a missing principle for robust dynamic AI

Authors: Matteo Dunnhofer, Christian Micheloni, Kohitij Kar

Organizations: York University, Department of Biology and Centre for Vision Research, Toronto, Canada · Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy

Abstract

How does an intelligent visual system combine what objects look like with how they move while remaining robust as appearance changes? We addressed this question by comparing human perception and neural activity in macaque inferior temporal cortex with representations from image- and video-based neural networks spanning recognition, segmentation, optic-flow processing and predictive world modeling. Temporal integration improved object representations, but most video recognition models generalized poorly when appearance was disrupted while motion structure was preserved. Humans and macaque IT remained robust. Notably, predictive world models combined strong cross-appearance generalization with the closest correspondence to IT, outperforming other video-modeling approaches in neural fidelity. Yet no model reproduced the cortical transformation from early appearance-dominated responses toward later appearance-invariant motion coding. These results identify progressive integration of motion into object representations as a principle of robust dynamic vision and implicate predictive learning as a promising route toward realizing this computation in artificial systems.

Explore similar work

CardsList
  1. Forecasting Motion in the Wild

    Apr 1, 2026Neerja Thakkar, Shiry Ginosar, Jacob Walker +3Trajectory PredictionMotion Representation Learning

  2. Self-Supervised Learning of Structured Dynamics from Videos

    Jul 23, 2026Lukas Knobel, Andrew Zisserman, Yuki M. AsanoVideo Representation LearningSelf-Supervised Visual Representation Learning

  3. GenMatter: Perceiving Physical Objects with Generative Matter Models

    Apr 24, 2026Eric Li, Arijit Dasgupta, Yoni Friedman +5Video Object SegmentationMotion Segmentation