cs.CVOct 12, 2026

IMPULSE: Push First, Then Predict in V-JEPA 2 Feature Space

Authors: Tingan Jin, Chung-Hsien Chou

Organizations: University of California, Los Angeles, Los Angeles, CA, USA

Abstract

Latent world models such as V-JEPA 2 forecast in the feature space of a video encoder, but one look at an object does not reveal how hard it is to rotate, how much it bounces or how much it slides. People find out by trying: a few pokes reveal how an object responds. IMPULSE, named after the impulse response it infers, gives a predictor in frozen V-JEPA 2 feature space the same ability. A Bayesian contact memory summarizes three short calibration pushes, a predicted object pose carries it into the predictor, and a lightweight random-Fourier pose head lets the predictor use the pose. On 512 fresh objects, in a pre-specified held-out confirmation with models sealed before the data existed, the memory lowers the 1-second feature-forecast error by 11.6-12.8% relative to the same predictor without experience, for all 8 training seeds, with a 95% seed-and-object interval excluding zero. The gain also holds for 128 objects with out-of-range physics (11.7-14.0%), and the full extension beats a plain predictor by 15.5-16.6%. An information-ladder argument, exact for ideal predictors, shows that physics reaches the features only through motion, so we measure how much the pathway lets pose help. On fresh objects, the Fourier head roughly triples the gain of a perfect memory over plain pose tokens (2.8-3.2 times). Raw push measurements fed through the same pathway give a similar gain, so the Bayesian summary is not required; it condenses the trials into eight interpretable numbers. The gain is absent at contact onset and grows afterwards.

Figures & tables

Explore similar work

CardsList
  1. Frozen in a Frame: The Velocity Blind Spot in JEPA World Models

    Oct 3, 2026Tinghe Zhang, Chunyu Liu, Yu Leon Liu +6World Model LearningJoint-Embedding Predictive Architecture

  2. When Does Latent Prediction Error Support Physical Surprise Claims in Video World Models?

    Nov 1, 2026Anton Hristov, Aleksandar Slavov, Vasil VasilevVideo World ModelsWorld Model Evaluation

  3. Tracking Is Not Permanence: What Video World Models Keep of a Hidden Object

    Oct 5, 2026Peng Xie, Amr AlanwarTemporal ConsistencyObject Permanence