cs.CVNov 15, 2026

EvoMem3D: Adaptive-Depth Temporal Representation Memory for Multi-Camera 3D Detection

Authors: Moshe Kimhi, Idan Kligvasser, Yotam Intrator, Regev Cohen, Ehud Rivlin

Organizations: Google Research

Abstract

Modern multi-camera 3D detectors increasingly rely on large Vision Transformer (ViT) image encoders, making repeated full-depth encoding a dominant inference cost even though adjacent driving frames are highly redundant. We present EvoMem3D, an adaptive-depth temporal framework that caches the most recent full-depth detector-interface appearance representation as a read-only anchor and combines it with policy-selected partial features from the current frame. A lightweight pre-encoding controller chooses among semantic encoder exits before image processing, allocating shallow computation to stable frames and deeper computation when the visual state changes. To reuse appearance without carrying stale geometry, we decouple temporal appearance from geometric alignment: current-frame calibration defines the decoder geometry at every timestamp, while a motion-conditioned positional adapter accounts for anchor-to-current ego motion. On nuScenes, EvoMem3D achieves 61.50 NDS and 52.76 mAP while reducing end-to-end latency from 364.4 to 168.7 ms (x2.16) relative to standard dense DETR3D. With StreamPETR, it reaches 61.36 NDS and 52.55 mAP at a x1.92 speedup. Controlled studies isolate the effects of current evidence, temporal reuse, memory correction, and adaptive routing, while our audit confirms that the policy learns to distinguish semantic driving regimes.

Figures & tables

Appendix figures & tables11 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. SToRe3D: Sparse Token Relevance in ViTs for Efficient Multi-View 3D Object Detection

    May 13, 2026Sandro Papais, Lezhou Feng, Charles Cossette +1Multi-View 3D Object DetectionToken Pruning

  2. PQR3D: Progressive Query Refinement over Reference-Conditioned Temporal Windows for Multi-View 3D Object Detection

    Sep 26, 2026Hui Ye, Yudong Liu, Yiran Chen +2Multi-View 3D Object Detection3D Object Detection

  3. Efficient Multi-View 3D Object Detection by Dynamic Token Selection and Fine-Tuning

    Apr 15, 2026Danish Nazir, Antoine Hanna-Asaad, Lucas Görnhardt +3Multi-View 3D Object Detection3D ViTs