cs.CVNov 16, 2026

Déjà-Events: Multi-view 3D Geometry with Event Cameras via Sparsity-Aware Adaptive Gating

Authors: Arda Cinar Demirtas, Pablo Varela Bernal, Marc Pollefeys, Sunghwan Hong

Organizations: ETH Zürich · TU Delft

Abstract

Event cameras keep capturing structure where conventional cameras blur or saturate, which makes them attractive for 3D perception in fast or poorly lit scenes. Event datasets with dense 3D ground truth, however, are far smaller and less diverse than the image collections behind feed-forward 3D reconstruction models. We present Déjà-Events, an event-only model that predicts depth, camera pose and pointmaps from multiple views in a single forward pass. Rather than relying on scarce 3D labels, we distil it from Déjà View, a feed-forward RGB model that refines its tokens by repeatedly applying one shared transformer block. On paired RGB and event recordings, the event student learns to reproduce the frozen teacher's final tokens, which requires no depth or pose ground truth and trains only about 1% of its parameters. Because events are dense at edges and moving texture but nearly absent in textureless regions, we further introduce sparsity-aware adaptive gating, which adapts the shared block's gates to events and adjusts them per patch by event density, so that accuracy holds as refinement steps are added. Trained only on simulated data, Déjà-Events achieves the lowest pointmap error among the event-based methods we evaluate, on EventScape and zero-shot on the real MVSEC and DSEC datasets. On DSEC it halves the error of the strongest baseline (0.15 vs. 0.30 AbsRel) with about a tenth of its parameters. It also has the lowest depth error on EventScape and DSEC and the lowest trajectory error on EventScape.

Figures & tables

Explore similar work

CardsList
  1. EventVGGT: Exploring Cross-Modal Distillation for Consistent Event-based Depth Estimation

    Mar 10, 2026Yinrui Ren, Jinjing Zhu, Kanghao Chen +8Event-Based VisionDepth Estimation

  2. Event3R: Asynchronous-to-Global 3D Reconstruction from Event Camera via Spatial-Temporal Feature Aggregation

    Jul 17, 2026Jian Huang, Haotian Shen, Xinhao Lou +3Event-Based Vision3D Reconstruction

  3. eSharp: Diffusion-based Sharp Monocular Metric Event-to-Depth Estimation

    Nov 5, 2026Qiushi Dai, Aniket Dashpute, Yuhao Liu +3Depth EstimationMetric Depth Estimation