cs.CVNov 1, 2026

Text-Assisted Event Stream Visual Place Recognition via Multi-Scale Spatiotemporal Optimal Transport

Authors: Lan Chen, Xingxing Xiong, Xiao Wang, Ziyan Zhang, Zikang Yan, Yuanhao Zheng, Bo Jiang, Yonghong Tian

Organizations: School of Electronic and Information Engineering, Anhui University, Hefei, China · School of Computer Science and Technology, Anhui University, Hefei, China · School of Computer Science, Peking University, Beijing, China

Abstract

Benefiting from the high dynamic range, high temporal resolution, and low energy consumption of event cameras, low-altitude economic research leveraging event cameras has become a popular topic. Several existing attempts introduce natural-language descriptions into visual place recognition (VPR) to mitigate the sparsity of structural spatial information inherent to event cameras. Nevertheless, these methods still fail to fully address two core challenges: effectively encoding event streams and semantically aligning event streams with text. In this paper, we propose a multi-scale spatial-temporal optimal transport approach, MSTOT-EPR, to address these challenges. Specifically, given event streams and scene text information, we first adopt a visual encoder and a text encoder to extract respective feature representations. We then apply optimal-transport constraints to achieve cross-modal alignment. We then design a cross-modal bottleneck fusion module to further fuse bimodal features. Furthermore, we develop multi-scale spatial optimal transport and inter-frame temporal optimal transport modules to mine high-quality spatial-temporal event features for scene recognition. Extensive experiments on the NYC-Event-VPR and EPRBench datasets fully validate the effectiveness of our proposed framework for event-based VPR. The source code of this paper will be released upon acceptance.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. EventGeM: Global-to-Local Feature Matching for Event-Based Visual Place Recognition

    Mar 6, 2026Adam D. Hines, Gokul B. Nair, Nicolás Marticorena +2Visual Place RecognitionEvent-Based Vision

  2. REALM: An RGB- and Event-Aligned Latent Manifold for Cross-Modal Perception

    Apr 30, 2026Vincenzo Polizzi, David B. Lindell, Jonathan KellyMultimodal Foundation ModelsEvent-Based Vision

  3. Multi-viewpoint Geo-localization with Event Cameras

    Sep 18, 2026Adam D. Hines, Michael Milford, Tobias FischerVisual Place RecognitionEvent-Based Vision