cs.CVOct 30, 2026

TAP-Out: Tracking Any Point in 360° via Outpainting

Authors: Finlay G. C. Hudson, James A. D. Gardner, William A. P. Smith

Organizations: Department of Computer Science, University of York, York, United Kingdom

Abstract

Tracking points that leave the camera's field of view (FoV) requires reasoning about unobserved scene dynamics, a fundamentally different problem from tracking visible correspondences. We present TAP-Out, an offline method that makes this out-of-view (OOV) reasoning explicit by leveraging generative video outpainting as a world-model prior. Given a narrow-FoV input video, TAP-Out outpaints a complete 360° equirectangular video, locates target objects within the panoramic scene via video object segmentation, and synthesises object-centred perspective crops on which standard in-frame trackers operate. This decoupled design composes off-the-shelf foundation models without requiring task-specific architectural modifications. On the TAPVid360 benchmark, TAP-Out achieves state-of-the-art performance, improving OOV tracking accuracy by approximately 3x over the best prior method. We demonstrate its flexibility on out-of-frame object segmentation and detection and we provide detailed diagnostic analyses across motion regimes, static versus dynamic content, and hallucination quality, characterising when and why the approach succeeds or fails. Code is publicly available at https://github.com/finlay-hudson/TAP-Out

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views

    Sep 1, 2026Skanda Koppula, Frano Rajic, Abdullah Faiz Ur Rahman +9Point Tracking3D Point Tracking

  2. 4DGS360: 360° Gaussian Reconstruction of Dynamic Objects from a Single Video

    Mar 23, 2026Jae Won Jang, Yeonjin Chang, Wonsik Shin +2Dynamic Scene ReconstructionPanoramic 3D Reconstruction

  3. Seen-to-Scene: Keep the Seen, Generate the Unseen for Video Outpainting

    Apr 16, 2026Inseok Jeon, Minhyeok Lee, Seunghoon Lee +3Video OutpaintingTemporal Consistency in Video Generation