cs.CVOct 30, 2026

Real-VAS: a Real-World Video Amodal Segmentation Dataset

Authors: Finlay G. C. Hudson, William A. P. Smith

Organizations: Department of Computer Science, University of York, York, United Kingdom

Abstract

Amodal video object segmentation is fundamentally limited by the absence of datasets that combine real-world complexity with precise ground-truth annotations. To address this, we present Real Video Amodal Segmentation (Real-VAS), a new large-scale, zero-shot evaluation dataset built from composited real-image video. We introduce a novel data generation pipeline that enables the creation of programmatically consistent amodal ground truth for real-world footage, in which the object mask, occlusion boundary, and composited image are all derived from a single unoccluded source, without relying on human estimation or expensive 3D reconstruction. Our dataset is structured into two challenging scenarios: dynamic Occlusion, created by compositing two clips of moving objects, and a unique Container category featuring complex, physically constrained interactions. These container scenarios--On Surface Containment, Articulated Containment, and Mobile Containment--allow us to generate precise ground truth by simulating an object's motion based on its container's tracked transformation. As a result, Real-VAS provides a diverse and challenging benchmark for evaluating amodal segmentation models on realistic video with the precision of synthetic data. The dataset and generation code are publicly available at https://finlay-hudson.github.io/real_vas

Figures & tables

Appendix figures & tables17 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. OccJEPA: Occlusion as Masking for Amodal Video Segmentation

    Oct 21, 2026Genpei Zhang, Runmin Jiang, Xingzu Zhan +3Amodal SegmentationVideo Object Segmentation

  2. Amodal SAM: A Unified Amodal Segmentation Framework with Generalization

    Apr 22, 2026Bo Zhang, Zhuotao Tian, Xin Tao +3Vision Foundation Model AdaptationAmodal Segmentation

  3. Show Me When and Where: Towards Referring Video Object Segmentation in the Wild

    Mar 15, 2026Mingqi Gao, Jinyu Yang, Jingnan Luo +4Multimodal TransformerReferring Video Object Segmentation