cs.CVNov 9, 2026

Towards Reconstructing and Recognizing Objects behind Fragmented Occlusion using Video

Authors: Roman Pflugfelder, Michael Lindenbaum, Daniel Cremers

Organizations: Austrian Institute of Technology Digital Safety & Security Department · Technical University of Munich School of Computation, Information and Technology Munich Center for Machine Learning (MCML) · Technion Faculty of Computer Science

Abstract

Perceiving objects through fragmented occlusions, such as foliage, is a natural capability of the human visual system but remains a fundamental challenge for computer vision. This work addresses the problem of object reconstruction, or de-occlusion, in the presence of high-density, fragmented occlusions. We propose a reconstruction framework that operates on a sequence of grayscale images of a moving object, acquired by a single camera, either stationary or in motion. The algorithm estimates the object's relative positions across frames by jointly registering the images and optimizing the alignment parameters to maximize the contrast of their average, referred to as the integrated image. This integrated image serves as the reconstructed representation of the object. Experimental evaluations on both synthetic and real video sequences demonstrate the feasibility of accurate reconstruction under occlusion densities exceeding 90%. The proposed approach is competitive with synthetic aperture techniques, which are limited to static objects and require complex camera setup with careful calibration. Furthermore, we show that the integrated image enables reliable object classification under severe occlusion when used as input to standard, off-the-shelf classifiers.

Figures & tables

Explore similar work

CardsList
  1. Open-World Scene Deocclusion

    Nov 13, 2026K. M. S. J. Kumarasinghe, Neil A. Dodgson, Fang-Lue Zhang

  2. OASIC: Occlusion-Agnostic and Severity-Informed Classification

    Apr 5, 2026Kay Gijzen, Gertjan J. Burghouts, Daniël M. PeltImage ClassificationOcclusion Reasoning

  3. OCH3R: Object-Centric Holistic 3D Reconstruction

    May 13, 2026Yi Du, Yang You, Xiang Wan +1Object-Centric 3D Reconstruction3D ViTs