cs.CVJul 13, 2026

Parallax Portrait Matting

Authors: Xin CaiJiawen ChenLars JebeTianfan XueZhoutong Zhang

Organizations: Multimedia Laboratory, The Chinese University of Hong Kong, Hong Kong SAR, China · Shanghai AI Laboratory, Shanghai, China · Adobe NextCam, San Jose, CA, USA · CPII under InnoHK, Hong Kong SAR, China

Abstract

Image matting is highly ill-posed, especially when both the foreground and background are richly textured. While single-image matting methods learn strong priors from data, they often struggle on these challenging cases. Existing approaches improve results by requiring additional signals such as green screens, polarized lighting, or clean background images, but these typically rely on specialized capture setups. We present Parallax Portrait Matting, a practical two-frame matting method that uses a second image captured with slight viewpoint change. Such a setting arises naturally in burst photography, where small camera motion induces foreground-background parallax and provides complementary observations for matting. Our pipeline estimates trimaps and foreground/background motion, then constructs aligned views for prediction. To handle imperfect motion estimation, the network uses the background-aligned pair for direct fusion and the foreground-aligned cue through cross-attention for error compensation. Experiments show that our method recovers finer details and more accurate foreground colors than strong single-image matting baselines on challenging portrait cases.

Explore similar work

CardsList
  1. Self-supervised Automatic Matting

    Jul 11, 2026Xiaonan Hu, Zhiyuan Lu, Jingdong Zhao +1Self-SupervisedImage Processing