Object Insertion
Object insertion, the task of seamlessly adding objects into images or 3D scenes, aims to create realistic and visually consistent composite results. Current research heavily utilizes diffusion models, often coupled with techniques like ControlNet for fine-grained control and inverse rendering for physically accurate lighting and shadow integration. These advancements are improving the quality and realism of object insertion across various modalities, from 2D images and videos to 3D neural radiance fields. This work has significant implications for applications such as augmented reality, image editing, and data augmentation for computer vision tasks.
Papers
SmartMask: Context Aware High-Fidelity Mask Generation for Fine-grained Object Insertion and Layout Control
Jaskirat Singh, Jianming Zhang, Qing Liu, Cameron Smith, Zhe Lin, Liang Zheng
3D Copy-Paste: Physically Plausible Object Insertion for Monocular 3D Detection
Yunhao Ge, Hong-Xing Yu, Cheng Zhao, Yuliang Guo, Xinyu Huang, Liu Ren, Laurent Itti, Jiajun Wu