cs.CVMar 6, 2026

Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertion

Authors: Bohai Gu, Taiyi Wu, Dazhao Du, Jian Liu, Shuai Yang, Xiaotong Zhao, Alan Zhao, Song Guo

Organizations: The Hong Kong University of Science and Technology · AI Technology Center, Tencent Video, Tencent · Peking University

Abstract

Video object insertion is fundamental to video editing, yet existing diffusion methods often produce visually plausible but physically inconsistent results. We present Place-it-R1, an end-to-end framework for physically plausible video object insertion driven by environment-aware MLLM reasoning. Rather than treating reasoning as a generic text prompt, Place-it-R1 uses the MLLM to analyze the target environment, infer object-scene interactions, and determine where an insertion is physically valid. The resulting reasoning is translated into two complementary forms of guidance for video diffusion: semantic guidance that describes the intended physical interaction and spatial guidance that provides a valid insertion region in each frame. To further align generation with local physical realism, we introduce Spatial Direct Preference Optimization, which leverages an MLLM to rank generated candidates, and introduces a region-aware preference objective that explicitly localizes physical-violation penalties to the inserted-object region. Place-it-R1 further offers flexible and standard modes to trade off environment adaptation and scene preservation. Extensive experiments show that Place-it-R1 produces more physically coherent and visually natural insertions than state-of-the-art methods and achieves competitive results against commercial systems.

Figures & tables

Explore similar work

CardsList
  1. SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion

    May 22, 2026Xinyu Chen, Yuyi Qian, Jiang Lin +9Video Diffusion ModelsVideo Editing

  2. InsertAnywhere: Geometrically Grounded and Optics-Aware Video Object Insertion

    Dec 19, 2025Hoiyeong Jin, Hyojin Jang, Junha Hyung +6Video Diffusion ModelsVideo Editing