A Bridge from Paste to Place: Physics-Guided One-Step Image Composition via Object-Scene Interaction
Organizations: Transsion
Abstract
Realistic image composition makes a pasted object appear naturally present in a scene while preserving the pasted layout and fine foreground and background details. Reference-based insertion methods preserve overall object identity but can alter pose and fine details, often at substantial computational cost. Foreground harmonization and shadow generation address individual aspects of this task, but neither alone ensures natural integration. An efficient, unified solution remains an open challenge, and large-scale, high-quality datasets and benchmarks for this task are lacking. To address these challenges, we introduce Paste2Place, an end-to-end, physics-guided flow-based model that learns a direct latent bridge from pasted inputs to realistic composites, guided by image-space corrections analytically derived from predicted physical components of object and scene appearance changes. To support training and evaluation, we introduce P2P-Data with 86K manually reviewed synthetic and real-scene training pairs, including dense physical annotations from our Blender rendering and validation pipeline for the synthetic subset. P2P-Bench combines paired compositions and manually pasted inputs from collected images into 1.5K examples for evaluating composition under user-chosen placements. Extensive qualitative and quantitative experiments demonstrate that Paste2Place achieves substantial advantages in image composition quality and inference speed across diverse scenarios.
Figures & tables
| Metric | MV-CoLight | OmniPaint | PS-Diffusion | DreamFuse | AnyDoor | DIRECT | SHINE | Insert Anything | Qwen-Image | Seedream | Nano Banana | Ours |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PSNR | 24.35 | 21.67 | 21.27 | 23.70 | 20.43 | 22.01 | 20.24 | 21.84 | 22.32 | 22.11 | 23.03 | 30.83 |
| SSIM | 0.9376 | 0.8672 | 0.7830 | 0.9358 | 0.8262 | 0.9344 | 0.7900 | 0.9009 | 0.9261 | 0.9212 | 0.9290 | 0.9427 |
| LPIPS | 0.0686 | 0.1043 | 0.2108 | 0.0665 | 0.1618 | 0.0687 | 0.1859 | 0.0976 | 0.0678 | 0.0725 | 0.0687 | 0.0396 |
| fMSE | 3091.1 | 5744.9 | 3986.7 | 3640.7 | 6594.0 | 6700.9 | 6543.0 | 6026.6 | 5853.4 | 5773.6 | 4041.5 | 713.2 |
| Effect MAE | 0.1343 | 0.1344 | 0.1414 | 0.1571 | 0.1676 | 0.1687 | 0.1709 | 0.1722 | 0.1433 | 0.1504 | 0.1374 | 0.0589 |
| Latency (s) | 1.289 | 20.415 | 16.795 | 41.518 | 8.500 | 70.257 | 115.424 | 22.661 | 15.677 | 65.619 | 27.559 | 0.743 |
| Setting | PSNR | SSIM | LPIPS | fMSE | Effect MAE |
|---|---|---|---|---|---|
| FLUX.2 9B (fine-tuned) | 24.33 | 0.8645 | 0.0742 | 1649.3 | 0.0980 |
| w/o physical branch | 28.58 | 0.9265 | 0.0493 | 841.9 | 0.0725 |
| Spatially shifted guidance | 28.20 | 0.9298 | 0.0584 | 905.6 | 0.0801 |
| Ours | 30.83 | 0.9427 | 0.0396 | 713.2 | 0.0589 |
Compositional Image Generation
Compositional image generation studies how to combine objects, attributes, spatial relations, and visual references into coherent, controllable images.
See all 95 papers