Compositional Image Generation

Overview

The field aims to make image generators reliably follow instructions about what belongs in a scene, where it goes, how objects relate, and which details come from reference images. Approaches include layout- and graph-conditioned diffusion, spatial and occlusion controls, modular adapters and layered synthesis, and agentic planning with iterative generation and editing. Evaluation spans layout-to-image, multi-subject and multi-reference tasks, with benchmarks such as CogCanvas and TRACE-Bench probing identity, attribute binding, relations, and spatial accuracy. A central challenge is generalizing to unfamiliar combinations and crowded scenes: binding and identity errors grow with complexity, while stronger control must preserve image quality and remain efficient.

Latest papers

CardsList

85 papers11 papers in the last four weeks, up 120% on the four weeks before. 0.1% of all new papers.

  1. Scaling Transformer Energy-based Models For High Quality Image Synthesis

    Oct 22, 2026Jungsoo Lee, Alexi Gladstone, Yilun DuImage GenerationEnergy-Based Models

  2. SciFusion: Physics-Guided Compositional Diffusion for Multimodal 3D Scientific Image Generation

    Oct 21, 2026Luoxi Wang, Alessio Quercia, Hanno Scharr +1Image GenerationMultimodal Diffusion Models

  3. Defining and Generating Compositional Structure

    Oct 14, 2026Eric Elmoznino, Tejas Kasetty, Blaise Agüera y Arcas +2Compositional Image GenerationGenerative Modeling

  4. From Prompting to Composing: A Spatial Canvas Interface for Poster Generation

    Oct 8, 2026Yitong Wang, Fangyun Wei, Jinjing Zhao +5Controllable Image GenerationImage Generation

  5. Depth-to-RGB: Repurposing a Frozen Depth Estimator for Geometry-Guided Compositing

    Oct 6, 2026Sanghyun Jo, Chae Yeon Lim, Donghwan Lee +3Image EditingCompositional Image Generation

  6. OverLay++: Dense-Overlap Layout-to-Image Generation Dataset

    Oct 6, 2026Shivansh Aggarwal, Shresth Grover, Divyansh Srivastava +7Image GenerationControllable Image Generation

  7. Form and Void: Entangled Composition through an Autonomous AI Agent

    Oct 1, 2026Shiwen Wang, Jian Yang, Xu Wang +2Image GenerationCompositional Image Generation

  8. VIF-Bench: Evaluating Visual Instruction Following in Multi-Reference Image Generation

    Sep 29, 2026Yuta Oshima, Masakazu Yoshimura, Masahiro Suzuki +2Image GenerationCompositional Image Generation

  9. OOD Generalization as a Bifurcation Problem

    Sep 27, 2026Nguyen-Thanh-Luong Doan, Quang-Vu Nguyen, Tang-Phu-Quy Le +1Diffusion Model GuidanceOOD Generalization

  10. RefCompose: Multi-Reference Image Generation via LoRA-Conditioned Diffusion

    Sep 26, 2026Sai Sri Teja Kuppa, Parth Shinde, Priyadharsan Balaji S +2Image GenerationCompositional Image Generation

  11. GeoComposer: Geometry-Grounded Photographic Composition Instruction

    Sep 22, 2026Shuangzhi Li, Qiaoqiao Jia, Xingxin Chen +2Image EditingCompositional Image Generation

  12. Compositional SVG Generation via VLM-Driven Hierarchical Semantic Parsing

    Sep 13, 2026Sehwan Park, Taehoon Kim, Geonhee Han +3Compositional Image GenerationSemantic Parsing

  13. Less Is More: Balancing Positive and Negative Space in Visual Concept Blending

    Aug 31, 2026Shishi Xiao, Adam J. Coscia, David H. LaidlawCompositional Image Generation

  14. X-MULTI: VLM-based Imaging Factor Disentanglement for Factor-Aware Image Synthesis

    Aug 25, 2026Sonali Godavarthy, Matthias Neuwirth-Trapp, Tim-Felix Faasch +4Disentangled Representation LearningCompositional Image Generation

  15. AnaDiffusion: Anatomically Compositional Latent Diffusion for Controllable 3D Brain MRI Generation

    Aug 24, 2026Huiwen Han, Lulin Liu, Bangya Liu +8Compositional Image GenerationMedical Image Synthesis

  16. Hybrid Generative-Discriminative Object Placement

    Aug 24, 2026Siyuan Zhou, Li NiuCompositional Image Generation

  17. VISTA: Test-Time Compositional Alignment for Visual Autoregressive Generation

    Aug 23, 2026Hossein Shahabadi, Niki Sepasian, Mahdieh Soleymani BaghshahVisual Autoregressive ModelsCompositional Image Generation

  18. presto: Efficient, Training-free, and Open-world Object Placement via Imaginary Search

    Aug 21, 2026Weixuan Ding, Shang Liu, Hanyu Pei +1MLLM ReasoningCompositional Image Generation

  19. OccluRank: Controllable Occlusion-Aware Layout-to-Image Generation by Adding Just an Ordinal Rank

    Aug 21, 2026Wenyang Hong, Yuan Wang, Yanbin Hao +5Image GenerationCompositional Image Generation

  20. WithEveryone: Unified Planning and Identity Grounding for Group Image Generation

    Aug 20, 2026Hengyuan Xu, Qixun Wang, Yiji Cheng +5Subject-Driven Image GenerationImage Generation

  21. TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generation

    Aug 17, 2026Haoran Wang, Chaofan Ma, Ran Yi +1Image GenerationImage Generation Evaluation

  22. PoseAdapter: Dual-Stream 2.5D Controllable Image Generation for Complex Multi-Object Scenes

    Aug 16, 2026Yufeng Chi, Huimin Ma, Fan Gao +3Image GenerationControllable Image Generation

  23. SDO: Subspace Deconflicting Operator for Multi-Adapter Composition

    Aug 13, 2026Zhongsheng Wang, Zhedong Lin, Qian Liu +2Compositional Image GenerationDiffusion Models

  24. StructGen: Disambiguating Multi-Reference Image Generation via Structured Context Modeling

    Jul 17, 2026Jianing Peng, Mengyu Wang, Henghui Ding +6Image GenerationCompositional Image Generation

  25. TAMF-VTON: Token-Wise Sparse Adaptation for Mask-Free Virtual Try-On

    Jul 16, 2026Jie Wang, Qian He, Gaofeng He +2Virtual Try-OnCompositional Image Generation

  26. LILAC: Layer-Wise Independent LoRAs and Cascaded Conditioning for Multi-Concept Customization of Diffusion Models

    Jul 6, 2026Marian Lupascu, Sebastian Ripa, Mihai Trascau +2Subject-Driven Image GenerationCompositional Image Generation