Controllable Image Generation

Overview

The field studies how to make image generators follow specific instructions about what an image contains and how its elements look and are arranged. Common approaches condition diffusion or flow models on layouts, boxes, sketches, masks, poses, depth maps, and reference images, or steer their attention, latent representations, noise, and activations; newer systems also plan and check images through iterative reasoning. Researchers evaluate control using compositional and spatial benchmarks as well as domain-specific tasks such as medical imaging, fashion, and remote sensing. A central challenge is meeting precise local constraints while preserving realism, identity, prompt meaning, and diversity, especially when several controls interact.

Latest papers

CardsList

228 papers14 papers in the last four weeks, down 26% on the four weeks before. 0.1% of all new papers.

  1. Few-Shot Visual Concept Extraction for Steering Diffusion Transformers

    Nov 14, 2026Nabyl Quignon, Antitza DantchevaControllable Image GenerationActivation Steering

  2. Creative Product Design under Brand Image Constraints

    Nov 13, 2026Takeshi Onishi, Hiroya Makino, Takahiro Yamaguchi +1T2I GenerationControllable Image Generation

  3. Continuous Angular Control in Text-to-Image Generation via Geometric Token Encoding

    Nov 9, 2026Furkan Güzelant, Basavaraj Sunagad, Aysegul Dundar +1Controllable Image GenerationGeometry-Conditioned Image Generation

  4. reComposer: Editable Planning for Controllable Image Generation

    Nov 9, 2026Susie S. Y. Li, Angie Boggust, Fred Hohman +3Human-AI Co-CreationControllable Image Generation

  5. Spatially and Compositionally Controlled Multimodal Glioblastoma MRI Synthesis with Latent Diffusion

    Nov 4, 2026Steven Glass, Max Van Puyvelde, Marija Pizurica +3Medical Image SynthesisMedical Imaging

  6. Generative AI for urban planning: synthesizing land-use maps with satellite imagery via DualControlNet

    Nov 4, 2026Qingqi Song, Yuzhou Chen, Lingqian Hu +1Urban PlanningImage Generation

  7. C-WFDM: A ControlNet-Guided Wavelet-Fusion Diffusion Model for Multimodal Brain MRI Completion

    Nov 3, 2026Muhammad Nabi Yasinzai, Remika Mito, Mangor PedersenMedical Image SynthesisBrain MRI

  8. ScoreDial: Precise Control of Visual Attributes in Image Generation via Regressor Guidance from Limited Human Ratings

    Nov 3, 2026Jianbo Tang, Keita Ishii, Hiroki Sakamoto +7Controllable Image Generation

  9. MATS: A Multi-Agent Framework for Controllable and Reflective Tumor Synthesis

    Oct 30, 2026Zhongnan Shi, Keyang Zhou, Siyi Li +6Medical Image SynthesisControllable Image Generation

  10. DiffAuction: An Auction-Driven Framework for Generative Image Advertising

    Oct 26, 2026Yijie Su, Ruiyang Si, Tonghan WangImage GenerationControllable Image Generation

  11. Rethinking Microscopy Generation: Co-Designed Diffusion for Biologically Interpretable Single-Cell Synthesis

    Oct 24, 2026Shumpei Takezaki, Duway Nicolas Lesmes-Leon, Ryoma Bise +4Image GenerationControllable Image Generation

  12. CCG Diffusion: Combinatory Categorial Grammar-Driven Compositional and Syntactically Disambiguated Text-to-Image Generation

    Oct 21, 2026Ryosuke Yamaki, Daichi Mochihashi, Nobutaka Shimada +2Compositional T2I GenerationControllable Image Generation

  13. T-DIG: Text-Conditioned Diversity for Image Generation

    Oct 21, 2026Simran Khanuja, Rohit Gandikota, Gaurav Parmar +1T2I GenerationControllable Image Generation

  14. Reflection-Guided Dynamics Rectification for Text-to-Image Generation

    Oct 18, 2026Shuo Xu, Hanrui Ying, Debin Liu +2T2I GenerationT2I Diffusion Models

  15. FlashControl: One-Step Controllable Generator via Distillation-Friendly Single-Stream Teachers

    Oct 15, 2026Ngan Nguyen, Dung Nguyen, Quan Dao +4Spatially Grounded Image GenerationControllable Image Generation

  16. Rethinking Classifier-Free Guidance for TI2I Flow Matching

    Oct 15, 2026Andreas Floros, Elena Koritska, Teofilo de Campos +4Classifier-Free GuidanceText-Guided Image Editing

  17. Controllable Diverse Sampling through Pullback Directions

    Oct 9, 2026Sylvain Dehayem Kenfouo, Aaron Zweig, Mingxuan Zhang +1Image GenerationDiffusion Model Sampling

  18. Stride: Scale-Aware Multi-Agent Evolutionary Refinement for Infographic Generation

    Oct 9, 2026Yan Zhou, Yang YangAgentic Image GenerationControllable Image Generation

  19. From Prompting to Composing: A Spatial Canvas Interface for Poster Generation

    Oct 8, 2026Yitong Wang, Fangyun Wei, Jinjing Zhao +5Controllable Image GenerationImage Generation

  20. Adaptive Adversarial Augmentation for Controllable Face Synthesis

    Oct 8, 2026Saransh Suri, Shivang Agarwal, Mayank Vatsa +1Synthetic Data AugmentationData Augmentation

  21. QuadTok: Quadtree Visual Tokenizer for Autoregressive Image Generation

    Oct 7, 2026Yucheng Mao, Zeyuan Chen, Xiaojun Shan +4Visual TokenizationDiscrete Visual Tokenization

  22. OverLay++: Dense-Overlap Layout-to-Image Generation Dataset

    Oct 6, 2026Shivansh Aggarwal, Shresth Grover, Divyansh Srivastava +7Image GenerationControllable Image Generation

  23. On Color Alignment in VAE Latent Spaces and Its Applications

    Oct 5, 2026Julian D. Santamaria, Kai Wang, Jesús Malo +2Variational AutoencodersImage Generation

  24. Safe Image Generation via Reinforcement Learning

    Oct 5, 2026Eungyeol Han, Jong-Seok LeeT2I GenerationSafe T2I Generation

  25. Controllable Road Marking Generation

    Oct 5, 2026Zhiyu Joey Cai, Yufan Zhang, Ruichen Tan +2HD Map ConstructionControllable Image Generation

  26. ProgressNet: Sketching and Prompting with a Frozen Text-to-Image Model

    Oct 2, 2026Arkaprabha Basu, Chaitat Utintu, Yi-Zhe SongImage GenerationControllable Image Generation

  27. DAGS: Disentangled Appearance-and-Geometry Steering of a Frozen Image DiT for Temporally Stabilized Generative Rendering

    Oct 1, 2026Karthik Mohan Kumar, Damian Andrysiak, Pedro Antonio Pena +2Controllable Image GenerationNeural Rendering