Controllable Image Generation

Ask about this topic

Overview

The field studies how to make image generators follow specific instructions about what an image contains and how its elements look and are arranged. Common approaches condition diffusion or flow models on layouts, boxes, sketches, masks, poses, depth maps, and reference images, or steer their attention, latent representations, noise, and activations; newer systems also plan and check images through iterative reasoning. Researchers evaluate control using compositional and spatial benchmarks as well as domain-specific tasks such as medical imaging, fashion, and remote sensing. A central challenge is meeting precise local constraints while preserving realism, identity, prompt meaning, and diversity, especially when several controls interact.

Latest papers

CardsList

216 papers22 papers in the last four weeks, up 47% on the four weeks before. 0.1% of all new papers.

  1. GeRM: A Generative Rendering Model From Physically Realistic to Photorealistic

    Apr 10, 2026Jiayuan Lu, Rengan Xie, Xuancheng Jin +5Controllable Image GenerationNeural Rendering

    State Key Lab of CAD&CG, Zhejiang University and Zhejiang Lab, China · State Key Laboratory of Industrial Control Technology, Zhejiang University, China · Zhejiang University, China

  2. SHIFT: Steering Hidden Intermediates in Flow Transformers

    Apr 10, 2026Nina Konovalova, Andrey Kuznetsov, Aibek AlanovControllable Image GenerationConcept Erasure

    FusionBrain Lab · HSE University · AXXX

  3. VersaVogue: Visual Expert Orchestration and Preference Alignment for Unified Fashion Synthesis

    Apr 8, 2026Jian Yu, Fei Shen, Cong Wang +4Image GenerationControllable Image Generation

    Nanjing University of Science and Technology · National University of Singapore · Nanjing University +1

  4. Graph-PiT: Enhancing Structural Coherence in Part-Based Image Synthesis via Graph Priors

    Apr 7, 2026Junbin Zhang, Meng Cao, Feng Tan +2Geometry-Conditioned Image GenerationImage Generation

    Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology Shenzhen Graduate School, Peking University, China · Department of Computer Vision, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates

  5. Improving Controllable Generation: Faster Training and Better Performance via x0x_0-Supervision

    Apr 7, 2026Amadou S. Sangare, Adrien Maglo, Mohamed Chaouch +1Controllable Image GenerationConditional Diffusion Models

    Université Paris-Saclay, CEA, List, F-91120, Palaiseau, France

  6. Controllable Image Generation with Composed Parallel Token Prediction

    Apr 7, 2026Jamie Stirling, Noura Al-Moubayed, Chris G. Willcocks +1Controllable Image GenerationCompositional Image Generation

    Durham University, United Kingdom

  7. EmoScene: A Dual-space Dataset for Controllable Affective Image Generation

    Apr 1, 2026Li He, Longtai Zhang, Wenqiang Zhang +2Image GenerationControllable Image Generation

    Fudan University · East China Normal University

  8. Disentangling to Re-couple: Resolving the Similarity-Controllability Paradox in Subject-Driven Text-to-Image Generation

    Apr 1, 2026Shuang Li, Chao Deng, Hang Chen +8Subject-Driven Image GenerationControllable Image Generation

    Tencent

  9. MMFace-DiT: A Dual-Stream Diffusion Transformer for High-Fidelity Multimodal Face Generation

    Mar 30, 2026Bharath Krishnamurthy, Ajita RattaniMultimodal GenerationControllable Image Generation

    University of North Texas, Denton, TX, USA

  10. Gated Condition Injection without Multimodal Attention: Towards Controllable Linear-Attention Transformers

    Mar 29, 2026Yuhe Liu, Zhenxiong Tan, Yujia Hu +2Conditional Diffusion ModelsControllable Image Generation

    National University of Singapore · Shanghai Jiao Tong University

  11. LightMover: Generative Light Movement with Color and Intensity Controls

    Mar 28, 2026Gengze Zhou, Tianyu Wang, Soo Ye Kim +7Image RelightingControllable Image Generation

    AIML, Adelaide University · Adobe Research · University of Hong Kong +1

  12. Let Triggers Control: Frequency-Aware Dropout for Effective Token Control

    Mar 28, 2026Junyoung Koh, Hoyeon Moon, Dongha Kim +3Controllable Image GenerationDiffusion Model Fine-Tuning

    Yonsei University · Onoma AI

  13. BizGenEval: A Systematic Benchmark for Commercial Visual Content Generation

    Mar 26, 2026Yan Li, Zezi Zeng, Ziwei Zhou +13Image Generation EvaluationImage Generation

    Shanghai Jiao Tong University · Xi’an Jiaotong University · Fudan University +1

  14. Self-Corrected Image Generation with Explainable Latent Rewards

    Mar 26, 2026Yinyi Luo, Hrishikesh Gokhale, Marios Savvides +2Image GenerationControllable Image Generation

    Carnegie Mellon University · Singapore Management University · William & Mary

  15. Realiz3D: 3D Generation Made Photorealistic via Domain-Aware Learning

    Mar 25, 2026Ido Sobol, Kihyuk Sohn, Yoav Blum +4Multi-View Image SynthesisImage Generation

    Technion · Meta AI

  16. LGTM: Training-Free Light-Guided Text-to-Image Diffusion Model via Initial Noise Manipulation

    Mar 25, 2026Ryugo Morita, Stanislav Frolov, Brian Bernhard Moser +3Controllable Image GenerationT2I Diffusion Models

    RPTU Kaiserslautern-Landau & DFKI GmbH, Kaiserslautern, Germany · Faculty of Science and Engineering, Hosei University, Tokyo, Japan

  17. FontCrafter: High-Fidelity Element-Driven Artistic Font Creation with Visual In-Context Generation

    Mar 23, 2026Wuyang Luo, Chengkai Tan, Chang Ge +3Controllable Image Generation

    Dalian University of Technology · Shanghai Key Laboratory of Intelligent Information Processing, Fudan University

  18. MS-CustomNet: Controllable Multi-Subject Customization with Hierarchical Relational Semantics

    Mar 22, 2026Pengxiang Cai, Mengyang LiControllable Image GenerationCompositional T2I Generation

    School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237, China · Center for Applied Mathematics, Tianjin University, Tianjin 300072, China

  19. The Unreasonable Effectiveness of Text Embedding Interpolation for Continuous Image Steering

    Mar 18, 2026Yigit Ekin, Yossi GandelsmanText-Guided Image EditingControllable Image Generation

    Reve

  20. Learning Latent Proxies for Controllable Single-Image Relighting

    Mar 16, 2026Haoze Zheng, Zihao Wang, Xianfeng Wu +5Physics-Informed Diffusion ModelsControllable Image Generation

    HKUST · HKPolyU · CUHK

  21. RSGen: Enhancing Layout-Driven Remote Sensing Image Generation with Diverse Edge Guidance

    Mar 16, 2026Xianbao Hou, Yonghao He, Zeyd Boukhers +4Image GenerationControllable Image Generation

    School of Future Science and Engineering, Soochow University, Suzhou, China · D-Robotics, Beijing, China · Fraunhofer Institute for Applied Information Technology, Sankt Augustin, Germany +2

  22. AnyPhoto: Multi-Person Identity Preserving Image Generation with ID Adaptive Modulation on Location Canvas

    Mar 16, 2026Longhui YuanIdentity-Preserving Image GenerationControllable Image Generation

  23. PHAC: Promptable Human Amodal Completion

    Mar 16, 2026Seung Young Noh, Ju Yong ChangControllable Image GenerationDiffusion-Based Image Generation

    Kwangwoon University

  24. ChArtist: Generating Pictorial Charts with Unified Spatial and Subject Control

    Mar 15, 2026Shishi Xiao, Tongyu Zhou, David Laidlaw +1Controllable Image GenerationData Visualization

    Brown University · Adobe Research

  25. Not All Latent Spaces Are Flat: Hyperbolic Concept Control

    Mar 14, 2026Maria Rosaria Briglia, Simone Facchiano, Paolo Cursi +6Controllable Image GenerationSafe T2I Generation

    Department of Computer Science, Sapienza University of Rome, Rome, Italy · ItalAI Labs, Rome, Italy · Paradigma Inc., Rome, Italy

  26. Multi-Object Advertisement Creative Generation

    Mar 14, 2026Jialu Gao, Mithun Das Gupta, Qun Li +4Image GenerationE-Commerce

    CMU, USA · Microsoft AI, USA · Microsoft Research, USA

  27. NumColor: Precise Numeric Color Control in Text-to-Image Generation

    Mar 13, 2026Muhammad Atif Butt, Diego Hernandez, Alexandra Gomez-Villa +3Controllable Image GenerationT2I Diffusion Models

    Computer Vision Center, Spain · Computer Sciences Department, Universitat Autònoma de Barcelona, Spain · Program of Computer Science, City University of Hong Kong (Dongguan) +1

  28. CalliMaster: Mastering Page-level Chinese Calligraphy via Layout-guided Spatial Planning

    Mar 12, 2026Tianshuo Xu, Tiantian Hong, Zhifei Chen +2Layout-Guided T2I GenerationImage Generation

    The Hong Kong University of Science and Technology (Guangzhou) · Faculty of Engineering and IT, University of Technology Sydney · Xiamen University +1

  29. The Latent Color Subspace: Emergent Order in High-Dimensional Chaos

    Mar 12, 2026Mateusz Pach, Jessica Bader, Quentin Bouniot +2Controllable Image GenerationNeural Network Interpretability

    Technical University of Munich · Helmholtz Munich · Munich Center for Machine Learning +2

  30. Visually-Guided Controllable Medical Image Generation via Fine-Grained Semantic Disentanglement

    Mar 11, 2026Xin Huang, Junjie Liang, Qingshan Hou +4Medical Image SynthesisControllable Image Generation

    Computer Science and Engineering, Northeastern University, Shenyang, China · Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, China · National Frontiers Science Center for Industrial Intelligence and Systems Optimization, Shenyang, China +2