Controllable Image Generation

Follow this topic Ask about this topic

Momentum

9 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 125

All topics

QuadTok: Quadtree Visual Tokenizer for Autoregressive Image Generation
Oct 7, 2026Yucheng Mao, Zeyuan Chen, Xiaojun Shan +4Visual Tokenization Autoregressive Image Generation
University of California, San Diego
OverLay++: Dense-Overlap Layout-to-Image Generation Dataset
Oct 6, 2026Shivansh Aggarwal, Shresth Grover, Divyansh Srivastava +7Image Generation Controllable Image Generation
UC San Diego · Lambda, Inc.
Local Content-Style Control for Diffusion-based Image Stylization
Oct 6, 2026Amir SemmoLatent Diffusion Models Image Style Transfer
Digital Masterpieces GmbH Potsdam, Germany
On Color Alignment in VAE Latent Spaces and Its Applications
Oct 5, 2026Julian D. Santamaria, Kai Wang, Jesús Malo +2Variational Autoencoders Image Generation
Computer Vision Center · Universitat Aut`onoma de Barcelona · City University of Hong Kong (Dongguan) +1
Safe Image Generation via Reinforcement Learning
Oct 5, 2026Eungyeol Han, Jong-Seok LeeT2I Generation Safe T2I Generation
Yonsei University School of Integrated Technology
Controllable Road Marking Generation
Oct 5, 2026Zhiyu, Cai, Yufan Zhang +3HD Map Construction Controllable Image Generation
Joey · Purdue University, West Lafayette, IN 47906
Steering Fields: Adaptive Vector Fields for Safe Image Generation and Beyond
Sep 30, 2026Simone Facchiano, Jan Eric Lenssen, Bernt Schiele +3T2I Generation Safe T2I Generation
Max Planck Institute for Informatics · Sapienza University of Rome
VIF-Bench: Evaluating Visual Instruction Following in Multi-Reference Image Generation
Sep 29, 2026Yuta Oshima, Masakazu Yoshimura, Masahiro Suzuki +2Image Generation Compositional Image Generation
The University of Tokyo
CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Models
Sep 28, 2026Pengyang Ling, Jiazi Bu, Yujie Zhou +6Generative Flow Networks Multi-Teacher Knowledge Distillation
University of Science and Technology of China · Shanghai Jiao Tong University · Fudan University +2
Beyond Emotion Prompts: Fine-Grained Text-to-Image Generation Driven by Valence-Arousal-Dominance
Sep 21, 2026Minglang Li, Yueyue Fang, Xieping GaoConditional Image Generation Controllable Image Generation
College of Information Science and Engineering Hunan Normal University, Changsha, China
Paint-Anything: Unified Any-Color Control for Image Generation and Editing
Sep 17, 2026Ji Xie, Dewei Zhou, Xinyu Huang +2Text-Guided Image Editing Image Editing
ByteDance Seed · Zhejiang University · Nanjing University
Multimodal Conditioning of Fine-Tuned Stable Diffusion XL for Controllable and Culturally Faithful Ulos Motif Generation
Sep 16, 2026Humasak Simanjuntak, Tamara Yunika Sianipar, Bronson T. M Siallagan +2Latent Diffusion Models Image Generation
Faculty of Informatics and Electrical Engineering, Institut Teknologi Del, Indonesia
Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring
Sep 14, 2026Jisheng Dang, Zhenxuan Wang, Bin Li +3Conditional Image Generation Image Generation
School of Information Science & Engineering, Lanzhou University, Lanzhou 730000, China · School of Environmental and Spatial Informatics, China University of Mining and Technology, Xuzhou 221116, China · College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China +2
An End-to-End Automated Pipeline for Controllable Crack Data Synthesis
Sep 11, 2026Conghui Li, Muxin Pu, Chern Hong Lim +2Synthetic Data Augmentation Learning with Noisy Labels
School of Information Technology, Monash University, Selangor, Malaysia · Department of Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China · School of Engineering, Monash University, Selangor, Malaysia
AcFlow: Controlling Text-to-Image Diffusion Transformers via Learned Conditional Activation Flow
Sep 9, 2026Junran Wang, Zehao Jin, Tianyu Luan +3Diffusion Transformer T2I Generation
Georgia Institute of technology · South China University of Technology
T2LSC-Bench: Benchmarking Localized Semantic Control in Text-to-Image Generation
Sep 2, 2026Yan Wang, Xinyi Hou, Weiguo Lin +2T2I Generation Controllable Image Generation
Communication University of China, Beijing, China · Huazhong University of Science and Technology, Wuhan, China · Peking University, Beijing, China
SpatialGuard: Harness-Guided Verifiable Spatial Reasoning for Text-to-Image Generation
Sep 1, 2026Ziyun Qian, Zizhi Chen, Yizhou Liu +33D Spatial Reasoning T2I Generation
College of Intelligent Robotics and Advanced Manufacturing, Fudan University · Fysics Intelligence Technologies Co., Ltd. (Fysics AI)
AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation
Aug 24, 2026Huiwen Han, Lulin Liu, Bangya Liu +8Compositional Image Generation Medical Image Synthesis
Stanford University · Texas A&M University · University of Minnesota +4
WithEveryone: Unified Planning and Identity Grounding for Group Image Generation
Aug 20, 2026Hengyuan Xu, Qixun Wang, Yiji Cheng +5Subject-Driven Image Generation Image Generation
1Fudan University · 2Hunyuan, Tencent · 3The University of Hong Kong
Evaluation of Clinically Steerable Retinal Image Generation from Foundation Model Latent Spaces
Aug 13, 2026Zuzanna A. Wakefield-Skórniewska, Bartłomiej W. PapieżSynthetic-to-Real Domain Adaptation Medical Imaging Foundation Models
Big Data Institute, Nuffield Department of Population Health, University of Oxford, United Kingdom
Erase but Preserve: Controllable Removal of Copyrighted Animation Characters via Optimized Semantic Anchors
Aug 13, 2026Qiao Li, Xiaomeng Fu, Wangjia Yu +4Diffusion Model Unlearning Controllable Image Generation
Institute of Information Engineering, Chinese Academy of Sciences, School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China · Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China
Staying True to the Origin: Continuous Image Stylization with Smooth Transitions
Aug 8, 2026Rui Xu, Hanmo Zhang, Songhua LiuImage Style Transfer Diffusion-Based Image Editing
Shanghai Jiao Tong University
Beyond Starry Night: Shortcut-Aware Control-State Planning for Artist-Grounded Text to Image Generation
Aug 7, 2026Kuan Xing, Ye Wang, Changyi Gan +4T2I Generation Image Generation
Jilin University · Adobe · University of Wisconsin
Controllable Clothing: Precise Labels and Generation for Virtual Try-On with Latent Diffusion Models
Aug 6, 2026Max Rehman LinderVirtual Try-On Conditional Image Generation
PUBLICIS RESOURCES GENAI TEAM · ÉCOLE POLYTECHNIQUE
CSGen: A Multi-Domain Curvilinear Structure Generation Model via Hierarchical Multimodal Diffusion
Aug 5, 2026Zhe Shan, Ziming Yang, Lei Zhou +3Image Generation Conditional Generative Modeling
Hainan University Haikou, China · Guangdong Ocean University Zhanjiang, China
DAC-Pose: Dual-Agent Collaborative Framework for Pose-Guided Human Generation
Aug 5, 2026Haotian Yang, Zhile Yang, Huiyu Zhou +1Conditional Image Generation Agentic Image Generation
Faculty of Data Science, City University of Macau, Macao, China · Shenzhen University of Advanced Technology, Shenzhen, China · Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China +1
UniWorld-Design: From Pixel Generation to Layer-Native Design
Aug 4, 2026Zongjian Li, Zhiyuan Yan, Chenxu Bai +9Image Generation Compositional Image Generation
UniWorld Team1,2∗
Dual Inversion for Text-to-Image Diffusion Models: From Both Prompt and Noise Perspectives
Jul 29, 2026Xiaolong Liu, Junjian Li, Yuan Xiao +4Diffusion Model Inversion Diffusion-Based Inverse Problems
Geely Hangzhou, China · City University of Macau Macau, China
PriSAR: 3D Geometric-Prior-Guided Diffusion for Parameter-Controlled SAR Image Generation
Jul 25, 2026Fan Zhang, Xuanting Wu, Fei Ma +2Diffusion Model Guidance Diffusion-Based Image Generation
College of Information Science and Technology, Beijing University of Chemical Technology, Beijing 100029, China · 2Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
Appearance Pointers -- Multimodal Region Control of Diffusion Transformers
Jul 21, 2026Rahul Sajnani, Yulia Gryaditskaya, Radomír Měch +2Diffusion Transformer Conditional Image Generation
1Brown University · 2Adobe Research

Oct 7, 2026, cs.CVJ/K move · Enter open · S save

QuadTok: Quadtree Visual Tokenizer for Autoregressive Image Generation

Yucheng Mao, Zeyuan Chen, Xiaojun Shan, Xiang Zhang+3

University of California, San Diego

Visual Tokenization Autoregressive Image Generation Visual Token Compression Controllable Image Generation

Open paper AskPDF arXiv

We introduce QuadTok, a novel framework for visual tokenization and autoregressive image generation. Compared to traditional approaches using 2D grids or 1D token sequences, we propose a hierarchical quadtree structure, bridging the gap between 2D spatial binding and 1D sequence-level flexibility. The QuadTok tokenizer dynamically allocates representational capacity to visually intricate areas while leaving homogeneous regions at a coarse resolution. Compared with a fixed 256-token grid, our ImageNet-trained tokenizer saves approximately 10% of tokens on ImageNet and 9% when transferred zero-shot to the COCO dataset, while maintaining comparable reconstruction fidelity. Furthermore, the natural causality introduced by the tree structure seamlessly enables autoregressive image generation. Conditioned on a quadtree topology supplied before generation, our 947M GPT-style generative model achieves a 2.08 gFID on the ImageNet

256 \times 256

benchmark. Additionally, leveraging the strong spatial correlation preserved by the quadtree structure, the QuadTok generator enables zero-shot spatially controlled image generation capabilities. Code: https://github.com/myc634/QuadTok.

Momentum

Related topics

Latest papers 125