Constrained Generative Modeling

Follow this topic Ask about this topic

Momentum

34 papers in the last four weeks, up 143% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 113

All topics

Mitigating Bias in Locally Constrained Decoding via Tractable Proposals
Jun 1, 2026Meihua Dang, Linxin Song, Honghua Zhang +3Constrained Generative Modeling Constrained Decoding
Department of Computer Science, Stanford University · Department of Computer Science, University of Southern California · Department of Computer Science, University of California, Los Angeles
Constrained Flow Optimization via Sequential Fine Tuning for Molecular Design
May 28, 2026Sven Gutjahr, Riccardo De Santi, Luca Schaufelberger +2Constrained Generative Modeling Molecular Optimization
Department of Computer Science, ETH Zurich · ETH AI Center · NCCR Catalysis, Switzerland +1
Conflict-Aware Additive Guidance for Flow Models under Compositional Rewards
May 20, 2026Xuehui Yu, Fucheng Cai, Meiyi Wang +2Constrained Generative Modeling Diffusion Model Guidance
Smart Systems Institute, National University of Singapore, Singapore · Faculty of Computing, Harbin Institute of Technology, Harbin, China · School of Computing, National University of Singapore, Singapore
Constrained Code Generation with Discrete Diffusion
May 16, 2026Lize Shao, Michael Cardei, Zichen Xie +2Constrained Generative Modeling Constrained Decoding
University of Virginia
StippleDiffusion: Capacity-Constrained Stippling using Controlled Diffusion
May 15, 2026Ofir Gilad, Aleksander Plocharski, Przemyslaw Musialski +1Constrained Generative Modeling Diffusion Sampling
Ben Gurion University of the Negev, Israel · Warsaw University of Technology, and Akces NCBR, Poland · Akces NCBR, Poland +1
Generative Floor Plan Design with LLMs via Reinforcement Learning with Verifiable Rewards
May 13, 2026Luis Lara, Aristides Milios, Zhi Hao Luo +5Constrained Generative Modeling Generative Modeling
Mila – Quebec AI Institute · Université de Montréal · Polytechnique Montréal +1
Learning Local Constraints for Reinforcement-Learned Content Generators
May 13, 2026Debosmita Bhaumik, Julian Togelius, Georgios N. Yannakakis +1Constrained Generative Modeling Constrained RL
Institute of Digital Games, Msida, Malta · Game Innovation Lab, New York, New York, USA
Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Sampling
May 12, 2026Jacob K. Christopher, James E. Warner, Ferdinando FiorettoConstrained Generative Modeling Flow Matching
University of Virginia · NASA Langley Research Center
Enforcing Constraints in Generative Sampling via Adaptive Correction Scheduling
May 11, 2026Noah Trupin, Yexiang XueConstrained Generative Modeling Diffusion Sampling
Department of Computer Science, Purdue University
Primal-Dual Guided Decoding for Constrained Discrete Diffusion
May 10, 2026Federico Tomasi, Dmitrii Moor, Alice Wang +1Primal-Dual Optimization Constrained Generative Modeling
Spotify
Towards Highly-Constrained Human Motion Generation with Retrieval-Guided Diffusion Noise Optimization
May 8, 2026Hanchao Liu, Fang-Lue Zhang, Shining Zhang +2Constrained Generative Modeling Retrieval-Augmented Generation
Tsinghua University · University of New South Wales
Exact Regular-Constrained Variable-Order Markov Generation via Sparse Context-State Belief Propagation
May 8, 2026François PachetConstrained Generative Modeling Constrained Decoding
LIP6, Sorbonne Université · Ynosound
FlowPlace: Flow Matching for Chip Placement
Apr 26, 2026Peng Xie, Ke Xue, Yunqi Shi +6Constrained Generative Modeling Flow Matching
1State Key Laboratory of Novel Software Technology, Nanjing University, China · School of Artificial Intelligence, Nanjing University, China · 3Huawei Noah’s Ark Lab, China
BrickNet: Graph-Backed Generative Brick Assembly
Apr 24, 2026Peter Kulits, Cordelia SchmidConstrained Generative Modeling 3D Asset Generation
Inria, `Ecole Normale Sup`erieure, CNRS, PSL Research University · Max Planck Institute for Intelligent Systems, Tübingen
UniCSG: Unified High-Fidelity Content-Constrained Style-Driven Generation via Staged Semantic and Frequency Disentanglement
Apr 20, 2026Jingwei Yang, Ruoxi Wu, Wei Shen +4Constrained Generative Modeling Diffusion Transformer
China University of Mining and Technology, Beijing, China · OPPO Artificial Intelligence Center, Beijing, China
Efficient Diffusion Models under Nonconvex Equality and Inequality constraints via Landing
Apr 20, 2026Kijung Jeon, Michael Muehlebach, Molei TaoConstrained Generative Modeling Langevin Dynamics
Georgia Institute of Technology · Max Planck Institute for Int. Sys.
DALM: A Domain-Algebraic Language Model via Three-Phase Structured Generation
Apr 17, 2026Chao LiConstrained Generative Modeling Knowledge Conflicts in Language Models
Schema-Key Wording as an Instruction Channel in Structured Generation under Constrained Decoding
Apr 16, 2026Yifan LeConstrained Generative Modeling Constrained Decoding
Independent Researcher
Suffix-Constrained Greedy Search Algorithms for Causal Language Models
Mar 1, 2026Ayoub Hammal, Pierre Zweigenbaum, Caio CorroConstrained Generative Modeling Constrained Decoding
1Université Paris-Saclay, CNRS, LISN · 2INSA Rennes, IRISA, CNRS, Université de Rennes
Neural Proposals, Symbolic Guarantees: Neuro-Symbolic Graph Generative Modeling
Feb 18, 2026Chuqin Geng, Li Zhang, Mark Zhang +3Constrained Generative Modeling Satisfiability Modulo Theories
School of Computer Science, McGill University, Montreal, Canada · Department of Computer Science, University of Toronto, Toronto, Canada
The Hidden Cost of Structured Generation in LLMs: Draft-Conditioned Constrained Decoding
Feb 8, 2026Avinash Reddy, Thayne T. Walker, James S. Ide +1Constrained Generative Modeling Constrained Decoding
Department of Computer Science, University of Central Florida, FL, US · Lockheed Martin AI Center, CT, US
Manifold-Aware Perturbations for Constrained Generative Modeling
Jan 30, 2026Katherine Keegan, Lars RuthottoConstrained Generative Modeling Generative Modeling
Department of Mathematics, Emory University, Atlanta, Georgia, USA.
Grammar-Aligned Decoding
May 31, 2024Kanghee Park, Jiayu Wang, Taylor Berg-Kirkpatrick +2Constrained Generative Modeling Constrained Decoding
University of Wisconsin-Madison · University of California San Diego

Jun 1, 2026, cs.CLJ/K move · Enter open · S save

Mitigating Bias in Locally Constrained Decoding via Tractable Proposals

Meihua Dang, Linxin Song, Honghua Zhang, Jieyu Zhao+2

Department of Computer Science, Stanford University · Department of Computer Science, University of Southern California · Department of Computer Science, University of California, Los Angeles

Constrained Generative Modeling Constrained Decoding

Open paper AskPDF arXiv

Generations from large language models often fail to conform to desired constraints such as JSON schema. Existing locally constrained decoding (LCD) approaches enforce constraints by myopically masking out next tokens, resulting in biased sampling and degradation in performance. Recent work uses sequential Monte Carlo (SMC) methods to mitigate such biases, but designing effective proposal distributions or potential functions remains a key challenge. In this work, we propose a generic approach to construct proposals and potentials for SMC sampling from

p_{\mathrm{lm}}( \cdot \mid \mathrm{constraint})

. First, we show that constraints specified as finite automata can be tensorized for efficient execution on GPUs, which we use to construct globally constrained decoding (GCD) proposals. In addition, leveraging the fact that tensorized finite automata share the same circuit structure as hidden Markov models, we circuit-multiply them to obtain the probabilistic GCD (P-GCD) proposals encoding both logical and probabilistic information about the target distributions. We evaluate (P-)GCD on the tasks of function calling, keyword-based generation, and SQL generation. Experiments show that under the same SMC sampling setup, compared to LCD proposals, (P-)GCD converges faster to the target distribution with significantly fewer particles.

Momentum

Related topics

Latest papers 113