Overview

Constrained decoding guides a model toward outputs that obey requirements such as a JSON schema, grammar, API specification, code constraints, or permitted label set. Common approaches use finite automata, parsers, tries, and token masking, while search, sampling, verification, and diffusion-based methods handle more complex or global constraints. These techniques can make outputs reliably valid and improve task-specific measures, but validity alone does not ensure correct meaning or successful tool use. A central tension is how to enforce constraints without distorting the model’s probabilities, hindering reasoning, or creating failures when constraints are incomplete.

Latest papers

CardsList

72 papers11 papers in the last four weeks, down 21% on the four weeks before. 0.1% of all new papers.

  1. PISG: Constraint-Aligned Signal Amplification for Diffusion-Based Combinatorial Optimization

    Nov 15, 2026Yuming Zhang, Xianchen Zhou, Hongxia WangCombinatorial OptimizationNeural Combinatorial Optimization

  2. Expanding the Decision Space of Pretrained Models through Structured Re-Decoding

    Nov 11, 2026Tinglan Wang, Qun Su, Shihang Wang +11Constrained DecodingLanguage Model Decoding

  3. Testing Processor Contracts in Speculative Decoding Engines

    Nov 2, 2026Tianyu Ding, Yaocheng Tong, Muzhi Yang +2Speculative DecodingDifferential Testing

  4. Specification-Guided Generation for Large Language Models

    Oct 30, 2026Alessandro Previti, Konstantinos Vandikas, Mario Alviano +5Language Model DecodingConstrained Decoding

  5. When All Rollouts Fail: Policy-Compatible Joint Decoding for Hard-Problem Reasoning

    Oct 27, 2026Zehao Wang, Hanzhu Chen, Runquan Gui +2RL for Language ModelsRL for Language Model Reasoning

  6. Constrained Decoding: Harmful or Beneficial? Revisiting Its Impact on LLM Performance

    Oct 26, 2026Ngoc Trinh Hung Nguyen, Alonso Silva, Armen Aghasaryan +1Constrained DecodingConstraint-Guided Reasoning in Language Models

  7. DConstrain: Compiling Context-Parameterized Transitions for Diffusion Language Model Constrained Decoding

    Oct 22, 2026Shidong Cao, Jing Ma, Wenhao Chai +3Constrained DecodingGrammar-Constrained Decoding

  8. Metamodel-Guided LLM Decoding for Consistent DSL Generation

    Oct 21, 2026Boqi Chen, Aren A. Babikian, José Antonio Hernández LópezConstrained DecodingSoftware Engineering

  9. When Copying Is Hard: Copy-Constrained Decoding for Exact Span Reproduction

    Oct 20, 2026Jinghui Zhang, Lang Gao, Zongfang Liu +5Language Model DecodingConstrained Decoding

  10. When Should Enterprise Policy Decisions Be Learned, and When Should They Be Reasoned?

    Oct 13, 2026Hyojung Han, Ryangkyung Kang, Youngeun Kim +1LLM Decision-MakingLLM Reasoning

  11. A Safe Action Is Not Enough: Feasible-Future Decoding for Vision-Language-Action Policies

    Oct 4, 2026Tu Nguyen, Matthieu Zimmer, Vu Anh Vu +4Constrained DecodingVision-Language-Action Models

  12. Constraint-Aware Training

    Oct 2, 2026Jinwoo KimConstrained Generative ModelingEfficient Language Model Training

  13. GrammarRL: Effective Grammar-Constrained Decoding via Reinforcement Learning

    Sep 30, 2026Gabriele Tuccio, Antonino Furnari, Aldo Gangemi +1RL for Language ModelsConstrained Decoding

  14. Making Grid Beam Search Less Greedy

    Sep 30, 2026Sean Papay, Roman KlingerConstrained DecodingConstrained Sampling

  15. Controlled Decoding Attacks on Black-Box LLMs

    Sep 29, 2026Jesson Wang, Shawn Li, Wei Yang +4Constrained DecodingAdversarial Attacks on LLMs

  16. Koa-decision: Fast and Consistent Structured Decision Making with Generative LLMs

    Sep 28, 2026Shenghong Dai, Shiva Kumar Pentyala, Yingchi Liu +6LLM Decision-MakingLLM Inference Acceleration

  17. Twist, Don't Tilt: Trajectory-Exact Constrained Decoding for Masked Diffusion Models

    Sep 28, 2026Aditya Thimmaiah, Lara Marinov, Jayanth Srinivasa +3Constrained DecodingMasked Diffusion Models

  18. Semantic Prefix Oracles for LLM Decoding: Contracts and Differential Validation

    Sep 28, 2026Paul Kronlund-DrouaultConstrained DecodingLLM-Based Program Synthesis

  19. Composable Decoding on the Probability Simplex: Theory and Implementation

    Sep 28, 2026Xiaotong Ji, Ahmed Khaled Khamis, Rasul Tutunov +2Constrained DecodingLanguage Model Decoding

  20. PTC-Decoder: Towards Intelligent SLMs on Offline Resource-Constrained Edge Devices

    Sep 25, 2026Minghui Yu, Ke Mu, Gang WuLLM Tool UseSmall Language Models

  21. Confident but Wrong: A Constrained Decoding Diagnostic for Low-Resource Automatic Post-Editing

    Aug 30, 2026Isuru Wijesiri, Nisansa de Silva, Kavindu Warnakulasuriya +2Low-Resource MTMT Evaluation

  22. Stay Within Your Bounds: Distance-Guided Decoding for Guaranteed Context-Free Grammar Compliance

    Aug 28, 2026Vincenzo Collura, Karim Tit, Eleonora Giunchiglia +2Constrained DecodingGrammar-Constrained Decoding

  23. Meta-Ctrl: Guaranteed Plan Generation by Decoupling Syntactic and Semantic Constraints

    Aug 23, 2026Gwen Yidou-Weng, Edward Sun, Tianyi Ma +5Large Language Model-Based Robot PlanningConstrained Decoding