Constrained Decoding

Ask about this topic

Momentum

8 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 43

All topics
CardsList

  1. Breaking the Space Barrier and its Application to Language Model Inference

    Oct 6, 2026Arip AsadulaevConstrained DecodingEfficient Language Model Inference

    MBZUAI

  2. A Safe Action Is Not Enough: Feasible-Future Decoding for Vision-Language-Action Policies

    Oct 4, 2026Tu Nguyen, Matthieu Zimmer, Vu Anh Vu +4Constrained DecodingVision-Language-Action Models

    Huawei Heisenberg Research Center · Huawei Noah’s Ark Lab · TU Berlin +1

  3. GrammarRL: Effective Grammar-Constrained Decoding via Reinforcement Learning

    Sep 30, 2026Gabriele Tuccio, Antonino Furnari, Aldo Gangemi +1RL for Language ModelsConstrained Decoding

    University of Catania · ISTC - National Research Council, Italy · University of Bologna

  4. Controlled Decoding Attacks on Black-Box LLMs

    Sep 29, 2026Jesson Wang, Shawn Li, Wei Yang +4Constrained DecodingAdversarial Attacks on LLMs

    University of Southern California · Adobe · Amazon

  5. Twist, Don't Tilt: Trajectory-Exact Constrained Decoding for Masked Diffusion Models

    Sep 28, 2026Aditya Thimmaiah, Lara Marinov, Jayanth Srinivasa +3Constrained DecodingMasked Diffusion Models

    The University of Texas at Austin · Cisco Research

  6. Semantic Prefix Oracles for LLM Decoding: Contracts and Differential Validation

    Sep 28, 2026Paul Kronlund-DrouaultConstrained DecodingLLM-Based Program Synthesis

    ENS de Lyon Lyon, France · Unsuspicious Industries Paris, France · Université de Lille Lille, France

  7. Composable Decoding on the Probability Simplex: Theory and Implementation

    Sep 28, 2026Xiaotong Ji, Ahmed Khaled Khamis, Rasul Tutunov +2Constrained DecodingLanguage Model Decoding

    Huawei Noah’s Ark Lab · UCL Centre for AI

  8. Constrained Decoding Eliminates Structural Failures in Small LLMs but Reveals a Scale-Dependent Semantic Gap

    Sep 20, 2026Akash ChavanConstrained DecodingLLM Evaluation

  9. CLAMP: Constrained Decoding for Vision-Language Embodied Planning

    Sep 8, 2026Tianyi Ma, Parisa KordjamshidiConstrained DecodingVision-Language Grounding

    Michigan State University

  10. Trie Automata for Constrained Decoding over Large Finite Sets

    Aug 12, 2026Xingzi Xu, Karim BouyarmaneConstrained DecodingLLM Inference Acceleration

    Amazon

  11. The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding

    Aug 10, 2026Işıl Özgü, Yaoxuan Wu, Guy Van den Broeck +1Constrained DecodingGrammar-Constrained Decoding

    University of California, Los Angeles Los Angeles, CA, USA

  12. Stateful CARS: Exact Cross-History Reuse for Policy-Constrained LLM Agents

    Aug 8, 2026Ibne Farabi Shihab, Md Najmus Swaqeeb, Abu Sa-Adat Mohamed Moon-Im Al AhsanConstrained DecodingLLM Agents

    Department of Computer Science, Iowa State University · Department of Computer Science & Engineering, BRAC University

  13. Explicit Note-Event Tokenization and Pitch-Validity Constrained Decoding for MIDI-to-Tablature Transcription

    Jul 29, 2026Ting-Kai Hsu, Wei-Chin Wang, Kai-Xi Hong +1Constrained DecodingAutomatic Music Transcription

    Graduate Institute of Communication Engineering National Taiwan University Taipei, Taiwan · Department of Electrical Engineering National Taiwan University Taipei, Taiwan · Graduate Institute of Networking and Multimedia National Taiwan University Taipei, Taiwan

  14. StageGuard: Physiologically Constrained Sleep Staging

    Jul 25, 2026Juntang Wang, Yihan Wang, Hao Wu +3Constrained DecodingSleep Stage Classification

    Zu Chongzhi Center, Duke Kunshan University Kunshan, China

  15. Constrained CTC Decoding for Efficient Diacritic Restoration

    Jul 21, 2026Rufael Marew, Amr Keleg, Hanan AldarmakiConstrained DecodingArabic NLP

    Mohamed Bin Zayed University of Artificial Intelligence, UAE

  16. Graph-Constrained Policy Learning for Extreme Clinical Code Prediction

    Jul 11, 2026Amritpal Singh, Sebastian Torres, Khawar Shakeel +1Hierarchical ClassificationConstrained Decoding

    Division of Computer Science, Mathematics and Science St. John’s University, New York, NY, USA

  17. FlashTrie: A GPU-Accelerated Constrained Beam Search for Generative Retrieval

    Jul 10, 2026Dakshitha Anandakumar, Anurag Mukkara, Wenxiang Hu +5Constrained DecodingGPU Kernel Optimization

    Microsoft, Redmond, WA, USA · Nvidia, Santa Clara, CA, USA

  18. Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata

    Jul 8, 2026Meihua Dang, Stefano ErmonConstrained Generative ModelingConstrained Decoding

    Stanford University

  19. Mitigating Errors in LLM-Generated Web API Invocations via Retrieval-Augmented Generation and Constrained Decoding

    Jul 7, 2026Daniel Maninger, Leon Chemnitz, Jannis Brugger +3Retrieval-Augmented GenerationConstrained Decoding

    Technische Universität Darmstadt, Darmstadt, Germany · Hessian Center for Artificial Intelligence (hessian.AI), Darmstadt, Germany · Pariton AI, Berlin, Germany +1

  20. Constraint Tax in Open-Weight LLMs: An Empirical Study of Tool Calling Suppression Under Structured Output Constraints

    Jun 24, 2026Fangzheng Li, Aimin Zhang, Chen LvConstrained DecodingLLM Tool Use

    1Focus AI Center, Focus Technology Co., Ltd. · 2Nanjing University of Science and Technology

  21. The Alignment Problem in Constrained Code Generation

    Jun 19, 2026Matteo Biagiola, Jahrim Gabriele Cesario, Luca Di Grazia +2Constrained DecodingConstraint Satisfaction

    University of St. Gallen and Università della Svizzera italiana (USI) St. Gallen and Lugano, SG and TI Switzerland · University of St. Gallen St. Gallen, SG, Switzerland

  22. Mitigating Bias in Locally Constrained Decoding via Tractable Proposals

    Jun 1, 2026Meihua Dang, Linxin Song, Honghua Zhang +3Constrained Generative ModelingConstrained Decoding

    Department of Computer Science, Stanford University · Department of Computer Science, University of Southern California · Department of Computer Science, University of California, Los Angeles

  23. Accelerating Constrained Decoding with Token Space Compression

    May 28, 2026Michael Sullivan, Alexander KollerConstrained DecodingLLM Inference Acceleration

    Department of Language Science and Technology Saarland Informatics Campus Saarland University, Saarbrücken, Germany

  24. Learning the Error Patterns of Language Models

    May 27, 2026Jinwoo Kim, Taylor Berg-KirkPatrick, Loris D'AntoniConstrained DecodingLanguage Model Error Detection

  25. An Empirical Audit of k-NAF Budget Accounting for Anchored Decoding

    May 27, 2026J. VijayavallabhConstrained DecodingLanguage Model Auditing

    Indian Institute of Technology Madras Chennai, India

  26. Gumbel Machine: Counterfactual Student Writing Generation via Gumbel Noise Steering

    May 26, 2026Hunter McNichols, Alexander Scarlatos, Mihai Dascalu +2Constrained DecodingControllable Text Generation

    University of Massachusetts Amherst · University Politehnica of Bucharest · Arizona State University

  27. The Constraint Tax: Measuring Validity-Correctness Tradeoffs in Structured Outputs for Small Language Models

    May 20, 2026Jaideep RayConstrained DecodingSmall Language Models

  28. Verifier-Guided Code Translation via Meta-Step Decoding

    May 17, 2026Tianyang Zhou, Somesh Jha, Mihai Christodorescu +2Code TranslationConstrained Decoding

    University of Illinois Urbana-Champaign · University of Wisconsin–Madison and Google · Google

  29. Constrained Code Generation with Discrete Diffusion

    May 16, 2026Lize Shao, Michael Cardei, Zichen Xie +2Constrained Generative ModelingConstrained Decoding

    University of Virginia

  30. TruncProof: A Guardrail for LLM-based JSON Generation under Token-Length Constraints

    May 13, 2026Yoshio Kato, Shuhei TarashimaConstrained DecodingStructured Output Generation

    NTT DOCOMO BUSINESS, Inc., Japan

  31. Improving Temporal Action Segmentation via Constraint-Aware Decoding

    May 11, 2026Yeo Keat Ee, Debaditya Roy, Chen Li +2Temporal Action SegmentationConstrained Decoding

    Institute of High-Performance Computing, Agency for Science, Technology and Research, Singapore · Centre for Frontier AI Research, Agency for Science, Technology and Research, Singapore · Indian Institute of Technology Kharagpur, India +1

  32. NCO: A Versatile Plug-in for Handling Negative Constraints in Decoding

    May 11, 2026Hyundong Jin, Yo-Sub HanConstrained Decoding

    Yonsei University Seoul, Republic of Korea

  33. Primal-Dual Guided Decoding for Constrained Discrete Diffusion

    May 10, 2026Federico Tomasi, Dmitrii Moor, Alice Wang +1Primal-Dual OptimizationConstrained Generative Modeling

    Spotify

  34. The Silent Vote: Improving Zero-Shot LLM Reliability by Aggregating Semantic Neighborhoods

    May 10, 2026Sanket Badhe, Priyanka Tiwari, Deep ShahConstrained DecodingZero-Shot Text Classification

    Google

  35. Exact Regular-Constrained Variable-Order Markov Generation via Sparse Context-State Belief Propagation

    May 8, 2026François PachetConstrained Generative ModelingConstrained Decoding

    LIP6, Sorbonne Université · Ynosound

  36. LatticeBridge: Rare-Event Sequential Inference for Faithful Structured Sequence Synthesis

    Apr 22, 2026Faruk Alpay, Bugra KilictasConstrained DecodingGrounded Text Generation

    Department of Computer Engineering, Bahcesehir University

  37. Schema-Key Wording as an Instruction Channel in Structured Generation under Constrained Decoding

    Apr 16, 2026Yifan LeConstrained Generative ModelingConstrained Decoding

    Independent Researcher

  38. Suffix-Constrained Greedy Search Algorithms for Causal Language Models

    Mar 1, 2026Ayoub Hammal, Pierre Zweigenbaum, Caio CorroConstrained Generative ModelingConstrained Decoding

    1Université Paris-Saclay, CNRS, LISN · 2INSA Rennes, IRISA, CNRS, Université de Rennes

  39. Vectorizing the Trie: Efficient Constrained Decoding for LLM-based Generative Retrieval on Accelerators

    Feb 26, 2026Zhengyang Su, Isay Katsman, Yueqi Wang +10Constrained DecodingGenerative Retrieval

    Google Mountain View, CA, USA · Yale University New Haven, CT, USA

  40. The Hidden Cost of Structured Generation in LLMs: Draft-Conditioned Constrained Decoding

    Feb 8, 2026Avinash Reddy, Thayne T. Walker, James S. Ide +1Constrained Generative ModelingConstrained Decoding

    Department of Computer Science, University of Central Florida, FL, US · Lockheed Martin AI Center, CT, US

  41. Anchored Decoding: Provably Reducing Copyright Risk for Any Language Model

    Feb 6, 2026Jacqueline He, Jonathan Hayase, Wen-tau Yih +3Constrained DecodingLanguage Model Decoding

    University of Washington · Allen Institute for Artificial Intelligence

  42. Strategies for Span Labeling with Large Language Models

    Jan 23, 2026Danil Semin, Ondřej Dušek, Zdeněk KasnerConstrained DecodingLanguage Model Decoding

    Institute of Formal and Applied Linguistics Faculty of Mathematics and Physics, Charles University

  43. Grammar-Aligned Decoding

    May 31, 2024Kanghee Park, Jiayu Wang, Taylor Berg-Kirkpatrick +2Constrained Generative ModelingConstrained Decoding

    University of Wisconsin-Madison · University of California San Diego