Language Model-Based Control

Overview

The field studies both how language models can control external systems and how controllers can regulate a model’s own behavior and outputs. Common designs use an LLM for high-level planning, intent interpretation, or code generation, paired with faster controllers such as MPC, reinforcement learning, PID, and deterministic tools; retrieval, world models, and formal safety shields help ground or check proposed actions. Researchers evaluate these systems in settings such as robot manipulation, autonomous driving, traffic signals, networks, HVAC, and software agents, using benchmarks including CARLA, SUMO, LIBERO, nuPlan, and OSWorld as well as some hardware tests. Results show useful planning and adaptation, but reliable deployment remains limited by latency, unsafe or incorrect actions, and gaps between simulation performance and robust real-world control.

Latest papers

CardsList

196 papers20 papers in the last four weeks, down 23% on the four weeks before. 0.2% of all new papers.

  1. Weight-space programming for tractor guidance controller: large language models natively write neural network weights that steer a real tractor

    Nov 16, 2026Timo Oksanenweight-space programmingLanguage Model-Based Control

  2. GainCtrl: Predicting Remaining Gains for Efficient LLM Agent Execution

    Nov 16, 2026Kangwen Zhao, Jianfeng Cai, Ruopei Sun +4LLM Agent EfficiencyLanguage Model-Based Control

  3. Dependable Voice Command for Multi-UAV Swarms Using Small Language Models

    Nov 13, 2026Afshin Ameri, Luiz Giacomossi, Håkan Forsberg +2Language Model-Based ControlMulti-Robot Systems

  4. Large Language Model-Empowered Intelligent Agent for Adaptive Fast-Charging Control of Lithium-Ion Batteries

    Nov 13, 2026Joey Chan, Haoyu Pan, Zhen Chen +1Language Model-Based ControlLithium-Ion Batteries

  5. Keeping LLM Agents on Procedure: Executable Finite-State Control for Long-Horizon Instruction Fidelity

    Nov 7, 2026Yutao Sun, Haokun Li, Mingshuai Chen +4Long-Horizon LLM AgentsLLM Agent Reliability

  6. Continual Instruction Tuning for LLM-based Management of Continuum Resources

    Nov 6, 2026Lanpei Li, Antonino Vaccarella, Vincenzo Lomonaco +1Language Model-Based ControlInstruction Tuning

  7. Mind Control of LLMs via Closed-Loop Stimulation: Out-of-Distribution Robustness

    Nov 4, 2026Kasra Fallah, Rudramani Singha, Hannah Ghanei +3Language Model SteeringLanguage Model Robustness

  8. Jev with Foresight: Safe Language-Guided Autonomous Driving via a Language World Model

    Nov 3, 2026Yansong Qu, Jiancong Chen, Samuel LabiAutonomous DrivingAutonomous Driving Planning

  9. OperAItor: An Agentic Framework for Fault-Tolerant Operation of Chemical Processes

    Nov 3, 2026Javal Vyas, Mehmet Mercang{ö}zLanguage Model-Based ControlProcess-Based Agent Evaluation

  10. REA: A Routed Embodied Agent Runtime for Asynchronous Brain-Cerebellum Control

    Oct 30, 2026Pengfei Zhou, Yixing Ma, Zhengfeiyang Zhang +5Robotic ControlLanguage Model-Based Control

  11. CLIC: Closed-Loop Intent Consistency for Securing LLM-Driven Control in Open RAN

    Oct 29, 2026Sunder Ali Khowaja, Kapal Dev, Joongheon Kim +2Language Model-Based ControlPrompt Injection Attacks on LLMs

  12. TaskFrame: Connecting Task-Level Planning with Frame-Level Control for Game Agents

    Oct 29, 2026Guangzhi Wang, Junfu Pu, Yiran Wang +10Game-Playing AgentsLanguage Model-Based Control

  13. Profiling a Frontier Agent with EBench: From Direct Control to Harness with Policy

    Oct 26, 2026Yifei Yao, Yude Zou, Guanbo Jiao +12Language Model-Based ControlRobotic Policy Evaluation

  14. Adaptive Control of Scientific Instruments with Nonstationary Responses through Multimodal Agents

    Oct 23, 2026Guoyang Shi, Hongwen Li, Yiding Yu +6Adaptive ControlLanguage Model-Based Control

  15. Compiling Autoregressive LLM Control into Policy-Exact Parallel Inference for Hierarchical RAG

    Oct 22, 2026Zehao Lin, Qianfeng Shen, Xixuan Hao +8Language Model-Based ControlEfficient Language Model Inference

  16. Self-Improving Agents with World Model Predictive Paths

    Oct 20, 2026Haori Lu, Tianyu Gao, Yaoyao Liu +1Self-Improving AgentsLLM Agent Planning

  17. RealControlBench: A Benchmark for Interpretability-Informed Fine-Grained Control of LLMs and Agents

    Oct 19, 2026Xinying Cai, Bin Hu, Mingyu Jin +16Language Model SteeringLanguage Model-Based Control

  18. The Bitter Lesson Comes to Robotics

    Oct 18, 2026Christopher Leet, Achyutha Menon, Sravanthi Machcha +3Language Model-Based ControlRobotic Manipulation

  19. Blackbox Performance Analysis of LLM-based Network Control

    Oct 17, 2026Mahdi Alizadeh, Pooria Namyar, Arvin Ghavidel +1Black-Box Model AuditingLanguage Model-Based Control

  20. LocalIntent: Outcome-Specific Structured Generation for Backend-Compatible Smart Building Automation with Local LLMs

    Oct 16, 2026Tianyang Liu, Jiayue Wang, Zhanhao Cheng +4LLM PromptingLanguage Model-Based Control

  21. X-RIC: An Agentic RAN-Intelligent Controller Benchmark for Enhancing Reinforcement Learning

    Oct 15, 2026Adhwaa Al-Chaab, Ayman Younis, Dario PompiliNetwork SlicingAgentic RL

  22. DeciCAD: Harness-Grounded Learning of Action Policies for CAD Agents

    Oct 15, 2026Yufeng Peng, Yixin Zhang, Ziyi Liu +5LLM Agent HarnessesLanguage Model-Based Control

  23. Multi-System Cognitive Steering for Generative Communication

    Oct 13, 2026Eric Lacosse, Pablo Tano, Daniel C. McNameeLanguage Model SteeringLanguage Model-Based Control

  24. Learning Adaptive Deliberation Control for Reliable Recognition with Multi-Agent Language Models

    Oct 13, 2026Yuan Liu, Haoyue Peng, Fanliang Hu +2Multi-Agent DeliberationMulti-Agent Debate