LLM Agent Orchestration

LLM: Large Language Model

Ask about this topic

Overview

LLM agent orchestration studies how to organize language models, tools, and specialized agents into systems that can solve tasks requiring multiple steps. Common approaches include sequential and hierarchical pipelines, graph-based workflows, parallel delegation, adaptive routing, and plan–execute–reflect loops, with memory and verification used to manage state and catch errors. Work is evaluated on tasks such as coding, web research, tool use, and domain workflows, using measures that include success, cost, latency, and reliability. A central open tension is that added coordination can improve difficult tasks but also increase cost and failure opportunities, and its benefits depend on the model, task structure, and quality of execution controls.

Latest papers

CardsList

463 papers61 papers in the last four weeks, up 74% on the four weeks before. 0.4% of all new papers.

  1. Can AI Models Direct Each Other? Organizational Structure as a Probe into Training Limitations

    Mar 27, 2026Rui LiuMulti-Agent CodingLLM Agent Orchestration

    Independent Researcher

  2. GISclaw: A Comprehensive Open-Source LLM Agent System for Realistic Multi-Step Geospatial Analysis

    Mar 27, 2026Jinzhen Han, JinByeong Lee, Yuri Shim +2Geospatial Reasoning BenchmarksGeospatial Reasoning

    Department of Civil, Architectural & Environment Engineering, Sungkyunkwan University, Suwon, South Korea · Ministry of the Interior and Safety, South Korea · School of Geography, University of Leeds, United Kingdom +1

  3. AutoB2G: Agentic Simulation and Reinforcement Learning for Spatio-Temporal Grid-Interactive Building Control

    Mar 27, 2026Borui Zhang, Nariman Mahdavi, Subbu Sethuvenkatraman +1LLM Agent OrchestrationPower Systems

    University of New South Wales Sydney, NSW, Australia · CSIRO Newcastle, NSW, Australia

  4. Natural-Language Agent Harnesses

    Mar 26, 2026Linyue Pan, Lexiao Zou, Shuo Guo +2LLM Agent HarnessesLLM Agent Orchestration

    Shenzhen International Graduate School, Tsinghua University · Harbin Institute of Technology (Shenzhen)

  5. Agent Factories for High Level Synthesis: How Far Can General-Purpose Coding Agents Go in Hardware Optimization?

    Mar 26, 2026Abhishek Bhandwaldar, Mihir Choudhury, Ruchir Puri +1Electronic Design AutomationMulti-Agent Coding

    IBM Corporation

  6. Training LLMs for Multi-Step Tool Orchestration with Constrained Data Synthesis and Graduated Rewards

    Mar 25, 2026Cheng Jiayang, Xin Liu, Zhihan Zhang +8LLM Agent OrchestrationRL for Tool Use

    Amazon Services Inc., Palo Alto, CA, USA. · Department of Computer Science and Engineering, HKUST, Hong Kong SAR, China. · School of Computational Science and Engineering, Georgia Institute of Technology, Atlanta, GA, USA.

  7. Empirical Comparison of Agent Communication Protocols for Task Orchestration

    Mar 24, 2026Ivan DobrovolskyiAgent Communication ProtocolsLLM Agent Orchestration

    Independent Researcher, Sunnyvale, CA, USA

  8. Benchmarking Multi-Agent LLM Architectures for Financial Document Processing: A Comparative Study of Orchestration Patterns, Cost-Accuracy Tradeoffs and Production Scaling Strategies

    Mar 24, 2026Siddhant Kulkarni, Yukta KulkarniMulti-Agent LLM SystemsLLM Agent Orchestration

    Department of Computer Science and Engineering, New York University, New York, NY 10012

  9. From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents

    Mar 23, 2026Ling Yue, Kushal Raj Bhandari, Ching-Yun Ko +6LLM Agent Workflow OptimizationAgentic Workflows

    Department of Computer Science, Rensselaer Polytechnic Institute, Troy, NY 12180 USA · IBM Research, Yorktown Heights, NY 10598 USA · Department of Mechanical, Aerospace, and Nuclear Engineering, Rensselaer Polytechnic Institute, Troy, NY 12180 USA

  10. Utility-Guided Agent Orchestration for Efficient LLM Tool Use

    Mar 20, 2026Boyan Liu, Gongming Zhao, Hongli XuLLM Agent OrchestrationLLM Tool Use

    University of Science and Technology of China, Hefei, Anhui, China · Suzhou Institute for Advanced Research, University of Science and Technology of China

  11. kRAIG: A Natural Language-Driven Agent for Automated DataOps Pipeline Generation

    Mar 19, 2026Rohan Siva, Kai Cheung, Lichi Li +1Workflow AutomationTool-Augmented Language Model Agents

    Cisco

  12. A Trace-Based Assurance Framework for Agentic AI Orchestration: Contracts, Testing, and Governance

    Mar 18, 2026Ciprian Paduraru, Petru-Liviu Bouruc, Alin StefanescuAI Agent ReliabilityLLM Agent Orchestration

    University of Bucharest Romania · University of Bucharest & Institute for Logic and Data Science Romania

  13. Interpretable Context Methodology: Folder Structure as Agentic Architecture

    Mar 17, 2026Jake Van Clief, David McDermottLLM Agent OrchestrationLLM Agents

    Eduba, University of Edinburgh, Palm Coast, Florida, USA

  14. HearthNet: Edge Multi-Agent Orchestration for Smart Homes

    Mar 16, 2026Zhonghao Zhan, Krinos Li, Yefan Zhang +1LLM Agent OrchestrationInternet of Things

    Imperial College London, London, UK · Independent Researcher, Seattle, USA

  15. A Two-Dimensional Framework for AI Agent Design Patterns: Cognitive Function and Execution Topology

    Mar 16, 2026Jia Huang, Joey Tianyi ZhouAI Agent ArchitectureLLM Agent Orchestration

    Agency for Science, Technology and Research (A*STAR), Singapore · Centre for Frontier AI Research (CFAR), A*STAR

  16. FactorSmith: Agentic Simulation Generation via Markov Decision Process Decomposition with Planner-Designer-Critic Refinement

    Mar 15, 2026Ali Shamsaddinlou, Morteza NourelahiAlamdariRobust Partially Observable Markov Decision ProcessesProgram Synthesis

  17. Orla: A Library for Serving LLM-Based Multi-Agent Systems

    Mar 13, 2026Rana Shahout, Hayder Tirmazi, Minlan Yu +1LLM Agent OrchestrationLLM Agent Serving

    Harvard University MA, USA · Boston University MA, USA

  18. NormCode Canvas: Making LLM Agentic Workflows Development Sustainable via Case-Based Reasoning

    Mar 13, 2026Xin Guan, Yunshan Li, Ze WangAgentic WorkflowsLLM Agent Orchestration

    Psylens AI, China · Shenzhen University, China · University College London, United Kingdom

  19. Separating Intelligence from Execution: A Workflow Engine for the Model Context Protocol

    Mar 13, 2026Abhinav Singh ParmarLLM Agent Tool GenerationLLM Agent Orchestration

    A Preprint

  20. Bridging Protocol and Production: Design Patterns for Deploying AI Agents with Model Context Protocol

    Mar 12, 2026Vasundra SrinivasanTool-Using AgentsAI Agent Reliability

  21. When OpenClaw Meets Hospital: Toward an Agentic Operating System for Dynamic Clinical Workflows

    Mar 12, 2026Wenxian Yang, Hanzheng Qiu, Bangqun Zhang +5Workflow AutomationLLM Agent Memory

    Independent Researcher · National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China · Yue’erwan Internet Hospital Co., Ltd. +4

  22. One Supervisor, Many Modalities: Adaptive Tool Orchestration for Autonomous Queries

    Mar 12, 2026Mayank Saini, Arit Kumar BishwasMultimodal AgentsLLM Agent Orchestration

    PwC US

  23. COMPASS: The explainable agentic framework for Sovereignty, Sustainability, Compliance, and Ethics

    Mar 11, 2026Jean-Sébastien Dessureault, Alain-Thierry Iliho Manzi, Soukaina Alaoui Ismaili +3Carbon-Aware ComputingAI Agent Governance

    Mathematics and Computer science, Université du Québec à Trois-Rivières, 3351 Boul. des Forges, Trois-Rivières, G8Z 4M3, Québec, Canada. · LSSI - Laboratory of Signal and System Integration, Electrical and Computer Engineering Department, Université du Québec à Trois-Rivières, 3351 Boul. des Forges, Trois-Rivières, G8Z 4M3, Québec, Canada. · Social Communication Department, Université du Québec à Trois-Rivières, 3351 Boul. des Forges, Trois-Rivières, G8Z 4M3, Québec, Canada. +1

  24. DUCTILE: Agentic LLM Orchestration of Engineering Analysis in Product Development Practice

    Mar 10, 2026Alejandro Pradas-Gomez, Arindam Brahma, Ola IsakssonLLM Agent Orchestration

    Product Development Division, Department of Mechanical Engineering, Chalmers University of Technology, Gothenburg, Sweden · GKN Aerospace Engine Systems, Trollhättan, Sweden

  25. AgentOS: From Application Silos to a Natural Language-Driven Data Ecosystem

    Mar 9, 2026Rui Liu, Tao Zhe, Dongjie Wang +5LLM Agent OrchestrationHuman-AI Interaction

    University of Kansas, Lawrence, USA · Clemson University, Clemson, USA · Arizona State University, Tempe, USA +1

  26. LDP: An Identity-Aware Protocol for Multi-Agent LLM Systems

    Mar 9, 2026Sunil PrakashAgent Communication ProtocolsMulti-Agent LLM Systems

    Indian School of Business, Hyderabad, India

  27. MASEval: Extending Multi-Agent Evaluation from Models to Systems

    Mar 9, 2026Cornelius Emde, Alexander Rubinstein, Anmol Goel +4AI Agent EvaluationAI Agent Benchmarks

    Parameter Lab · University of Oxford · University of Tübingen +4

  28. IronEngine: Towards General AI Assistant

    Mar 9, 2026Xi MoLLM Agent OrchestrationTool-Augmented Language Model Agents

    NiusRobotLab

  29. GraphBit: A Graph-based Agentic Framework for Non-Linear Agent Orchestration

    Mar 8, 2026Yeahia Sarker, Md Rahmat Ullah, Musa Molla +1LLM Agent OrchestrationMulti-Agent Orchestration

    MTSU · InfinitiBit GmbH · Salesforce Research

  30. Quine: Realizing LLM Agents as Native POSIX Processes

    Mar 8, 2026Hao KeLLM Agent OrchestrationLLM Agents

    Independent Researcher, Bloomington, IN, USA