LLM Agent Harnesses

LLM: Large Language Model

Overview

An LLM agent harness surrounds a language model with the mechanisms needed to act: tool interfaces, control loops, context and memory management, persistent state, and execution environments. Common approaches include ReAct-style loops, explicit workflow graphs, typed tool contracts, sandboxes, and verification or recovery steps; newer systems also adapt harnesses using execution traces, search, or reinforcement learning. Researchers evaluate these systems on coding, web, terminal, scientific, and interactive tasks, measuring not only success but also cost, reliability, and safety. A central tension is how much structure helps: added guidance can improve control and recovery, yet may constrain useful behavior, fail to transfer across models or tasks, or make comparisons hard to interpret without specifying the harness.

Latest papers

CardsList

428 papers67 papers in the last four weeks, down 46% on the four weeks before. 0.5% of all new papers.

  1. Agentic Harness Engineering Beta: Requirement-Centered Evolution of Agent Harnesses

    Nov 18, 2026Jiahang Lin, Jiahao Chen, Yiding Wang +11Agent Harness OptimizationAgent Harness Self-Evolution

  2. Reliability by Architecture: Agentic Workflows for Validated Multi-Physics Simulation from Natural Language

    Nov 17, 2026Søren Taverniers, Eric Darve, Hamdi A. TchelepiAgentic WorkflowsLarge Language Model-Based Simulation

  3. RagHarnessDebugger: Jev-Guided Agentic RAG in Contract Inference Repair Auditing

    Nov 17, 2026Moriya Dechtiar, Daniel Martin Katz, Michael J. Bommarito +2Agentic RAGAI Agent Auditing

  4. WebAgents: Unbundling Agent Creation, Hosting, and Execution for an Agent-Native Web

    Nov 16, 2026Dario Fenoglio, Martin Gjoreski, Marc Langheinrich +2Web AgentsAI Agent Interoperability

  5. Harness Leverage Across Model Size: A Ladder of Five Local Agent Harnesses from 0.75B to 4.7B

    Nov 16, 2026Hao Wang, Ting HuangLLM Agent HarnessesAI Agent Benchmarks

  6. Invariant-Aware Harness Enforcement to Protect LLM Agents from Silent API Failures

    Nov 16, 2026Sajib Acharjee Dip, Brian Ouyang, Lala MotlhabiRuntime Enforcement for AI AgentsLLM Agent Harnesses

  7. HydroMind: A Checkable Agent for Autonomous Hydrological Research

    Nov 15, 2026Zheng Fang, Yiqun Sun, Simin Qu +1LLM Agent HarnessesAutonomous Research Agents

  8. ModHarness-RL: Recasting Harnesses as Learnable and Evolving Programs for Agentic RL

    Nov 13, 2026Zelin He, Siyu Zhu, Jacob Helwig +5LLM Agent HarnessesAgent Harness Optimization

  9. DecArena: Evaluating Large-Scale Decentralized Multi-Agent Collaboration

    Nov 11, 2026Jiali Cheng, Oleg Rokhlenko, Joo-Kyung Kim +2Multi-Agent CollaborationAI Agent Benchmarks

  10. EvoX: Rethinking the Agent Harness as a Runtime Policy

    Nov 11, 2026Haoyang Zhang, Qumeng Sun, Xiao Zhang +3LLM Agent HarnessesRuntime Enforcement for AI Agents

  11. From Attack Surface to Defense Architecture: Compositional Security for Agentic Coding Harnesses

    Nov 10, 2026Simon Hegelich, Bardh Prenkaj, Habiba Sarhan +5AI Agent SecurityTool Access Control for LLM Agents

  12. Veritas: A Verifier Generation Harness for Agent Tasks

    Nov 9, 2026Daoan Zhang, Qinbo Bai, Dehai Min +3LLM Agent VerificationAutomated Agent Evaluation

  13. Say Shibboleth: Fingerprinting the LLMs and Harnesses Behind Agentic Attacks

    Nov 9, 2026Dario Pasquini, Reworr, Giuseppe Ateniese +2Language Model FingerprintingAI Agent Security

  14. Reconfigurable Action Theories: A Formal Foundation for Dynamically Composable Agent Harnesses

    Nov 9, 2026Jianmin JiLLM Agent Harnesses

  15. System Optimizations for Cost-Efficient Agent Harnesses

    Nov 9, 2026Jongseok Park, Jiaxiang Yu, Eric Zhou +6Agent Harness OptimizationLLM Agent Harnesses

  16. Harness Matters: Measuring and Dissecting Security Resilience in Web Agents

    Nov 9, 2026Xinyi Wu, Jiagui Chen, JiaYi Dong +5LLM Agent SecurityLLM Agent Harnesses

  17. REINS: A Self-Evolving Agent Harness for Real-Time Trajectory Planning

    Nov 7, 2026Zhihong Cui, Hengyu Liu, Haoran Tang +3LLM Agent PlanningAgent Harness Self-Evolution

  18. When Routine Operations Break Architectural Pattern Relationships in LLM Agent Harnesses

    Nov 6, 2026Boming Xia, Qinghua Lu, Dino Sejdinovic +1LLM Agent HarnessesSoftware Engineering

  19. The Last Mile to the Real World: Agent-Native Primitives as Reusable Building Blocks for Solving Real-World Tasks

    Nov 5, 2026Haibo Jin, Peng Kuang, Xiaopeng Yuan +11LLM Agent HarnessesLLM Agents

  20. HarnessFlow: MCTS-Guided Harness Optimization for LLM Agents

    Nov 4, 2026Zhi Hong, Qianlong Wang, Hongchen Wei +5Agent Harness OptimizationLLM Agent Harnesses

  21. The Harness Is the Model: Agent Scaffolding Changes a Fixed LLM's Compliance with Banking Conduct Rules, Unevenly Across Models

    Nov 4, 2026Mehmet Murat HuyutLLM Agent HarnessesAI Regulatory Compliance