LLM Agent Harnesses

LLM: Large Language Model

Overview

An LLM agent harness surrounds a language model with the mechanisms needed to act: tool interfaces, control loops, context and memory management, persistent state, and execution environments. Common approaches include ReAct-style loops, explicit workflow graphs, typed tool contracts, sandboxes, and verification or recovery steps; newer systems also adapt harnesses using execution traces, search, or reinforcement learning. Researchers evaluate these systems on coding, web, terminal, scientific, and interactive tasks, measuring not only success but also cost, reliability, and safety. A central tension is how much structure helps: added guidance can improve control and recovery, yet may constrain useful behavior, fail to transfer across models or tasks, or make comparisons hard to interpret without specifying the harness.

Latest papers

CardsList

389 papers118 papers in the last four weeks, up 103% on the four weeks before. 0.7% of all new papers.

  1. HarnessSafe: Evaluating Safety Across Persistent Carriers in Agent Harnesses

    Aug 7, 2026Xiao Zhang, Yusheng Wang, Yuhao Fei +5AI Agent SecurityAI Agent Safety Benchmarks

  2. SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries

    Aug 6, 2026Xingyu Tan, Xiaoyang Wang, Qing Liu +4LLM Agent Skill RetrievalLLM Agent Harnesses

  3. Skill-Use: Can LLMs Actually Use Skills in Agentic Harnesses?

    Aug 5, 2026Jinyi Han, Yuanjian Xu, Ying Liao +6LLM Agent EvaluationLLM Agent Skill Retrieval

  4. OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agents

    Aug 4, 2026Jingsheng Zheng, Xinyuan Fang, Jintian Zhang +3LLM Agent MemoryLong-Horizon Agent Evaluation

  5. Formal Verification of Agentic Systems over Operational Data

    Aug 4, 2026Alejandro J. Mercado, Alessio LomuscioFormal VerificationLLM Agent Harnesses

  6. Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectories

    Aug 3, 2026Shuai Shao, Kangning Zhang, Qingyao Li +7Agent Harness OptimizationLLM Agent Self-Improvement

  7. Homebot: A Personal AI Agent for Conversational Home Assistance and Automation

    Aug 3, 2026Shengyuan Ye, Yixin Zhang, Han Liang +3Tool-Augmented Language Model AgentsTool-Using Agents

  8. Towards the Harness of Embodied Agents

    Aug 3, 2026Qi Wang, Tianyi Wang, Chengyang Li +6Tool-Using AgentsLong-Horizon Agent Tasks

  9. HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnesses

    Aug 3, 2026Luan Zhang, Ruochen Zhou, Dandan Song +9Agent Harness OptimizationLLM Agents

  10. Constructing Executable Analytical Knowledge Representations for Meta-Analysis Synthesis Using an Agentic Harness

    Aug 3, 2026Lingbo Li, Anuradha Mathrani, Teo SusnjakAI-Assisted Scientific ResearchKnowledge Representation

  11. GABench: A Comprehensive Benchmark for Evaluating LLM Agents on Graph Analysis Tasks

    Aug 3, 2026Jiarui Tan, Zhongjian Zhang, YaBo Guo +5LLM Agent EvaluationAI Agent Benchmarks

  12. FinanceHarness: Autonomous Financial Deep Research Framework

    Jul 30, 2026Yijia Xiao, Rujun Han, Yanfei Chen +8Deep Research AgentsFinancial Forecasting

  13. Harness-G: A Graph-Structured Harness for Search Agents

    Jul 30, 2026Yanning Hou, Haoyuan Chen, Sihang Zhou +7RL for LLM AgentsCredit Assignment in RL

  14. DREvo: Distilling Recalibrated Historical Experience for Harness Self-Evolution

    Jul 29, 2026Hanghui Guo, Weijie Shi, Zhangze Chen +6Agent Harness OptimizationLLM Agent Harnesses

  15. Filesystem-Based Memory for LLM Agents: Organization, Evolution, and Sustainability

    Jul 29, 2026Sizhe Zhou, Sheldon Yu, Hui Wei +8Agent MemoryLLM Agent Memory

  16. Living-Harness Is an Interactive-Agent Evolver

    Jul 29, 2026Yuetian Du, Yucheng Wang, He Xu +9AI Agent ReliabilityAgent Harness Optimization

  17. Distributing Security Controls Through Harness Engineering

    Jul 28, 2026William Robert GoreAI Agent SecurityLLM Agent Security

  18. CogEEGAgent: Toward Autonomous Cognitive EEG Analysis with Grounded Execution and Selection-Aware Verification

    Jul 27, 2026Dengzhe Hou, Lingyu Jiang, Fangzhou Lin +1ElectroencephalographySelective Inference

  19. SIREN: Towards End-to-End Extreme-Weather Early Warning with Experience-Grounded LLM Agents

    Jul 27, 2026Hang Ni, Weijia Zhang, Fan Liu +2AI Agent BenchmarksExtreme Weather Forecasting

  20. SpecBox: Speculative Sandbox Scheduling for Efficient LLM Agent Serving

    Jul 27, 2026Yihui Zhang, Tianyu Wo, Jinghao Wang +7LLM Inference EfficiencyLLM Agent Serving

  21. OpenForgeRL: Train Harness-native Agents in Any Environment

    Jul 23, 2026Xiao Yu, Baolin Peng, Ruize Xu +7Computer-Use AgentsLLM Agent Training

  22. HARP: The Human--AI Research Platform

    Jul 22, 2026Zeshu Zhu, Natalie Friedman, Kevin Weatherwax +1Human-in-the-Loop EvaluationHuman-AI Interaction

  23. NVIDIA-labs OO Agents: Native Python Object-Oriented Agents

    Jul 22, 2026Paul Furgale, Severin Klingler, James Nolan +12LLM Agent OrchestrationTool-Using Agents