LLM Agent Harnesses

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

49 papers in the last four weeks, up 88% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 198

All topics

FinHarness: An Inline Lifecycle Safety Harness for Finance LLM Agents
May 26, 2026Haoxuan Jia, Yang Liu, Bin Chong +10AI Agent Reliability LLM Guardrails
Nanyang Technological University · Tsinghua University · Peking University +8
It's Not the Capability: Harness Sensitivity Is Non-Monotone Across LLM Agent Tiers
May 26, 2026Yong-eun ChoAI Agent Reliability LLM Agent Evaluation
KailosLab · Seoul, Republic of Korea
Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents
May 21, 2026Tianshi Xu, Huifeng Wen, Meng LiLLM Agents LLM Agent Harnesses
Peking University
Code as Agent Harness
May 18, 2026Xuying Ning, Katherine Tieu, Dongqi Fu +39LLM Agent Orchestration Long-Horizon LLM Agents
Harnessing LLM Agents with Skill Programs
May 18, 2026Hongjun Liu, Yifei Ming, Shafiq Joty +1LLM Agent Self-Improvement LLM Agent Skill Learning
New York University · Salesforce AI Research
Harnesses for Inference-Time Alignment over Execution Trajectories
May 15, 2026Boyuan Wang, Bochao Li, Minghan Wang +2LLM Planning Agent Harness Optimization
Southern University of Science and Technology
Is Grep All You Need? How Agent Harnesses Reshape Agentic Search
May 14, 2026Sahil Sen, Akhil Kasturi, Elias Lumer +2Agentic Search LLM Agent Evaluation
PricewaterhouseCoopers, U.S.
Harness Engineering as Categorical Architecture
May 12, 2026Bogdan BanuLLM Agent Orchestration LLM Agent Harnesses
WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation
May 11, 2026Shuangrui Ding, Xuanlang Dai, Long Xing +14Computer-Use Agent Benchmarks Tool-Augmented Language Model Agents
1Shanghai AI Laboratory, 2The Chinese University of Hong Kong · 1Shanghai AI Laboratory, 3Fudan University · 1Shanghai AI Laboratory, 4University of Science and Technology of China +8
Continual Harness: Online Adaptation for Self-Improving Foundation Agents
May 11, 2026Seth Karten, Joel Zhang, Tersoo Upaa +5Continual Learning for LLM Agents Game-Playing Agents
Princeton University · ARISE Foundation · Google DeepMind
Workspace Optimization: How to Train Your Agent
May 10, 2026Elad Sarafian, Gal Kaplun, Ron Banner +2Multi-Agent LLM Systems LLM Agent Self-Improvement
NVIDIA · NVIDIA & Technion
Stop Comparing LLM Agents Without Disclosing the Harness
May 7, 2026Yunbei Zhang, Janet Wang, Yingqiang Ge +3LLM Agent Evaluation Long-Horizon Agent Evaluation
Tulane University · Rutgers University · Independent Researcher +1
AgenticRAG: Agentic Retrieval for Enterprise Knowledge Bases
May 7, 2026Susheel Suresh, Hazel Mak, Shangpo Chou +2Tool-Augmented Language Model Agents Agentic Search
Microsoft Corporation
Design Conductor 2.0: An agent builds a TurboQuant inference accelerator in 80 hours
May 6, 2026The Verkor Team, Ravi Krishna, Suresh Krishna +1AI Accelerator Inference Multi-Agent LLM Systems
The Verkor Team
Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses
Apr 28, 2026Jiahang Lin, Shichun Liu, Chengjun Pan +8AI Coding Agents Agent Harness Optimization
Fudan University · Shanghai Qiji Zhifeng Co., Ltd · Peking University
The Last Harness You'll Ever Build
Apr 22, 2026Haebin Seong, Li Yin, Haoran Zhang +1Meta-Learning Agent Harness Optimization
EvoHarnessBench: Can Your Agents Keep Pace with an Evolving Harness?
Date pendingZixuan Ke, Vaidehi Patil, Haizhou Shi +9Continual Learning for LLM Agents LLM Agent Harnesses
Salesforce Research · University of North Carolina at Chapel Hill, conducted this work during an internship at Salesforce Research · University of Wisconsin–Madison +1
Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluation
Date pendingLin Shi (Audrey), Haowei Lin (Audrey), Zixuan Zhu (Audrey) +123LLM Agent Evaluation AI Agent Evaluation

May 26, 2026, cs.CLJ/K move · Enter open · S save

FinHarness: An Inline Lifecycle Safety Harness for Finance LLM Agents

Haoxuan Jia, Yang Liu, Bin Chong, Yingguang Yang+9

Nanyang Technological University · Tsinghua University · Peking University+8

AI Agent Reliability LLM Guardrails LLM Agent Verification AI Agent Monitoring Safety Filtering Runtime Enforcement for AI Agents+4

Open paper AskPDF arXiv

Finance LLM agents must simultaneously block prompt-induced unauthorized actions and approve legitimate multi-step business workflows. However, boundary filters often miss irreversible mid-trajectory tool calls, while post-hoc LLM judges perform auditing only after termination -- too late for intervention and at a computational cost that scales linearly with trace length. We present FinHarness, an inline safety harness that wraps a finance agent end-to-end with three components: a Query Monitor that fuses single-turn intent with cross-turn drift, a Tool Monitor that evaluates each prospective tool call, and a Cascade module that integrates per-step risk and adaptively routes verification between a lightweight and an advanced-tier LLM judge. Fired risk factors are re-injected into the agent input as ex-ante evidence, enabling the agent to refuse, re-plan, or approve on its own. On FinVault, routed FinHarness cuts ASR from 38.3% to 15.0% while largely preserving benign approval (

41.1\% \to 39.3\%

), and uses

4.7\times

fewer advanced-judge calls than an always-advanced ablation.

Momentum

Related topics

Latest papers 198