LLM Agent Reliability

LLM: Large Language Model

Ask about this topic

Momentum

90 papers in the last four weeks, up 109% on the four weeks before. 0.9% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 558

All topics
CardsList

  1. CockpitHAT: Dependency-Graph-Driven Hierarchical Attribution for Embodied Multi-Agent Cockpits

    Aug 3, 2026Wei Wang, Shuanghe Liu, Zhu Zhuo +4Agent Failure AnalysisMulti-Agent LLM Systems

    ByteDance

  2. ESCROW: Guarded and Dual-Objective Continual Maintenance for Agents in Policy-Governed Enterprise Workflows

    Aug 3, 2026Ruoqi Shu, Chen Dan, Xuhui Wang +4Continual Learning for LLM AgentsBusiness Process Automation

    BMO Financial Group

  3. Deep Agentic Search for Repository-Level Code Question Answering: An Empirical Study

    Aug 2, 2026Amirkia Rafiei Oskooei, Bora Ilci, Alperen Kayim +5Agentic SearchSemantic Search

    Department of Computer Engineering, Yildiz Technical University, Istanbul, Turkey · Intellica Business Intelligence, Istanbul, Turkey

  4. HopRefusalBench: Diagnosing Refusal Failures in Search-Augmented Agents for Multi-Hop Reasoning

    Aug 2, 2026Jianan Xie, Xin Sun, Zhongqi Chen +3Multi-Hop QAAI Agent Benchmarks

    ShanghaiTech University · NLPR, MAIS, CASIA · Ant Group

  5. Control Under Compression: Reliability Frontiers for Tool-Using Agents

    Aug 2, 2026Yinghan Hou, Zongyou YangAI Agent ReliabilityAI Agent Benchmarks

    Department of Electrical and Electronic Engineering Imperial College London London, United Kingdom · Dyson School of Design Engineering Imperial College London London, United Kingdom

  6. Don't Offer What Can't Be Done: Deterministic Executability Gating for LLM Skill Selection at Scale

    Aug 2, 2026Ortal Ashkenazi, Vitalii Kloz, Mykhailo UlianchenkoLLM Agent Skill RetrievalLLM Agent Reliability

    Wix Israel · Wix Ukraine

  7. You Don't Need To Stay in The Loop: An Agentic Robotics Loop for Robot-Policy Improvement

    Aug 2, 2026Hang YuRobot Policy AdaptationRobotic Policy Evaluation

    Independent Researcher, United States.

  8. Bayesian and Motivated Reasoning in AI Agents

    Jul 31, 2026Eddie YangLLM Decision-MakingAgentic Reasoning

    Purdue University

  9. A Few Neurons Reveal When LLMs Misuse Tools: Sparse Detection and Selective Steering for Reliable Tool Use

    Jul 31, 2026Yutong Ke, Ming Yin, Chongwen Zhao +1LLM InterpretabilityLLM Tool Use

  10. Measuring Cross-Task Behavioral Consistency in Language Model Agents

    Jul 31, 2026Amritesh Banerjee, Pranil RaichuraAI Agent ReliabilitySoftware Engineering Agents

    University of Massachusetts Amherst · Mantis AI Research (MIT CSAIL)

  11. AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?

    Jul 31, 2026Dong Yan, Jian Liang, Dapeng Hu +4LLM Agent EvaluationAI Agent Benchmarks

    School of Artificial Intelligence, University of Chinese Academy of Sciences · Microsoft · Institute of Automation, Chinese Academy of Sciences +1

  12. Verified Tool Calls Improve LLM Agent Reliability Under Non-Atomic Failures

    Jul 31, 2026Isham Kalappurackal Mansoor, Abhishek Phadke, Pratip RanaAI Agent ReliabilityLLM Tool Use

    Department of Computer Science Old Dominion University Norfolk, VA 23529 · School of Engineering and Computing Christopher Newport University Newport News, VA 23606

  13. Validation Evidence in LLM Repair Agents: How Much of What Passes Actually Tests the Bug?

    Jul 30, 2026Xiaonan Xu, Wenjing WuAutomated Software TestingAutomated Program Repair

    College of Computing, Georgia Institute of Technology, Atlanta, GA, 30332, USA. · Department of Computer Science, University of Colorado Boulder, Boulder, CO, 80309, USA.

  14. Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failures

    Jul 30, 2026Harsh Raj, Vipul Gupta, Anas Mahmoud +4Agent Failure AnalysisLLM Agent Evaluation

    Scale AI

  15. ORCA-bench: How Ready Are Language Model Agents for Oncall?

    Jul 30, 2026Albert Gong, Kyuseong Choi, Abhineet Agarwal +5Software Engineering AgentsAI Agent Benchmarks

    Cornell Tech · Traversal · Columbia University

  16. One Human, NN Agents: Audit-Budget Allocation for LLM Agent Fleets under Miscalibrated, Correlated Confidence

    Jul 30, 2026Cesare Zavattari, Alessandro Tommasi, Giuseppe PrencipeScalable OversightAI Agent Reliability

    Dipartimento di Informatica, Università di Pisa, Pisa, Italy

  17. Vibe-FDTR: An agent-oriented framework for reproducible frequency-domain thermoreflectance data analysis

    Jul 30, 2026Fuwei Yang, Weiheng Li, Bai SongLLM Agent Reliability

    National Key Laboratory of Advanced Micro and Nano Manufacture Technology, Peking University, Beijing 100871, China · Center for Nano and Micro Mechanics, Tsinghua University, Beijing 100084, China · Department of Engineering Mechanics, Tsinghua University, Beijing 100084, China +1

  18. ΣΣ-Mem: An Online Reliability Memory for LLM-based Multi-Agent Systems

    Jul 30, 2026Peilin Feng, Suorong Yang, Soujanya PoriaAI Agent ReliabilityMulti-Agent LLM Systems

    1DeCLaRe Lab, Nanyang Technological University

  19. Rehearse: Stepping Back from the Confidence Cliff in Self-Improving Autoresearch

    Jul 30, 2026Jiazhen Ji, Shouhong DingLanguage Model Self-AssessmentAutonomous Experimentation

    Tencent

  20. Leveraging Trajectory Graphs for Pre-Execution Error Diagnosis in Agentic LLM Systems

    Jul 29, 2026Xu Zheng, Zhuomin Chen, Chaohao Lin +4Long-Horizon Agent TasksLong-Horizon LLM Agents

    1Florida International University, Miami, FL, USA · 2Arizona State University, Tempe, AZ, USA · 3NEC Laboratories America, Princeton, NJ, USA +1

  21. LayerRAG-Bench: A Cross-Layer Reliability Benchmark for Agentic Retrieval-Augmented Generation

    Jul 29, 2026Musa ShamsAI Agent ReliabilityRetrieval-Augmented Generation

    Independent Researcher

  22. Can AI agents conduct open-ended AI research? Early evidence from two case studies

    Jul 29, 2026Peter Kirgis, Sayash Kapoor, Andrew Schwartz +21AI-Assisted Scientific ResearchAI Agent Evaluation

    Princeton University · Cornflower Labs · UK AI Security Institute +8

  23. Think Short, Defer Smart, Act, and Repeat: Calibrated Reasoning and Uncertainty-Aware Deferral for Edge LLM Agents

    Jul 29, 2026Amirmohammad Farzaneh, Osvaldo SimeoneLLM Inference EfficiencyAI Agent Reliability

    Institute for Intelligent Networked Systems (INSI) Northeastern University London London, UK

  24. Flat Score, Amplified Failures: How the Error Budget Masks Damage in Quantized LLM Agents

    Jul 29, 2026Jiwon Jang, Kisu Yang, Heuiseok Lim +1AI Agent ReliabilityBenchmark Design

    VAIV Company · Seoul National University · Korea University

  25. When LLM Agents Negotiate: Private Information and Dynamic Bargaining in Supply Chains

    Jul 29, 2026Chen Liang, Fasheng XuMulti-Agent NegotiationAutomated Negotiation

    School of Business, University of Connecticut

  26. SARC-DQ: Runtime Data-Quality Gating for Agentic AI: Silent Evidence Defects, the Incompetence Shield, and Downstream-Only Remediation

    Jul 28, 2026Gaston BesansonAI Agent ReliabilityData Provenance

    Universidad Torcuato Di Tella

  27. COVENANT: Natural-Language Workflow Compilation for Aligned Agent Execution

    Jul 28, 2026Jincheng Wang, Min Zheng, Tao WeiAgentic WorkflowsLLM Agent Harnesses

    Ant Group

  28. HANDBOOK.md: A Benchmark for Long-Context Agentic Instruction Following

    Jul 28, 2026Liudas Panavas, Sebastian Minus, Bradley Monton +4Computer-Use Agent BenchmarksAI Agent Reliability

    Surge AI*

  29. Gubernaut: A Deterministic Homeostatic Controller for Affect-Regulated LLM Agents, Validated Across Independent Model Families

    Jul 27, 2026Dushyant SharmaLanguage Model-Based ControlLLM Agents

    Gubernaut Research

  30. Falsifiable Commitment Planning for Self-Correcting Web Agents

    Jul 27, 2026Guangyi Liu, Huan Zhao, Quanming YaoLong-Horizon LLM AgentsWeb Agents

    1Tsinghua University · 2Noumena AI