AI Agent Reliability

Ask about this topic

Momentum

34 papers in the last four weeks, up 240% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 215

All topics
CardsList

  1. AgentCheck: A Reproduce-Intervene-Mitigate Workbench for LLM Agents over MCP

    Jul 13, 2026Aritra Mazumder, Nusrat jahan LiaAI Agent ReliabilityLLM Agent Evaluation

    University of Utah · University of Dhaka

  2. To Answer or to Abstain: Mitigating Search-Agent Hallucinations via Abstention-Aware Reinforcement Learning

    Jul 12, 2026Fengji Zhang, Tianyu Fan, Yuxiang Zheng +4AI Agent ReliabilityLLM Hallucination Mitigation

    City University of Hong Kong · Alibaba Group

  3. Confining Nondeterminism: AI-Driven Research Systems as DBMSs for Reliable, Non-Wasteful, Transparent, and Collaborative Research [Vision]

    Jul 11, 2026Kyoungmin Kim, Anastasia AilamakiAI Agent ReliabilityAutonomous Research Agents

    EPFL Lausanne, Switzerland

  4. Compaction as Epistemic Failure: How Agentic LLM Tools Fabricate Confirmed Results from Killed Processes

    Jul 11, 2026Hiroki TambaAI Agent ReliabilityLLM Agent Memory

    Independent Researcher

  5. AgentAbstain: Do LLM Agents Know When Not to Act?

    Jul 11, 2026Xun Liu, Yi Evie Zhang, Vira Kasprova +5AI Agent ReliabilityLLM Agent Evaluation

    University of Illinois Urbana-Champaign

  6. Scoped Verification for Reliable Long-Horizon Agentic Context Evolution under Distribution Shift

    Jul 10, 2026Dan C. Hsu, Luke LuAI Agent ReliabilityLong-Horizon Agent Evaluation

    RedMind Research, San Francisco, CA, USA · National Taiwan University, Taipei, Taiwan

  7. Agent Delivery Engineering Predictive Reliability Framework

    Jul 8, 2026Dexing LiuAI Agent ReliabilityMulti-Agent LLM Systems

    Shanghai Qijing Digital Technology Co., Ltd · Shanghai Qijing Digital Technology Co., Ltd.

  8. Reason Less, Verify More: Deterministic Gates Recover a Silent Policy-Violation Failure Mode in Tool-Using LLM Agents

    Jul 8, 2026Vikas Reddy, Sumanth Reddy Challaram, Abhishek BasuAgent Failure AnalysisAI Agent Reliability

    Independent Researcher · Indian Institute of Technology Kharagpur Kharagpur, India · Massachusetts Institute of Technology Cambridge, USA

  9. Agentic Data Environments

    Jul 8, 2026Elaine Ang, Chenxi Huang, Georgios Liargkovas +13AI Agent ReliabilityAI Agent Safety

    Columbia University

  10. Beyond the Leaderboard: A Synthesis of Tool-Use, Planning, and Reasoning Failures in Large Language Model Agents

    Jul 7, 2026Wael Albayaydh, Rui Zhao, Ivan FlechaisAI Agent ReliabilityLLM Agent Evaluation

    University of Oxford

  11. ToolFailBench: Diagnosing Tool-Use Failures in LLM Agents

    Jul 6, 2026Harsh SoniAI Agent ReliabilityTool-Use Evaluation

    UC Berkeley

  12. The "I Don't Know" Filter: Enhancing Agentic Reliability in Function Calling

    Jul 4, 2026Stefan Broecker, Mason del Rosario, Boris Selitser +1AI Agent ReliabilityLLM Agent Evaluation

    University of California, Davis, Department of Computer Science · Okareo, Inc. · University of California, Davis, Department of Mathematics

  13. The Remarkable Effectiveness of Providing AI Agents with Natural Language Tools: A Replication Study Validating NLT Performance Across 14 Models

    Jul 4, 2026Alexander Somma, Isabelle Plante, Fred PremjiAI Agent ReliabilityLLM Agent Evaluation

    Sage.is AI-UI

  14. Reasoning effort, not tool access, buys first-try reliability in agentic code generation: an observational study

    Jul 2, 2026Achint MehtaAI Agent ReliabilityTest-Time Scaling

    TrendAI

  15. When the Database Fails: Prompting LLM Dialogue Agents for Safe Recovery in Task-Oriented Dialogue

    Jun 30, 2026Mohammad Alijanpour Shalmani, Alale Rezvani Boroujeni, Jiann Shiun YuanAI Agent ReliabilityLLM Hallucination Mitigation

    College of Engineering and Computer Science, University of Central Florida, Orlando, Florida · Department of Marketing, University of Central Florida, Orlando, Florida

  16. Certified Speculative Execution for Untrusted AI Agents

    Jun 30, 2026Chenyu Zhou, Qiliang Jiang, Shuning Wu +1AI Agent ReliabilityConstrained RL

    School of Engineering, Institute of Science Tokyo, Japan · College of Control Science and Engineering, Zhejiang University, China · Department of Electrical and Computer Engineering, National University of Singapore, Singapore

  17. SEVA: Self-Evolving Verification Agent with Process Reward for Fact Attribution

    Jun 29, 2026Aojie Yuan, Yi Nian, Haiyue Zhang +2AI Agent ReliabilityProcess Reward Models

    University of Southern California, Los Angeles, USA · University of Michigan, Ann Arbor, USA

  18. Budgeted Act-or-Defer Multi-Agent LLM Deliberation with Local Reliability Bounds

    Jun 28, 2026Mengdie Flora Wang, Haochen Xie, Guanghui Wang +2AI Agent ReliabilityMulti-Agent LLM Systems

    1AWS Generative AI Innovation Center, USA · General Motors (GM), USA

  19. Manufactured Confidence: How Memory Consolidation Turns Hearsay into Confident Facts

    Jun 28, 2026Alex KwonAI Agent ReliabilityLLM Agent Memory

    Independent Researcher

  20. Preventing Error Propagation in Multi-Agent AI through Runtime Monitoring

    Jun 27, 2026Shahnewaz Karim Sakib, Anindya Bijoy DasAI Agent ReliabilityMulti-Agent Systems

    University of Tennessee at Chattanooga, TN 37403, USA · The University of Akron, OH 44325, USA

  21. Delayed Verification Destabilizes Multi-Agent LLM Belief: Instability Thresholds and Optimal Corrector Placement

    Jun 25, 2026Igor ItkinAI Agent ReliabilityMulti-Agent Coordination

    Independent Researcher, Tel Aviv, Israel

  22. Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliability

    Jun 24, 2026Yang Tian, Zhengpeng Shi, Yu Zhou +1AI Agent ReliabilityAI Agent Benchmarks

    School of AI, Shanghai Jiao Tong University1 · School of Cyber Science and Engineering, Southeast University2

  23. Position: Correct Answer, Wrong Mechanism -- When AI Scientists Defend General Claims Their Own Data Contradicts

    Jun 22, 2026Steven Young EuligAI Agent ReliabilityReasoning Evaluation

    Department of Physics and Laboratory for Particle Physics and Cosmology (LPPC), Harvard University, Cambridge, MA 02138, USA.

  24. When Agents Commit Too Soon: Diagnosing Premature Commitment in LLM Agents

    Jun 22, 2026Aman MehtaAI Agent ReliabilityLLM Agent Evaluation

    Snowflake AI Research

  25. GroundEval: A Deterministic Replacement for LLM-as-Judge in Stateful Agent Evaluation

    Jun 22, 2026Jeffrey FlyntAI Agent ReliabilityTool-Use Evaluation

    Independent Researcher

  26. RigorBench: Benchmarking Engineering Process Discipline in Autonomous AI Coding Agents

    Jun 21, 2026Meher Bhaskar Madiraju, Meher Sai Preetam MadirajuAI Agent ReliabilityCoding Agents

  27. Grounded Scaling: Why Agentic AI Needs Deterministic Environments

    Jun 21, 2026Liang Ding, Xintong WangAI Agent ReliabilityLong-Horizon Agent Tasks

    1Alibaba Group

  28. OpenBioRQ: Unsolved Biomedical Research Questions for Agents

    Jun 20, 2026Minbyul JeongAI Agent ReliabilityCitation Verification

    Upstage AI

  29. Don't Blindly Trust It: How Unreliable Feedback Breaks Tool-Using LLM Agents

    Jun 19, 2026Chubin Zhang, Zhenglin Wan, Xingrui Yu +5AI Agent ReliabilityTool-Use Evaluation

    Nanyang Technological University, Singapore · National University of Singapore, Singapore · CFAR, Agency for Science, Technology and Research, Singapore +3

  30. EARS: Explanatory Abstention for Reliable Sub-Agent Modeling in Large-scale Multi-Agent Systems

    Jun 17, 2026Shuang Xie, Yunan Lu, Han Li +1AI Agent ReliabilityMulti-Agent LLM Systems

    Shopify · Columbia University