AI Agent Reliability

Ask about this topic

Momentum

34 papers in the last four weeks, up 278% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 213

All topics
CardsList

  1. A Case Study in Assuring AI-Written Software

    Oct 6, 2026Lindsey Ferris, Sierra BonillaAI Agent ReliabilityAI Assurance

    Independent Researcher · University College London London, United Kingdom

  2. AgentSpy: Making AI Agent Behavior Observable

    Oct 5, 2026Christoph Bühler, Matteo Biagiola, Luca Di Grazia +1AI Agent ReliabilityAI Agent Auditing

    University of St. Gallen, St. Gallen, SG, Switzerland · University of St. Gallen and Università della Svizzera italiana (USI), St. Gallen and Lugano, SG and TI, Switzerland

  3. UndoBench: Separating Task Competence from Recovery Capability in Tool-Using AI Agents

    Oct 4, 2026Dolly Sah, Tanmay Sah, Harshul Jain +1Agent Failure AnalysisAI Agent Reliability

    Independent Researcher

  4. AECG: Asymmetric Experience Consolidation and Governance In Multi-Agent Systems

    Oct 4, 2026Ao Tian, Jialong Liu, Daqi Zheng +7AI Agent ReliabilityMulti-Agent LLM Systems

    Beihang University · Wuhan University · ModelBest +1

  5. Agents Are Systems, Not Models: Rethinking Agentic Evaluation

    Oct 1, 2026Luis Wiedmann, Leander Girrbach, Cordelia Schmid +1AI Agent ReliabilityAI Agent Evaluation

    Technical University of Munich, MCML · Helmholtz Munich · Inria, École normale supérieure, CNRS, PSL Research University

  6. Right Answers, Wrong States: Hidden Information Failures in Multi-Agent Collaboration

    Oct 1, 2026Herun Wan, Jiaying Wu, Minnan Luo +4AI Agent ReliabilityMulti-Agent Collaboration

    Xi’an Jiaotong University · National University of Singapore · Yunnan University +1

  7. YouRA: A Persistent-State Architecture for Evidence-Traceable Autonomous Research Agents

    Oct 1, 2026Yoonkyu Woo, Woojin Lee, Jin-Xia HuangAI Agent ReliabilityAI Agents for Scientific Discovery

    Electronics and Telecommunications Research Institute, Republic of Korea · Department of Artificial Intelligence, University of Science and Technology, Republic of Korea

  8. Empty Commitments: When Agents Promise What Their Runtime Cannot Deliver

    Oct 1, 2026Jiaqi Tang, Lan Wei, Bingyu Shen +1AI Agent ReliabilityLLM Agent Evaluation

    Department of Computer Science and Technology, Kean University, Union, NJ, USA · Independent Researcher

  9. Legal Research Bench: Measuring End-to-End Reliability in Long-Horizon Legal Research Agents

    Sep 30, 2026Katrina Drozdov, Oliver Chen, Langston Nashold +1AI Agent ReliabilityLegal Citation Verification

    Vals AI San Francisco, USA

  10. AgBench: Agentic AI Benchmarks for Personal AI Devices

    Sep 29, 2026Yizhou Han, Di Wu, Dhananjay Saikumar +1AI Agent ReliabilityAI Agent Evaluation

    University of St Andrews, UK · Zhejiang University of Technology, China

  11. The Backdrop Exposes What the World Around an Agent Costs It

    Sep 29, 2026Nusrat Jahan Lia, Shubhashis Roy DiptaAI Agent ReliabilityPrompt Injection Attacks on AI Agents

    University of Dhaka · University of Maryland, Baltimore County

  12. When Tools Silently Lie: Evaluating and Mitigating Blind Compliance in Tool-Augmented Data Agents

    Sep 29, 2026Zifu Tao, Changqing YinAI Agent ReliabilityTool-Use Evaluation

    Tongji University

  13. Reliability Engineering for AI Systems: Challenges, Methods, and Directions

    Sep 28, 2026Rong Pan, Yili Hong, Min XieAI Agent ReliabilityAI Safety Evaluation

    Arizona State University, Tempe, AZ, USA · Virginia Tech, Blacksburg, VA, USA · City University of Hong Kong, Hong Kong

  14. BIABench: Evaluating AI agents on real-world bioimage analysis tasks

    Sep 28, 2026Zixuan Pan, Davide Panzeri, Lukas Johanns +5AI Agent ReliabilityAI Agent Evaluation

    Department of Computer Science and Engineering, University of Notre Dame, Notre Dame, USA · Leibniz-Institut für Analytische Wissenschaften – ISAS – e.V., Dortmund, Germany · Institute of Computer Science, University of Tartu, Tartu, Estonia

  15. DISCERN: Can AI Agents Work Like Scientists and Guide Discovery?

    Sep 27, 2026Nan Huang, Mario Tapia-Pacheco, Kun Zhou +4AI Agent ReliabilityScientific Hypothesis Generation

    University of California San Diego · Independent Researcher

  16. CORTEX: A Verified Experience Layer for Generalist Agents

    Sep 27, 2026Garapati Keerthana, Manik GuptaAI Agent ReliabilityLifelong Learning Agents

    Birla Institute of Technology and Science, Pilani, Hyderabad, India

  17. Between the Commits: Process, Error, and Claim Reliability in a Wholly AI-Authored Codebase

    Sep 24, 2026Douglas LeithAI Agent ReliabilityData Provenance

    Trinity College Dublin Dublin, Ireland

  18. AquaMend: Minimal Re-probing and Conditional Rollback for Latent-Belief Failures in Embodied Agents

    Sep 24, 2026Yufan Liu, Shang Luo, Yang Liu +9Belief-Space PlanningAI Agent Reliability

    University College London · Peking University · School of Electrical and Electronic Engineering, Nanyang Technological University +4

  19. Reliability Theory for AI Control

    Sep 22, 2026Grant MolnarAI Agent ReliabilityAI Control

    Google DeepMind

  20. Governed AI-Agent Coordination for Dementia Care: Architecture, Safety Contracts, and Evidence-Derived Workflow Verification

    Sep 22, 2026Francesca Medda, Hui GongAI Agent ReliabilityHealthcare

    UCL Institute of Finance and Technology University College London London, United Kingdom

  21. Risk-Aware Online Conformal State Probing

    Sep 22, 2026Pietro Talli, Petar Popovski, Osvaldo SimeoneAI Agent ReliabilityConformal Prediction

    Institute for Intelligent Networked Systems, Northeastern University London · Connectivity Section, Department of Electronic Systems, Aalborg University

  22. Quantifying Overclaiming Propensity in Frontier LLM Agents

    Sep 17, 2026Nolan Smyth, Yorguin-Jose Mantilla-Ramos, Pascal Jr Tikeng Notsawo +6AI Agent ReliabilityAI Coding Agents

    Tara Research · Mila – Quebec AI Institute · Cohere

  23. Neuro-Symbolic Agentic AI for Networked Low-Altitude UAVs

    Sep 17, 2026Yuqi Ping, Tianhao Liang, Nanchi Su +4AI Agent ReliabilityAerial Robotics

    College of Informatics, Harbin Institute of Technology, Shenzhen 518000, China

  24. Securing quantum error correction against misleading advice from AI agents

    Sep 16, 2026A. Barış ÖzgülerAI Agent ReliabilityQuantum Error Correction

  25. A Study of the Reliability of Agentic AI-Generated Programs

    Sep 16, 2026Ayesha Shafique, Barton P. MIller, Elisa R. HeymannAI Agent ReliabilityAgentic Code Generation

  26. Locating Hidden Failures Makes Long-Horizon Agents More Reliable

    Sep 15, 2026Salman Rahman, Yubin Kim, Mihir Parmar +15Agent Failure AnalysisAI Agent Reliability

    University of California, Los Angeles · New York University · Google Research +1

  27. ERPBench: A State-Grounded Evaluation Paradigm for Computer-Use Agents in Enterprise Software

    Sep 15, 2026Kratika Bhagtani, Kusha Sridhar, Maziyar Baran Pouyan +2Computer-Use Agent BenchmarksAI Agent Reliability

    Center for Advanced AI, Accenture

  28. Agentic Societies Need a Social Harness

    Sep 15, 2026Tapan Chugh, Vidushi Singh, Krish Jain +2AI Agent ReliabilityMulti-Agent System Security

    University of Washington Seattle, Washington, USA

  29. Guardrailed Meta-Agent Loops: Stress-Testing Policy Pinning, Budget Bounds, and Crash Recovery

    Sep 14, 2026Qinzhen Ma, Jialin WuAgent Failure AnalysisAI Agent Reliability

    Rice University · University of California, San Diego

  30. Reality Is the Final Verifier: On Two Key Gaps in Agentic Software Engineering

    Sep 14, 2026Alexander Krentsel, Shubham Agarwal, Mert Cemri +5AI Agent ReliabilitySoftware Engineering Agents

    UC Berkeley

  31. Agent-Integrated Software: Interaction Contracts and Continuous Assurance

    Sep 12, 2026Shengcheng Yu, Chunrong Fang, Zhenyu ChenAI Agent ReliabilityHuman-AI Interaction

    Technical University of Munich, Heilbronn, Germany · State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China

  32. Finishing the Task Is Not Enough: Evaluating Agent Resilience and Considerate Participation under Accumulating Challenge

    Sep 12, 2026Yuanchen Bai, Zijian Ding, Angelique TaylorAI Agent ReliabilityAgent Reliability

    Cornell Tech / Cornell University · University of Maryland, College Park · Korea Advanced Institute of Science and Technology

  33. IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier

    Sep 9, 2026Blake Stenstrom, Charangan Vasantharajan, Brian SathianathanAI Agent ReliabilityBenchmark Auditing

  34. AgentAudit: An Open, Extensible Framework for Full-Lifecycle Trust Evaluation of AI Agents

    Sep 9, 2026Shrey Nag, Sachita, Abhishek Kumar Singh +2AI Agent ReliabilityAI Agent Auditing

    TIET · IGDTUW · GTBIT +1

  35. Vision: Data-Centric Anchoring for Robust and Interpretable Agentic AI

    Sep 8, 2026Arun Vignesh Malarkkan, Xinyuan Wang, Yanjie FuAI Agent ReliabilityDistribution Shift

    School of Computing and Augmented Intelligence, Arizona State University, USA

  36. CIVI: A Framework for Diagnosing Search Agent Failures in Civic Information

    Sep 8, 2026Dingying Liu, Yunshun Zhong, Wentao Zhang +1Agent Failure AnalysisAI Agent Reliability

    University of Sydney · University of Toronto · University of Waterloo +1

  37. Remember and Reweight: Enhancing Multi-Agent Debate with Experience Memory and Confidence Estimation

    Sep 3, 2026Xuanfa Jin, Zhijian Ma, Yongcheng Zeng +3AI Agent ReliabilityMulti-Agent Debate

    Institute of Automation, Chinese Academy of Sciences · University of Chinese Academy of Sciences · University College London

  38. Where Reliability Lives: Experimental Localisation of Behavioural Properties in an Agent System

    Sep 2, 2026Timothy Marsden, Matthew Collecutt, James MarsdenAI Agent ReliabilityAgent-Based Modeling

    Taniwha AI

  39. Epistemic Sybil Resistance: Multiplying AI Agents Without Multiplying Evidence

    Sep 1, 2026Marc BaraAI Agent ReliabilityMulti-Agent LLM Systems

    Universitat Oberta de Catalunya (UOC), Barcelona, Spain

  40. EDGE: Engine for Deterministic Graph Evaluation through Conversation Simulation from Graph Structured DSL Configuration

    Aug 30, 2026Ram Kulathumani, Pushkar Nagar, Regunathan Radhakrishnan +6AI Agent ReliabilityLLM Agent Evaluation

    Salesforce, Palo Alto, USA.

  41. Robustness Analysis of Agentic AI to Inconsistent and Incomplete Tool Responses

    Aug 24, 2026Jiachen Xu, Torben Bach Pedersen, Zhongming Yao +2Agent Failure AnalysisAI Agent Reliability

    Department of Computer Science Aalborg University Aalborg, Denmark · College of Computer Science and Technology Zhejiang University Hangzhou, China · School of Information Science and Engineering Northeastern University Shenyang, China

  42. Agent Behavioral Contracts II: Certifying Compositional Reliability Without Assuming Independence

    Aug 13, 2026Varun Pratap Bhardwaj, Garima Singh, Arun Pratap BhardwajAgent Failure AnalysisAI Agent Reliability

    Qualixar / Independent Researcher, India · Independent Researcher, India

  43. Specification-first convergence with an AI coding agent: a case study of dismantling a core architectural invariant across 189 files in a 717k-line codebase with no test oracle and no human code review

    Aug 12, 2026Joel AbenhaimSoftware EngineeringAI Agent Reliability

    AI Sovereign Labs, Paris, France

  44. Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations

    Aug 11, 2026Vasundra SrinivasanAI Agent ReliabilityAI Agent Evaluation

    Independent Researcher, Stanford School of Engineering

  45. Software Engineering for and with GUI Agent

    Aug 10, 2026Shengcheng Yu, Yuchen Ling, Junyang Xing +3AI Agent ReliabilityGUI Agents

    State Key Laboratory for Novel Software Technology, Nanjing University, China · Technical University of Munich, Germany

  46. CyberAGENTS: Structured Autonomy for Agentic Gamified Learning in Cybersecurity

    Aug 8, 2026Ivan Hornung, Deepthi Marasinghe Arachchige, Tharindu Kumarage +4AI Agent ReliabilityEducational Technology

    Arizona State University · Amazon AGI

  47. When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agents

    Aug 6, 2026Linfang Shang, Ming Xu, Yiding Sun +4AI Agent ReliabilityLLM Agent Skill Learning

    Tencent

  48. OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality

    Aug 5, 2026Yidian Chen, Yingzi Gu, Natan Vidra +2Agent Failure AnalysisAI Agent Reliability

    Anote

  49. SearchAuditor: Auditing and Attributing Failures in Long-Horizon Search Agents

    Aug 5, 2026Zhixiang Liang, Yifei Liu, Yidan Huang +5Agent Failure AnalysisAI Agent Reliability

    University of Illinois Urbana-Champaign · 2Joy Future Academy, JD

  50. SafeCommit: Certifying When Memory-Grounded Agents May Safely Act

    Aug 4, 2026Mayur Akewar, Ravi RanjanAgent MemoryAI Agent Reliability

    Florida International University

  51. Local verification cannot detect non-transportability: a cohomological theory of context preservation in agentic reasoning

    Aug 4, 2026Suyash MishraAI Agent ReliabilityAgentic Reasoning

    AI researcher, Zürich, Switzerland

  52. The LLM Proposes, the Executive Disposes: A Self-Verifying Agent Instrument that Dissociates Commitment Drift from Binding Drift in Long-Horizon Agents

    Aug 4, 2026Mohsen ArjmandiAgent Failure AnalysisAI Agent Reliability

    Independent researcher

  53. Agents Catching Agents: Shortcut Cascades and Benchmark Gaming in Clinical Multi-Agent Systems

    Aug 4, 2026Sebastián Andrés Cajas Ordóñez, Agastya Munnangi, Aldo Marzullo +13AI Agent ReliabilityMulti-Agent LLM Systems

    MIT Critical Data, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States · Georgia State University, Atlanta, Georgia, United States · Politecnico di Milano, Milan, Italy +12

  54. Real-Time Detection and Repair of LLM Agent Failures

    Aug 3, 2026Sunny DubeyAI Agent ReliabilityAI Agent Monitoring

  55. PredAct-Bench: Benchmarking Tool-Augmented Dialogue under Controlled Tool Noise

    Aug 3, 2026Abdulrahman AlRabah, Xiaocheng Yang, Dilek Hakkani-Tür +1AI Agent ReliabilityAI-Assisted Decision Making

    University of Illinois Urbana-Champaign

  56. Control Under Compression: Reliability Frontiers for Tool-Using Agents

    Aug 2, 2026Yinghan Hou, Zongyou YangAI Agent ReliabilityAI Agent Benchmarks

    Department of Electrical and Electronic Engineering Imperial College London London, United Kingdom · Dyson School of Design Engineering Imperial College London London, United Kingdom

  57. DiffuseAgent-MI: Distributionally-Grounded,Tool-Integrated Self-Evolving Agents for Faithful Visual Reasoning

    Aug 1, 2026An Lanji, Dawei Liu, Jin Li +3AI Agent ReliabilityVLM Interpretability

    University of Electronic Science and Technology of China, Chengdu, China.

  58. Measuring Cross-Task Behavioral Consistency in Language Model Agents

    Jul 31, 2026Amritesh Banerjee, Pranil RaichuraAI Agent ReliabilitySoftware Engineering Agents

    University of Massachusetts Amherst · Mantis AI Research (MIT CSAIL)

  59. Verified Tool Calls Improve LLM Agent Reliability Under Non-Atomic Failures

    Jul 31, 2026Isham Kalappurackal Mansoor, Abhishek Phadke, Pratip RanaAI Agent ReliabilityLLM Tool Use

    Department of Computer Science Old Dominion University Norfolk, VA 23529 · School of Engineering and Computing Christopher Newport University Newport News, VA 23606

  60. InfraBench: Evaluating Infrastructure Agents Across Layers, Lifecycle, and Risk

    Jul 31, 2026Yuan Gao, Zeren Yang, Junnan Li +6AI Agent ReliabilityAI Agent Evaluation

    Wanxiang · University of Wisconsin–Madison · 2Iowa State University