LLM Agent Reliability

LLM: Large Language Model

Ask about this topic

Momentum

90 papers in the last four weeks, up 109% on the four weeks before. 0.9% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 558

All topics
CardsList

  1. Diagnosing CFG Interpretation in LLMs

    Apr 22, 2026Hanqi Li, Lu Chen, Kai YuLLM EvaluationIn-Context Learning

    1X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University, Shanghai, China · 3Shanghai Innovation Institution, Shanghai, China · 4Jiangsu Key Lab of Language Computing, Suzhou, China +2

  2. SWE-chat: Coding Agent Interactions From Real Users in the Wild

    Apr 22, 2026Joachim Baumann, Vishakh Padmakumar, Xiang Li +3Coding AgentsHuman-AI Collaboration

    Stanford University

  3. Toward Reliable Design of LLM-Enabled Agentic Workflows: Optimizing Latency-Reliability-Cost Tradeoffs

    Apr 21, 2026Ya-Ting Yang, Quanyan ZhuCost-Aware InferenceAgentic Workflows

    New York University Brooklyn, NY, USA

  4. CogniConsole: Externalizing Inference-Time Control as a Formal Abstraction for Reliable LLM Interactions

    Apr 21, 2026Vanessa Figueiredo, Wilter FranceschiAI Agent ReliabilityLanguage Model-Based Control

    Orbital Sea Regina, SK, Canada

  5. Taming Actor-Observer Asymmetry in Agents via Dialectical Alignment

    Apr 21, 2026Bobo Li, Rui Wu, Zibo Ji +5AI Agent BenchmarksMulti-Agent Reasoning

    National University of Singapore · Sichuan University · University of Minnesota Twin Cities +2

  6. Refute-or-Promote: An Adversarial Stage-Gated Multi-Agent Review Methodology for High-Precision LLM-Assisted Defect Discovery

    Apr 21, 2026Abhinav AgarwalSoftware Vulnerability DetectionLLMs for Cybersecurity

  7. AI scientists produce results without reasoning scientifically

    Apr 20, 2026Martiño Ríos-García, Nawaf Alampara, Chandan Gupta +5AI Agent ReliabilityScientific Reasoning

    Laboratory of Organic and Macromolecular Chemistry (IOMC), Friedrich Schiller University Jena, Humboldstr. 10, 07743 Jena, Germany · Department of Civil Engineering, Indian Institute of Technology Delhi, Hauz Khas, New Delhi 110016, India · School of Interdisciplinary Research, Indian Institute of Technology Delhi, Hauz Khas, New Delhi 110016, India +3

  8. JTPRO: A Joint Tool-Prompt Reflective Optimization Framework for Language Agents

    Apr 20, 2026Sandip Ghoshal, Anshul Mittal, Jyotika Singh +9AI Agent ReliabilityLLM Tool Use

    Oracle AI

  9. Do LLMs Need to See Everything? A Benchmark and Study of Failures in LLM-driven Smartphone Automation using Screentext vs. Screenshots

    Apr 20, 2026Shiquan Zhang, Tianyi Zhang, Le Fang +3Mobile GUI AutomationLLM Agent Evaluation

    School of Computing and Information Systems, University of Melbourne, Melbourne, Australia · School of Computer Science, University of Auckland, Auckland, New Zealand

  10. Towards Self-Improving Error Diagnosis in Multi-Agent Systems

    Apr 19, 2026Jiazheng Li, Emine Yilmaz, Bei Chen +1Multi-Agent LLM SystemsMulti-Agent Systems

    King’s College London · Amazon Alexa AI · University College London

  11. Agents Explore but Agents Ignore: LLMs Lack Environmental Curiosity

    Apr 19, 2026Leon Engländer, Sophia Althammer, Ahmet Üstün +2LLM Agent EvaluationTool-Using Agents

    Cohere · Poolside

  12. Towards Shutdownable Agents: Generalizing Stochastic Choice in RL Agents and LLMs

    Apr 19, 2026Carissa Cullen, Harry Garland, Alexander Roman +3Agent ReliabilityAI Agent Safety

    University of Oxford · University College London · New College of Florida +3

  13. Answer Only as Precisely as Justified: Calibrated Claim-Level Specificity Control for Agentic Systems

    Apr 19, 2026Tianyi Huang, Samuel Xu, Jason Tansong Dang +2Uncertainty CalibrationLLM Agent Reliability

    Ryquo · App-In Club.

  14. Seeing Isn't Believing: Mitigating Belief Inertia via Active Intervention in Embodied Agents

    Apr 19, 2026Hanlin Wang, Chak Tou Leong, Jian Wang +1Embodied AILLM Agent Reliability

    Department of Computing, The Hong Kong Polytechnic University · College of Computer Science, Sichuan University

  15. HiveMind: OS-Inspired Scheduling for Concurrent LLM Agent Workloads

    Apr 18, 2026Justice Owusu Agyemang, Jerry John Kponyo, Obed Kwasi Somuah +3LLM Inference EfficiencyAI Coding Agents

    Sperix Labs · VIA Cybersecurity Lab, KNUST · Quantum and Assistive Technologies Lab, KNUST

  16. Harness as an Asset: Enforcing Determinism via the Convergent AI Agent Framework (CAAF)

    Apr 18, 2026Tianbao ZhangSafety-Critical ControlLLM Guardrails

    Independent Researcher

  17. Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMs

    Apr 17, 2026Eren UnluLLM AgentsLLM Uncertainty Estimation

    Globeholder Paris, France

  18. Don't Start What You Can't Finish: A Counterfactual Audit of Support-State Triage in LLM Agents

    Apr 17, 2026Eren UnluLLM Agent EvaluationLLM Refusal Behavior

    Globeholder Paris, France

  19. When Agents Go Quiet: Output Generation Capacity and Format-Cost Separation for LLM Document Synthesis

    Apr 17, 2026Justice Owusu Agyemang, Michael Agyare, Miriam Kobbinah +2LLM Inference EfficiencyLong-Form Document Generation

    Sperix Labs · GCTU, Ghana · NCA, Ghana +1

  20. Evaluating Tool-Using Language Agents: Judge Reliability, Propagation Cascades, and Runtime Mitigation in AgentProp-Bench

    Apr 17, 2026Bhaskar GurramAI Agent ReliabilityTool-Augmented Language Model Agents

    Zasti Inc., Ashburn, VA, USA

  21. Weak-Link Optimization for Multi-Agent Reasoning and Collaboration

    Apr 17, 2026Haoyu Bian, Chaoning Zhang, Jiaquan Zhang +4Multi-Agent CollaborationInference-Time Compute Allocation

    University of Electronic Science and Technology of China, Chengdu 611731, China · Beihang University, Beijing 100191, China · Xi’an University of Architecture and Technology, Xi’an 710064, China

  22. LLMs Corrupt Your Documents When You Delegate

    Apr 17, 2026Philippe Laban, Tobias Schnabel, Jennifer NevilleLLM ReliabilityLong-Horizon LLM Agents

    Microsoft Research

  23. Confident and Wrong: Silent Semantic Failures in Coding Agents

    Mar 26, 2026Aman MehtaAI Agent ReliabilityAI Coding Agents

    Snowflake AI Research

  24. RetailBench: Evaluating Long-Horizon Autonomous Decision-Making and Strategy Stability of LLM Agents in Realistic Retail Environments

    Mar 17, 2026Linghua Zhang, Jun Wang, Jingtong Wu +1Long-Horizon Agent EvaluationAI Agent Benchmarks

    Ant Group · City University of Hong Kong

  25. MOOSEnger: A Simulation-Aware AI Agent Framework for the MOOSE Ecosystem

    Mar 5, 2026Mengnan Li, Jason Miller, Zaid Abulawi +7AI Agent ReliabilityAgentic Code Generation

    Idaho National Laboratory, 995 MK Simpson Blvd, Idaho Falls, 83401, ID, USA

  26. A Dual-Helix Governance Approach Towards Reliable Agentic Artificial Intelligence for WebGIS Development

    Mar 4, 2026Boyuan Guan, Wencong Cui, Levente JuhaszSoftware Engineering AgentsAI Coding Agents

    Geographic Information Systems Center, Florida International University, Miami, FL, USA · Geospatial Analytics, Technology and Open Research Lab, University of Florida, Fort Lauderdale, FL, USA

  27. MASRubric: Auditing Information Flow in Multi-Agent Systems with Failure-Distilled Pitfall Rubrics

    Feb 26, 2026Yutong Wang, Siyuan Xiong, Xuebo Liu +4Agent Failure AnalysisMulti-Agent Systems

    Harbin Institute of Technology, Shenzhen · Alibaba Group

  28. When Agents Disagree With Themselves: Behavioral Consistency as an Uncertainty Signal for LLM Agents

    Feb 12, 2026Aman MehtaAI Agent ReliabilitySelective Prediction

    Snowflake AI Research

  29. When Is Enough Not Enough? Illusory Completion in Search Agents

    Feb 7, 2026Dayoon Ko, Jihyuk Kim, Sohyeon Kim +5AI Agent ReliabilityLLM Answer Verification

    Seoul National University · LG AI Research · University of Illinois Chicago

  30. Replayable Financial Agents: A Determinism-Faithfulness Assurance Harness for Tool-Using LLM Agents

    Jan 17, 2026Raffi KhatchadourianAI Agent ReliabilityLLM Agent Evaluation

    IBM Financial Services Market, New York, NY, USA