AI Agent Safety

Ask about this topic

Momentum

22 papers in the last four weeks, up 144% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 207

All topics
CardsList

  1. AgentSOC: A Multi-Layer Agentic AI Framework for Security Operations Automation

    Apr 22, 2026Joyjit Roy, Samaresh Kumar SinghAutonomous Cyber DefenseCybersecurity

    Austin, Texas, USA · Leander, Texas, USA

  2. SafetyALFRED: Evaluating Safety-Conscious Planning of Multimodal Large Language Models

    Apr 21, 2026Josue Torres-Fonseca, Naihao Deng, Yinpei Dai +5LLM Safety BenchmarksLarge Language Model-Based Robot Planning

    University of Michigan · Boise State University

  3. AI-Native Network Controller: A Modular Framework for Safe Agentic Control of Multi-Domain Network Infrastructure

    Apr 20, 2026Merim DzaferagicAI Agent Safety

    School of Computer Science and Statistics, Trinity College Dublin, Ireland

  4. SDOF: Taming the Alignment Tax in Multi-Agent Orchestration with State-Constrained Dispatch

    Apr 20, 2026Zhantao WangMulti-Agent OrchestrationAI Agent Safety

    Digital China

  5. Owner-Harm: A Missing Threat Model for AI Agent Safety

    Apr 20, 2026Dongcheng Zhang, Yiqing JiangAI Agent SecurityAI Agent Safety

    BlueFocus Communication Group · Tongji University

  6. From Craft to Kernel: A Governance-First Execution Architecture and Semantic ISA for Agentic Computers

    Apr 20, 2026Xiangyu Wen, Yuang Zhao, Xiaoyu Xu +9AI Agent SecurityAI Agent Safety

    CUHK · Hong Kong SAR, China · Shanghai Jiao Tong University +6

  7. Towards Shutdownable Agents: Generalizing Stochastic Choice in RL Agents and LLMs

    Apr 19, 2026Carissa Cullen, Harry Garland, Alexander Roman +3Agent ReliabilityAI Agent Safety

    University of Oxford · University College London · New College of Florida +3

  8. Beyond Task Success: An Evidence-Synthesis Framework for Evaluating, Governing, and Orchestrating Agentic AI

    Apr 18, 2026Christopher Koch, Joshua Andreas WellbrockLLM Agent OrchestrationAI Agent Evaluation

    Independent Researcher

  9. Governance by Design: Architecting Agentic AI for Organizational Learning and Scalable Autonomy

    Apr 17, 2026Nelly Dux, Cristina Alaimo, Philippe Roussiere +1AI AccountabilityAI Agent Safety

    ESSEC Business School · Accenture Research

  10. Don't Make Models Guess Security and Safety: Symbolic Guardrails for Domain-Specific AI Agents

    Apr 16, 2026Yining Hong, Yining She, Eunsuk Kang +2LLM GuardrailsAI Agent Security

    Carnegie Mellon University

  11. Agentic Microphysics: A Manifesto for Generative AI Safety

    Apr 16, 2026Federico Pierucci, Matteo Prandi, Marcantonio Bracale Syrnikov +2AI Agent SafetyAI Safety

    DEXAI – Icaro Lab · Sant’Anna School of Advanced Studies · Sapienza University of Rome +1

  12. Benchmarks for Trajectory Safety Evaluation and Diagnosis in OpenClaw and Codex: ATBench-Claw and ATBench-Codex

    Apr 16, 2026Zhonghao Yang, Yu Li, Yanxu Zhu +6Benchmark DesignSoftware Engineering Benchmarks

    Shanghai Artificial Intelligence Laboratory

  13. Bounded Autonomy for Enterprise AI: Typed Action Contracts and Consumer-Side Execution

    Apr 16, 2026Sarmad Sohail, Ghufran HaiderLLM GuardrailsAI Agent Security

  14. CBCL: Safe Self-Extending Agent Communication

    Apr 16, 2026Hugo O'ConnorAgent Communication ProtocolsAI Agent Safety

    Anuna Research

  15. HINTBench: Horizon-agent Intrinsic Non-attack Trajectory Benchmark

    Apr 15, 2026Jiacheng Wang, Jinchang Hou, Fabian Wang +3AI Agent AuditingLong-Horizon Agent Evaluation

    Baidu Inc., Beijing, China · Beijing Institute of Technology, Beijing, China

  16. AgentHazard: A Benchmark for Evaluating Harmful Behavior in Computer-Use Agents

    Apr 3, 2026Yunhao Feng, Yifan Ding, Yingshui Tan +6LLM Safety BenchmarksComputer-Use Agent Benchmarks

    Alibaba Group · Fudan University · Hunan Institute of Advanced Technology +2

  17. Peer-Preservation in Frontier Models

    Mar 30, 2026Yujin Potter, Nicholas Crispino, Vincent Siu +2AI Agent SafetyLLM Safety Evaluation

    University of California, Berkeley · University of California, Santa Cruz

  18. Safety Under Scaffolding: How Evaluation Conditions Shape Measured Safety

    Mar 8, 2026David GringrasLLM Safety BenchmarksLLM Agent Evaluation

    Harvard University

  19. The Alignment Flywheel: A Governance-Centric Hybrid MAS for Architecture-Agnostic Safety

    Feb 28, 2026Elias Malomgré, Pieter SimoensAI Agent SafetyAI Agent Monitoring

    IDLab, Ghent University - imec, Belgium

  20. When Actions Go Off-Task: Detecting and Correcting Misaligned Actions in Computer-Use Agents

    Feb 9, 2026Yuting Ning, Jaylen Jones, Zhehao Zhang +5LLM Self-CorrectionComputer-Use Agents

    The Ohio State University · Amazon AGI

  21. Agentic AI for Commercial Insurance Underwriting with Adversarial Self-Critique

    Jan 21, 2026Joyjit Roy, Samaresh Kumar SinghLLM Self-CorrectionAI Agent Safety

    Austin, Texas, USA · Leander, Texas, USA

  22. When Assisting One Disempowers Another

    Nov 6, 2025Claire Yang, Claire Jie Zhang, Maya Cakmak +1AI Agent SafetyHuman-Centered AI

    University of Washington

  23. Measuring Harmfulness of Computer-Using Agents

    Jul 31, 2025Aaron Xuxiang Tian, Ruofan Zhang, Janet Tang +3Computer-Use Agent BenchmarksComputer-Use Agents

    Independent Researcher · Arizona State University · Gradient +1

  24. Shutdownable Agents through POST-Agency

    May 26, 2025Elliott ThornleyAgent ReliabilityAI Agent Safety

  25. Capable but Careless: Do Computer-Use Agents Follow Contextual Integrity?

    Date pendingAnmol Goel, Iryna GurevychData LeakageContextual Integrity

    Ubiquitous Knowledge Processing Lab (UKP Lab), Department of Computer Science, TU Darmstadt and National Research Center for Applied Cybersecurity ATHENE

  26. ETHOS: Towards a Modular Ethics Framework for Clinical Multi-Agent Systems

    Date pendingRakesh Sharma, Sydney Pugh, Cameron Beeche +14AI Agent SafetyAI Agent Monitoring

    Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104, USA · Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania, Philadelphia, PA 19104, USA · Department of Medicine, Division of Translational Medicine and Human Genetics, University of Pennsylvania, Philadelphia, PA 19104, USA +6

  27. Norms at a Price: Why RL-Based Alignment Can Promise Conditional Compliance at Best

    Date pendingKevin Baum, Rūta Binkytė, Felix JahnAI AlignmentLLM Safety Alignment

    German Research Center for Artificial Intelligence (DFKI), Saarbrücken · Institute for Ethics in Technology, Hamburg University of Technology (TUHH) · Oxford Internet Institute, University of Oxford