Overview

The field asks how to make AI systems behave reliably, remain controllable, and avoid harms to people and society. Approaches include alignment training, red-teaming and benchmarks, interpretability, formal verification, runtime monitoring, and safety engineering for systems that use tools or act in the physical world. Researchers also study risks in deployment, including misuse, overreliance, organizational failures, and effects on vulnerable users, using methods from human-computer interaction, law, and governance. A central open tension is that strong results on bounded tests do not establish safety in long, changing real-world settings, while comprehensive guarantees for complex systems remain difficult to obtain.

Latest papers

CardsList

134 papers21 papers in the last four weeks, up 62% on the four weeks before. 0.1% of all new papers.

  1. Why Does Agentic Safety Fail to Generalize Across Tasks?

    May 7, 2026Yonatan Slutzky, Yotam Alexander, Tomer Slor +2AI Agent SafetyLLM Agent Safety

  2. Contextual Multi-Objective Optimization: Rethinking Objectives in Frontier AI Systems

    May 5, 2026Jie Zhou, Qin Chen, Liang HeAI AlignmentAI Safety

  3. Brainrot: Deskilling and Addiction are Overlooked AI Risks

    May 5, 2026Ilias Chalkidis, Anders SøgaardAI SafetyResponsible AI

  4. AI Safety as Control of Irreversibility: A Systems Framework for Decision-Energy and Sovereignty Boundaries

    May 2, 2026Wesley Shu, Peng WeiAI ControlAI Governance

  5. A Cellular Doctrine of Morality: Intrinsic Active Precision and the Mind-Reality Overload Dilemma

    May 2, 2026Ahsan AdeelAI Safety

  6. Are we Doomed to an AI Race? Why Self-Interest Could Drive Countries Towards a Moratorium on Superintelligence

    May 2, 2026Edward Roussel, Lode Lauwaert, Torben Swoboda +4AI GovernanceAI Safety

  7. Open Problems in Frontier AI Risk Management

    Apr 28, 2026Marta Ziosi, Miro Plueckebaum, Stephen Casper +26AI Risk ManagementAI Governance

  8. Risk Reporting for Developers' Internal AI Model Use

    Apr 27, 2026Oscar Delaney, Sambhav Maheshwari, Joe O'Brien +2AI Risk ManagementAI Governance

  9. Agentic Microphysics: A Manifesto for Generative AI Safety

    Apr 16, 2026Federico Pierucci, Matteo Prandi, Marcantonio Bracale Syrnikov +2AI Agent SafetyAI Safety

  10. Risk-Calibrated Learning: Minimizing Fatal Errors in Medical AI

    Apr 14, 2026Abolfazl Mohammadi-Seif, Ricardo Baeza-YatesMedical Image ClassificationAI Safety

  11. Incompleteness of AI Safety Verification via Kolmogorov Complexity

    Apr 6, 2026Munawar HasanKolmogorov ComplexityFormal Verification

  12. Automated Analysis of Global AI Safety Initiatives: A Taxonomy-Driven LLM Approach

    Apr 4, 2026Takayuki Semitsu, Naoto Kiribuchi, Kengo ZenitaniAI Safety

  13. From High-Dimensional Spaces to Verifiable ODD Coverage for Safety-Critical AI-based Systems

    Apr 2, 2026Thomas Stefani, Johann Maximilian Christensen, Elena Hoemann +2AI SafetyFormal Verification

  14. TSHA: A Benchmark for Visual Language Models in Trustworthy Safety Hazard Assessment Scenarios

    Mar 31, 2026Qiucheng Yu, Ruijie Xu, Mingang Chen +2VLM EvaluationVLM Robustness

  15. Peer-Preservation in Frontier Models

    Mar 30, 2026Yujin Potter, Nicholas Crispino, Vincent Siu +2AI Agent SafetyLLM Safety Evaluation

  16. Safety in Embodied AI: A Survey of Risks, Attacks, and Defenses

    Mar 28, 2026Xiao Li, Xiang Zheng, Yifeng Gao +35Embodied AIAI Safety

  17. Trust or Check? Understanding the (Evolutionary) Dynamics of User Trust in AI Systems

    Mar 25, 2026Adeela Bashir, Zhao Song, Ndidi Bianca Ogbo +21Trust in AIHuman Oversight of AI

  18. AI Psychosis: Does Conversational AI Amplify Delusion-Related Language?

    Mar 20, 2026Soorya Ram Shimgekar, Vipin Gunda, Jiwon Kim +3Mental Health Conversational AgentsAI Safety

  19. Consequentialist Objectives and Catastrophe

    Mar 16, 2026Henrik Marklund, Alex Infanger, Benjamin Van RoyAI SafetyAI Alignment

  20. Bridging the Gap in the Responsible AI Divides

    Mar 15, 2026Bálint Gyevnár, Atoosa KasirzadehAI EthicsResponsible AI

  21. Clear, Compelling Arguments: Rethinking the Foundations of Frontier AI Safety Cases

    Mar 8, 2026Shaun Feakins, Ibrahim Habli, Phillip MorganAI SafetyAI Assurance

  22. Shutdown Safety Valves for Advanced AI

    Mar 7, 2026Vincent ConitzerAI SafetyAI Control