Overview

The field asks how to make AI systems behave reliably, remain controllable, and avoid harms to people and society. Approaches include alignment training, red-teaming and benchmarks, interpretability, formal verification, runtime monitoring, and safety engineering for systems that use tools or act in the physical world. Researchers also study risks in deployment, including misuse, overreliance, organizational failures, and effects on vulnerable users, using methods from human-computer interaction, law, and governance. A central open tension is that strong results on bounded tests do not establish safety in long, changing real-world settings, while comprehensive guarantees for complex systems remain difficult to obtain.

Latest papers

CardsList

134 papers21 papers in the last four weeks, up 62% on the four weeks before. 0.1% of all new papers.

  1. Safe by Benchmark, Unsafe in Practice: Lessons from 1331 Child-Related AI Incidents

    Oct 26, 2026Junfeng Jiao, Kevin Chen, Shrestha Mishra +4AI SafetyAI Accountability

  2. From Clinical Judgment to Checkable Rules: Clinician-Led Guardrails for Mental-Health Chatbots

    Oct 22, 2026Chenhan Lyu, Kit Wislocki, Sarah Elizabeth Stoeckl +2LLM GuardrailsLLM Safety

  3. COMET: A coordinated multi-layer runtime monitoring framework for human-supervised AI-enabled safety systems

    Oct 21, 2026Niclas Flehmig, Mary Ann Lundteigen, Shen YinAI SafetyAI Agent Monitoring

  4. Humans Correct Their Judgments Through Debate, but Weaker AI Models Do Not

    Oct 20, 2026Maria Victoria Carro, Denise Alejandra Mester, Facundo Nieto +14Multi-Agent DebateHuman Oversight of AI

  5. Fundamental Impossibility Results in AI Safety: Trading Off between Desiderata

    Oct 19, 2026Ida Mattsson, Ratip Emin Berker, Emanuel Tewolde +11AI SafetyInformation Design

  6. Towards Robust Model Organisms for Eliciting Latent Knowledge

    Oct 19, 2026Lennart Finke, Hardik Bhatnagar, Euodia Dodd +4AI SafetyLanguage Model Safety Evaluation

  7. FinSafeGuard: A Quality-Driven Synthetic Dataset for Financial AI Safety

    Oct 19, 2026Joseph Thomas Thacil, Reetu Raj Harsh, Krati Saxena +2Synthetic Data GenerationSynthetic Data Evaluation

  8. Assessing the Empirical Evidence for Loss of Control from Agentic General-Purpose AI

    Oct 18, 2026Risto Uuk, Santeri Koivula, Lorenzo Pacchiardi +3AI Agent SafetyAI Safety

  9. AI Rights with an Off-Switch: Rights-Balancing and Due Process Harmonize AI Rights with AI Safety

    Oct 17, 2026Heather Alexander, Jonathan SimonAI EthicsAI Governance

  10. What Social Media Teaches Us About Accumulative AI Risks

    Oct 15, 2026Dawei Li, Bohan Jiang, Huan LiuAI SafetyLLM Safety

  11. Market Incentives for AI Safety Investment

    Oct 15, 2026Nikita TsoyAI SafetyAI Governance

  12. CompanionSafe: From Multi-turn Safety Evaluation to Guardrails for AI Companions

    Oct 13, 2026Xinyang Liao, Lingyu Li, Kaicheng Shen +4AI SafetyAI Safety Evaluation

  13. Superintelligence and the Triple Risk of an AI Race

    Oct 12, 2026Matthew Rendall, Max Hellrigel-Holderbaum, Leonard DungAI GovernanceArtificial General Intelligence

  14. Beyond the Ergodic Wall: A Discrete Geometric Physics Sandbox for Analysing AI Scaling Limits and Complexity Collapse

    Oct 7, 2026Simon Richard DanielAI Safety

  15. AI Safety Considerations for Agents With Limited Time to Act

    Oct 7, 2026Leo Zeitler, Jack Richings, Victoria NocklesAI Agent SafetyAI Safety

  16. Comprehension Audits to Mitigate Risks from Automated AI Research

    Oct 7, 2026Ronald J. Bodkin, Bahrad A. Sokhansanj, Gillian K. HadfieldHuman Oversight of AIAI Safety

  17. Systemization of Knowledge (SoK): Human-Centered AI Safety for Youth

    Oct 6, 2026Pratyasha Saha, Yaman Yu, Yang WangAI Risk ManagementAI Safety Evaluation

  18. How Could AI Eliminate Humanity? A Failure-Mode Analysis of Civilizational Risk

    Oct 6, 2026Mikołaj Sienicki, Krzysztof SienickiAI SafetyAI Risk Management

  19. Not What a Child Expressed: Auditing the Sign-to-Text Safety Interface in Child-Facing AI

    Oct 5, 2026Muhammad Rafiullah Memon, Viet Vo, Wanlun Ma +1Sign Language TranslationAI Safety Evaluation

  20. What if automating AI R&D triggers an intelligence explosion?

    Sep 28, 2026Alan Chan, Christoph Winter, Andrew Barto +19AI ControlAI Governance

  21. Safety Nudges: User-Facing Interventions for Real-Time AI Risk Awareness

    Sep 22, 2026Varshini Elangovan, James Wedgwood, Chhavi Yadav +3AI Agent SafetyHuman-AI Interaction

  22. The Moral Check: Strategic AI Governance for the Pacing Problem

    Sep 19, 2026Zaid Amin, Rahma Santhi Zinaida, Nazlena Mohamad AliAI GovernanceAI Safety

  23. Artificial intelligence and biosecurity: capabilities, threat pathways, and defense-in-depth governance

    Sep 14, 2026Candace S. Y. Chan, Aris Karatzikos, Ilias Georgakopoulos-SoaresAI SafetyAI Governance

  24. A Responsive Present, a Shared Past, a Social Other: Teens' Overreliance on Companion AI Chatbots

    Sep 13, 2026Mohammad Namvarpour, Tyler Chang, Afsaneh RaziAI CompanionsHuman-AI Interaction

  25. AI Persuasion as a Threat to Human Control

    Sep 13, 2026Joshua Levy, Mick Yang, Kellin PelrineAI ControlAI Governance

  26. LogiScope-VQA: Benchmarking Vision-Language Models for Logistics Hazard Identification in Industrial Scenarios

    Sep 9, 2026Hanjing Zhou, Mingze Yin, Ying Lian +3VLM EvaluationVisual Question Answering