Overview

The field combines lifecycle frameworks such as the NIST AI Risk Management Framework and hazard analysis methods like HARA and STPA with threat modeling, red-teaming, statistical certification, and domain-specific testing in areas such as healthcare, finance, and autonomous systems. Researchers use incident databases, risk taxonomies, benchmarks, and deployment simulations to connect system failures to real-world harms, while governance work translates findings into accountability, standards, controls, and incident response. For agentic systems, approaches include least-privilege access, runtime monitoring, limits on delegated authority, cumulative risk budgets, and insurance. Open questions include whether evaluations predict harms in real deployments, how to measure uncertain and system-level effects, and how to balance safeguards with usefulness, fairness, and organizational incentives.

Latest papers

CardsList

108 papers11 papers in the last four weeks, down 27% on the four weeks before. 0.1% of all new papers.

  1. Agentic Hazard Mapper: Emulating Expert Map-Making with AI Agents for Risk Communication

    Oct 23, 2026Sidi Wu, Lifeng Lin, Yizi Chen +2Data VisualizationAgentic Workflows

  2. AI Risk Ontologies for the EU AI Act Compliance: AIRO, VAIR, and their Integration with DPV

    Oct 22, 2026Delaram Golpayegani, Harshvardhan J. Pandit, Declan O'Sullivan +1AI Risk ManagementAI Regulatory Compliance

  3. Assessing the Empirical Evidence for Loss of Control from Agentic General-Purpose AI

    Oct 18, 2026Risto Uuk, Santeri Koivula, Lorenzo Pacchiardi +3AI Agent SafetyAI Safety

  4. LatentRiskBench: Measuring State-Dependent Risks in Enterprise Agents

    Oct 13, 2026Jingyue Cong, Estrid He, Zhuang Li +5AI Agent SafetyAI Safety Evaluation

  5. agent-risk: Risk Assessment for Changes to AI Agents

    Oct 12, 2026Yue Zhao, Zixiang Xu, Angela Huyue Zhang +2AI Risk ManagementAI Agent Safety

  6. ParanoiaEval: Benchmarking Unnecessary Defensive Work in Agentic Coding

    Oct 6, 2026Hanjun Luo, Xiucheng Zhang, Zhuoning Xu +4AI Coding AgentsAI Risk Management

  7. Systemization of Knowledge (SoK): Human-Centered AI Safety for Youth

    Oct 6, 2026Pratyasha Saha, Yaman Yu, Yang WangAI Risk ManagementAI Safety Evaluation

  8. How Could AI Eliminate Humanity? A Failure-Mode Analysis of Civilizational Risk

    Oct 6, 2026Mikołaj Sienicki, Krzysztof SienickiAI SafetyAI Risk Management

  9. Reward Hacking and Agent Containment Failure: A Monte Carlo Study Based on the 2026 Hugging Face Incident

    Sep 26, 2026Murat Ozer, Bulent Erenay, Ibrahim BerberAI Agent SecurityAI Agent Safety

  10. Small-world Networks of Agents Brainstorm AI Risks to Support Ideation

    Sep 21, 2026Ke Zhou, Edyta Bogucka, Daniele QuerciaAI Risk ManagementHuman-in-the-Loop AI

  11. SAFARI: An Industrial Benchmark for LLM-Assisted Hazard Analysis and Risk Assessment

    Sep 17, 2026Chenxi Wu, Zimu Wang, Haiyang Zhang +2LLM Safety BenchmarksAI Risk Management

  12. Disrupted Companionship: A Risk Assessment Framework and Cross-Platform Quantitative Analysis of Psychosocial Responses to AI Companion Disruptions

    Sep 15, 2026Chau Do, Yunhao Yuan, Koustuv Saha +2AI Risk ManagementAI Companions

  13. Mapping U.S. Federal AI Governance Against Sector Vulnerability

    Sep 14, 2026Ho Ting Hung, Angelica Chowdhury, James Teague +5AI GovernanceAI Risk Management

  14. A Decision-Support Audit Protocol for Supervision Drift in Proxy-Labeled Credit-Risk Prediction

    Sep 14, 2026Mehrdad Shoeibi, Muhammad Shabanpour, Waldemar Karwowski +1AI Risk ManagementAlgorithmic Auditing

  15. Design of a Deep Learning Credit Risk Early Warning System Integrating Multi-source Heterogeneous Data

    Sep 14, 2026LiYang Wang, Zhen Zhong, Zhen Tian +2AI Risk ManagementCredit Scoring

  16. From Legal Text to AI-specific Risk Sources: A Systematic Analysis of the EU AI Act's High-Risk Requirements

    Sep 11, 2026Ronald Schnitzer, Mike Auer, Rumpa Choudhury +5AI GovernanceAI Risk Management

  17. The Normalization of Deviance in AI Development

    Sep 4, 2026Emilio Barkett, Alexander Kimpton, Daniel Graham +1AI SafetyAI Risk Management

  18. Why Better Models Can Create Riskier Systems: Evidence from LLM Agents in Financial Markets

    Sep 3, 2026Jillian Ross, Eric So, Zoe De Simone +2Multi-Agent LLM SystemsAI Risk Management

  19. Reducing Catastrophic Risk from AI with Systematic Monitoring and Evaluation of Rogue AI Progression

    Sep 2, 2026T. Bauer, W. P. Kegelmeyer, E. Begoli +15AI Risk ManagementAI Safety Evaluation

  20. The Irreversibility Budget: Fleet-Level Risk Accounting and Admission Control for Agent Operating Systems

    Aug 31, 2026Bardia Mohammadi, Laurent BindschaedlerAI Risk ManagementRuntime Enforcement for AI Agents

  21. AI Morbidity and Mortality: A Framework for Clinical AI Failure Review

    Aug 31, 2026Paulius Mui, Dean F. Sittig, Steve Labkoff +1AI Risk ManagementAI Safety

  22. Applications of Risk Science to AI Fairness Evaluation: Principles, Challenges, and Best Practices

    Aug 30, 2026Kyra Wilson, Sabrina Kang, Saloni Dash +1AI Safety EvaluationAlgorithmic Fairness

  23. Quantifying System-Level Harms from AI Adoption in Complex Sociotechnical Systems

    Aug 24, 2026Paul Vautravers, Oliver Chalkley, Gabriel Downer +2AI Risk ManagementAI Safety Evaluation

  24. SENTRY: Deterministic, Intelligent Risk Assessment for IT Change Management

    Aug 21, 2026Daniel Arulpragasam, Christer Henrysson, Ella Ly +2AI Risk Management

  25. Insurance as AI Risk Infrastructure: A Generative-Agent Simulation of AI Adoption

    Aug 15, 2026Yixuan Yuan, Dedai Wei, Chudong Qian +6Organizational AI AdoptionAI Risk Management