Overview

The field combines lifecycle frameworks such as the NIST AI Risk Management Framework and hazard analysis methods like HARA and STPA with threat modeling, red-teaming, statistical certification, and domain-specific testing in areas such as healthcare, finance, and autonomous systems. Researchers use incident databases, risk taxonomies, benchmarks, and deployment simulations to connect system failures to real-world harms, while governance work translates findings into accountability, standards, controls, and incident response. For agentic systems, approaches include least-privilege access, runtime monitoring, limits on delegated authority, cumulative risk budgets, and insurance. Open questions include whether evaluations predict harms in real deployments, how to measure uncertain and system-level effects, and how to balance safeguards with usefulness, fairness, and organizational incentives.

Latest papers

CardsList

108 papers11 papers in the last four weeks, down 27% on the four weeks before. 0.1% of all new papers.

  1. Quantifying Trust: Financial Risk Management for Trustworthy AI Agents

    Apr 5, 2026Wenyue Hua, Tianyi Peng, Chi Wang +4AI Risk ManagementTrust in AI

  2. When AI Gets it Wrong: Reliability and Risk in AI-Assisted Medication Decision Systems

    Apr 1, 2026Khalid Adnan AlsayedClinical Decision SupportAI Risk Management

  3. A federated architecture for sector-led AI governance: lessons from India

    Mar 27, 2026Avinash Agarwal, Manisha J. NeneAI GovernanceAI Risk Management

  4. From the AI Act to a European AI Agency: Completing the Union's Regulatory Architecture

    Mar 24, 2026Georgios PavlidisAI GovernanceAI Risk Management

  5. An Agentic Multi-Agent Architecture for Cybersecurity Risk Management

    Mar 20, 2026Ravish Gupta, Saket Kumar, Shreeya Sharma +2CybersecurityAI Risk Management

  6. Soft-Label Governance for Distributional Safety in Multi-Agent Systems

    Mar 19, 2026Aizierjiang Aiersilan, Raeli SavittAI Agent GovernanceAI Risk Management

  7. Safety Case Patterns for VLA-based driving systems: Insights from SimLingo

    Mar 16, 2026Gerhard Yu, Fuyuki Ishikawa, Oluwafemi Odu +1Autonomous Driving Safety EvaluationAutonomous Driving

  8. When AI Fails, What Works? A Data-Driven Taxonomy of Real-World AI Risk Mitigation Strategies

    Mar 4, 2026Evgenija Popchanovska, Ana Gjorgjevikj, Maryan Rizinski +3AI Risk Management

  9. Measuring AI R&D Automation

    Mar 4, 2026Alan Chan, Ranay Padarath, Joe Kwon +2AI Risk ManagementHuman Oversight of AI

  10. Quantifying Automation Risk in High-Automation AI Systems: A Bayesian Framework for Failure Propagation and Optimal Oversight

    Feb 22, 2026Vishal Srivastava, Tanmay SahAI Risk ManagementHuman Oversight of AI

  11. A Patient Simulation Framework for Risk Assessment of Conversational Healthcare AI: Evaluation of an Antidepressant Decision Aid

    Feb 11, 2026Md Tanvir Rouf Shawon, Mohammad Sabik Irbaz, Hadeel R. A. Elyazori +6AI Risk ManagementHealthcare

  12. From Silos to Systems: Process-Oriented Hazard Analysis for AI Systems

    Oct 29, 2024Shalaleh Rismani, Roel Dobbe, AJung MoonAI Risk ManagementAI Safety