LLM Safety Evaluation

LLM: Large Language Model

Overview

The field tests whether language models refuse harmful requests, handle benign sensitive tasks helpfully, and remain safe when prompts, context, or tools change. Common approaches include fixed safety benchmarks, adversarial red-teaming and jailbreak testing, multi-turn agent simulations, domain-specific scenarios, and automated or human judging. Researchers increasingly measure more than refusal rates or attack success, including harm severity, omissions, false refusals, reasoning and tool-use failures, and effects on users. A central challenge is that results can shift with benchmark design, evaluation conditions, and judge choice, while stronger safeguards may reduce helpfulness and static tests may not predict behavior in deployment.

Latest papers

CardsList

278 papers25 papers in the last four weeks, up 9% on the four weeks before. 0.2% of all new papers.

  1. Context-Aware Classification and Grading of Sensitive Information in Online Conversational Health Data

    Dec 25, 2025Yiwei Yan, Guanfeng LiuHealthcareText Classification

  2. Learning-Based Automated Adversarial Red-Teaming for Robustness Evaluation of Large Language Models

    Dec 21, 2025Zhang Wei, Hanxuan Chen, Peilu Hu +19Adversarial Robustness of Language ModelsLLM Safety Evaluation

  3. SoK: Systematizing LLM Prompt Security: Taxonomies, Datasets, and Unified Evaluation of Attacks and Defenses

    Oct 17, 2025Hanbin Hong, Shuang Wu, Shuya Feng +6LLM SecurityLLM Jailbreak Attacks

  4. SafetyFlow: An Agent-Flow System for Automated LLM Safety Benchmarking

    Aug 21, 2025Xiangyang Zhu, Yuan Tian, Chunyi Li +3LLM Safety BenchmarksSynthetic Benchmark Generation

  5. HarmReduction: Benchmarking LLMs in Harm Reduction Information Provision to Support People Who Use Drugs

    Jul 29, 2025Kaixuan Wang, Chenxin Diao, Jason T. Jacques +2HealthcareQuestion Answering

  6. GuidedBench: Measuring and Mitigating the Evaluation Discrepancies of In-the-wild LLM Jailbreak Methods

    Feb 24, 2025Ruixuan Huang, Xunguang Wang, Zongjie Li +2Language Model Safety EvaluationLLM Jailbreak Attacks

  7. Towards the Worst-case Robustness of Large Language Models

    Jan 31, 2025Huanran Chen, Zeming Wei, Yao Huang +2Adversarial Robustness of Language ModelsAdversarial Attacks on LLMs

  8. CASE-Bench: Context-Aware SafEty Benchmark for Large Language Models

    Jan 24, 2025Guangzhi Sun, Xiao Zhan, Shutong Feng +2LLM Safety BenchmarksLanguage Model Safety Evaluation