Language Model Safety Evaluation

Follow this topic Ask about this topic

Momentum

30 papers in the last four weeks, up 58% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 347

All topics

AVISE: Framework for Evaluating the Security of AI Systems
Apr 22, 2026Mikko Lempinen, Joni Kemppainen, Niklas RaesalmiLanguage Model Safety Evaluation Adversarial Attacks on LLMs
University of Oulu
Breaking Bad: Interpretability-Based Safety Audits of State-of-the-Art LLMs
Apr 22, 2026Krishiv Agarwal, Ramneet Kaur, Colin Samplawski +6Language Model Safety Evaluation LLM Auditing
University of Florida · SRI
HarDBench: A Benchmark for Draft-Based Co-Authoring Jailbreak Attacks for Safe Human-LLM Collaborative Writing
Apr 21, 2026Euntae Kim, Soomin Han, Buru ChangLLM Safety Benchmarks Language Model Safety Evaluation
Korea University · Sogang University
Harmful Intent as a Geometrically Recoverable Feature of LLM Residual Streams
Apr 20, 2026Isaac Llorente-SaguerLanguage Model Safety Evaluation LLM Interpretability
Independent Researcher
An Empirical Study of Multi-Generation Sampling for Jailbreak Detection in Large Language Models
Apr 20, 2026Hanrui Luo, Shreyank N GowdaLanguage Model Safety Evaluation LLM Auditing
School of Computer Science, University of Nottingham, Nottingham, United Kingdom.
LLM Safety From Within: Detecting Harmful Content with Internal Representations
Apr 20, 2026Difan Jiao, Yilun Liu, Ye Yuan +4Language Model Safety Evaluation LLM Guardrails
University of Toronto · LMU Munich · McGill University
Different Paths to Harmful Compliance: Behavioral Side Effects and Mechanistic Divergence Across LLM Jailbreaks
Apr 20, 2026Md Rysul Kabir, Zoran TiganjLanguage Model Safety Evaluation LLM Interpretability
Department of Computer Science Luddy School of Informatics, Computing, and Engineering Indiana University Bloomington
Reverse Constitutional AI: A Framework for Controllable Toxic Data Generation via Probability-Clamped RLAIF
Apr 20, 2026Yuan Fang, Yiming Luo, Aimin Zhou +1Language Model Safety Evaluation Adversarial Scenario Generation
East China Normal University, Shanghai, China · Shanghai Innovation Institute, Shanghai, China
The Granularity Gap: A Multi-Dimensional Longitudinal Audit of Sycophancy in Gemini Models
Apr 19, 2026Patrick KeoughLLM Sycophancy LLM Alignment
Independent Researcher Bremerton, WA, USA
Please refuse to answer me! Mitigating Over-Refusal in Large Language Models via Adaptive Contrastive Decoding
Apr 18, 2026Yupeng Qi, Ziyu Lyu, Lixin Cui +2Language Model Safety Evaluation LLM Refusal Behavior
School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University · School of Information, Central University of Finance and Economics · School of Artificial Intelligence, Beijing Normal University +1
Do LLMs Hold Their Values? MANTA: A Multi-Turn Adversarial Benchmark for Animal Welfare Reasoning
Apr 18, 2026Isabella Luong, Joyee Chen, Arturs Kanepajs +5LLM Evaluation Moral Reasoning in Language Models
SPAR · Compassion Aligned Machine Learning · NUS +2
Jailbreaking Large Language Models with Morality Attacks
Apr 18, 2026Ying Su, Mingen Zheng, Weili Diao +1Moral Reasoning in Language Models Language Model Safety Evaluation
South China University of Technology1 · HKUST2 · Beihang University3
Evaluating Multimodal LLMs for Inpatient Diagnosis: Real-World Performance, Safety, and Cost Across Ten Frontier Models
Apr 18, 2026Bruce A. Bassett, Amy Rouillard, Sitwala Mundia +8Language Model Safety Evaluation Healthcare
School of Computer Science and Applied Mathematics, University of the Witwatersrand, Johannesburg, South Africa · Wits MIND Institute, University of the Witwatersrand, Johannesburg, South Africa · Grai Labs, Cape Town, South Africa +3
SafeDream: Safety World Model for Proactive Early Jailbreak Detection
Apr 18, 2026Bo Yan, Weikai Lin, Yada Zhu +1Language Model Safety Evaluation World Models
University of Central Florida · University of Rochester · IBM Research
Benign Fine-Tuning Breaks Safety Alignment in Audio LLMs
Apr 17, 2026Jaechul Roh, Virat Shejwalkar, Amir HoumansadrLanguage Model Safety Evaluation LLM Fine-Tuning
University of Massachusetts Amherst
MCBench: A Multicontext Safety Assessment Benchmark for Omni Large Language Models
Apr 17, 2026Manh Luong, Tamas Abraham, Junae Kim +6LLM Safety Benchmarks Language Model Safety Evaluation
Monash University, Australia · Defence Science and Technology Group, Australia
TWGuard: A Case Study of LLM Safety Guardrails for Localized Linguistic Contexts
Apr 17, 2026Hua-Rong Chu, Kuan-Chun Wang, Yao-Te HuangLanguage Model Safety Evaluation LLM Guardrails
Chunghwa Telecom Laboratories
Context Over Content: Exposing Evaluation Faking in Automated Judges
Apr 16, 2026Manan Gupta, Inderjeet Nair, Lu Wang +1LLM-as-a-Judge Language Model Safety Evaluation
1BITS Pilani, India · University of Michigan
VoxSafeBench: Not Just What Is Said, but Who, How, and Where
Apr 16, 2026Yuxiang Wang, Hongyu Liu, Yijiang Xu +9Language Model Safety Evaluation Privacy Leakage in Language Models
1The Chinese University of Hong Kong, Shenzhen · 2Shenzhen Loop Area Institute · 3Amphion Technology Co., Ltd.
Kill-Chain Canaries: Stage-Level Tracking of Prompt Injection Across Attack Surfaces and Five Production LLMs
Mar 30, 2026Haochuan Kevin Wang, Zechen ZhangMulti-Agent LLM Systems Language Model Safety Evaluation
Massachusetts Institute of Technology · University of Chicago
How Utilitarian Are OpenAI's Models Really? Replicating and Reinterpreting Pfeffer, Krügel, and Uhl (2025)
Mar 24, 2026Johannes HimmelreichPrompt Sensitivity Moral Reasoning in Language Models
The Hidden Puppet Master: Predicting Human Belief Change in Manipulative LLM Dialogues
Mar 21, 2026Jocelyn Shen, Amina Luvsanchultem, Jessica Kim +6Opinion Dynamics Language Model Safety Evaluation
Massachusetts Institute of Technology, Cambridge, MA, USA · Carnegie Mellon University, Pittsburgh, PA, USA
Risk-Adjusted Harm Scoring for Automated Red Teaming for LLMs in Financial Services
Mar 11, 2026Fabrizio Dimino, Bhaskarjit Sarmah, Stefano PasqualiLanguage Model Safety Evaluation LLM Safety
1Domyn, New York, US · 2Domyn, New York, US · 3Domyn, New York, US
AdaCultureSafe: Adaptive Cultural Safety Grounded by Cultural Knowledge in Large Language Models
Mar 9, 2026Hankun Kang, Di Lin, Zhirong Liao +6Language Model Safety Evaluation Cultural Knowledge in Language Models
School of Computer Science, Wuhan University, China · Tsinghua University, China · Jiangxi University of Finance and Economics, China
MUSE: A Run-Centric Platform for Multimodal Unified Safety Evaluation of Large Language Models
Mar 3, 2026Zhongxi Wang, Yueqian Lin, Jingyang Zhang +3LLM Safety Benchmarks Language Model Safety Evaluation
1Duke University · 2Virtue AI
NEST: Nascent Encoded Steganographic Thoughts
Feb 15, 2026Artem KarpovLanguage Model Safety Evaluation LLM Auditing
Independent.
AI Chatbot Suicide Risk Detection and Response: Human Validation Study of the Open-Source VERA-MH Safety Evaluation
Feb 4, 2026Kate H. Bentley, Luca Belli, Adam M. Chekroud +7Language Model Safety Evaluation Human-AI Agreement
Spring Health · UC Berkeley · Yale University
CoT is Not the Chain of Truth: An Empirical Internal Analysis of Reasoning LLMs for Fake News Generation
Feb 4, 2026Zhao Tong, Chunlin Gong, Yiping Zhang +5Language Model Safety Evaluation LLM Interpretability
Institute of Information Engineering, Chinese Academy of Sciences · School of Cyber Security, University of Chinese Academy of Sciences · Shanghai AI Laboratory +3
SalamahBench: Dialect and Category Level Safety Evaluation of Arabic Language Models
Feb 3, 2026Omar Abdelnasser, Fatemah Alharbi, Khaled Khasawneh +2LLM Safety Benchmarks Multilingual Language Model Evaluation
Compumacy for Artificial Intelligence Solutions, Cairo, Egypt · Computer Science Department, College of Computer Science and Engineering, Taibah University, Yanbu 46522, KSA · Electrical and Computer Engineering Department, George Mason University, VA, USA +2
VoxPrivacy: A Benchmark for Evaluating Interactional Privacy of Speech Language Models
Jan 27, 2026Yuxiang Wang, Hongyu Liu, Dekun Chen +2Privacy-Preserving Language Models Language Model Safety Evaluation
The Chinese University of Hong Kong, Shenzhen · Shenzhen Loop Area Institute · Amphion Technology Co., Ltd. +1

Apr 22, 2026, cs.CRJ/K move · Enter open · S save

AVISE: Framework for Evaluating the Security of AI Systems

Mikko Lempinen, Joni Kemppainen, Niklas Raesalmi

University of Oulu

Language Model Safety Evaluation Adversarial Attacks on LLMs LLM Security LLM Jailbreak Attacks

Open paper AskPDF arXiv

As artificial intelligence (AI) systems are increasingly deployed across critical domains, their security vulnerabilities pose growing risks of high-profile exploits and consequential system failures. Yet systematic approaches to evaluating AI security remain underdeveloped. In this paper, we introduce AVISE (AI Vulnerability Identification and Security Evaluation), a modular open-source framework for identifying vulnerabilities in and evaluating the security of AI systems and models. As a demonstration of the framework, we extend the theory-of-mind-based multi-turn Red Queen attack into an Adversarial Language Model (ALM) augmented attack and develop an automated Security Evaluation Test (SET) for discovering jailbreak vulnerabilities in language models. The SET comprises 25 test cases and an Evaluation Language Model (ELM) that determines whether each test case was able to jailbreak the target model, achieving 92% accuracy, an F1-score of 0.91, and a Matthews correlation coefficient of 0.83. We evaluate nine recently released language models of diverse sizes with the SET and find that all are vulnerable to the augmented Red Queen attack to varying degrees. AVISE provides researchers and industry practitioners with an extensible foundation for developing and deploying automated SETs, offering a concrete step toward more rigorous and reproducible AI security evaluation.

Momentum

Related topics

Latest papers 347