Jailbreak Evaluations

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

2 new papers

A weekly snapshot of new work published in Jailbreak Evaluations.

Period ending 2026-09-14

6 new papers

A weekly snapshot of new work published in Jailbreak Evaluations.

Period ending 2026-09-07

6 new papers

A weekly snapshot of new work published in Jailbreak Evaluations.

Inside this field

Focused directions

Focused topic

Large Language Model Jailbreaks

Within Jailbreak Evaluations

64 papersExplore

Focused topic

Jailbreak Evaluations

Within Jailbreak Evaluations

61 papersExplore

Focused topic

Jailbreaks

Within Jailbreak Evaluations

57 papersExplore

Focused topic

Jailbreak Attacks

Within Jailbreak Evaluations

43 papersExplore

Focused topic

Jailbreak Detection

Within Jailbreak Evaluations

30 papersExplore

Focused topic

Novel Jailbreak Method

Within Jailbreak Evaluations

21 papersExplore

Focused topic

Adversarial Jailbreaks

Within Jailbreak Evaluations

20 papersExplore

184 papers

Latest in Jailbreak Evaluations

Browse all topics →

MT-JailBench: A Modular Benchmark for Understanding Multi-Turn Jailbreak Attacks
May 10, 2026Xinkai Zhang, Zhipeng Wei, Huanli Gong +4Jailbreak Attacks Jailbreak Detection
The Art of the Jailbreak: Formulating Jailbreak Attacks for LLM Security Beyond Binary Scoring
May 9, 2026Ismail Hossain, Tanzim Ahad, Md Jahangir Alam +3Jailbreak Attacks Jailbreaks
Single-Configuration Attack Success Rate Is Not Enough: Jailbreak Evaluations Should Report Distributional Attack Success
May 9, 2026Carsten Maple, Abhishek Kumar, Riya TapwalJailbreak Attacks Jailbreak Evaluations
Internalizing Safety Understanding in Large Reasoning Models via Verification
May 9, 2026Yi Zhang, Yuxin Chen, Leheng Sheng +4Large Reasoning Models Reasoning Trajectory
Why Do Aligned LLMs Remain Jailbreakable: Refusal-Escape Directions, Operator-Level Sources, and Safety-Utility Trade-off
May 9, 2026Yu Chen, Yuanhao Liu, Qi CaoLarge Language Model Jailbreaks Jailbreak Attacks
Not All Turns Matter: Credit Assignment for Multi-Turn Jailbreaking
May 9, 2026Zhida He, Xiaoyu Wen, Han Qi +7Jailbreak Evaluations Credit Assignment
OrchJail: Jailbreaking Tool-Calling Text-to-Image Agents by Orchestration-Guided Fuzzing
May 8, 2026Jianming Chen, Yawen Wang, Junjie Wang +3Jailbreaks Fuzzing
GPO-V: Jailbreak Diffusion Vision Language Model by Global Probability Optimization
May 8, 2026Yu Pan, Andi Zhang, Yi Wang +2Large Language Model Jailbreaks Diffusion Language Models
Mitigating Many-shot Jailbreak Attacks with One Single Demonstration
May 8, 2026Kejia Chen, Jiawen Zhang, Boheng Li +6Jailbreak Attacks Jailbreak Evaluations
Hard to Read, Easy to Jailbreak: How Visual Degradation Bypasses MLLM Safety Alignment
May 8, 2026Zhixue Song, Boyan Han, Yiwei Wang +1Large Language Model Safety Large Vision Language Models
A Systematic Investigation of RL-Jailbreaking in LLMs
May 7, 2026Montaser Mohammedalamen, Kevin Roice, Reginald McLean +1Large Language Model Jailbreaks Jailbreak Evaluations
How Many Iterations to Jailbreak? Dynamic Budget Allocation for Multi-Turn LLM Evaluation
May 7, 2026Shai Feldman, Yaniv RomanoJailbreak Evaluations Jailbreaks
Conceal, Reconstruct, Jailbreak: Exploiting the Reconstruction-Concealment Tradeoff in MLLMs
May 7, 2026Md Farhamdur Reza, Richeng Jin, Tianfu Wu +1Large Language Model Jailbreaks Jailbreak Attacks
XL-SafetyBench: A Country-Grounded Cross-Cultural Benchmark for LLM Safety and Cultural Sensitivity
May 7, 2026Dasol Choi, Eugenia Kim, Jaewon Noh +14Large Language Model Safety Cultural Knowledge
On the Hardness of Junking LLMs
May 6, 2026Marco Rando, Samuel VaiterLarge Language Model Jailbreaks Jailbreak Attacks
SoK: Robustness in Large Language Models against Jailbreak Attacks
May 6, 2026Feiyue Xu, Hongsheng Hu, Chaoxiang He +9Large Language Model Jailbreaks Large Language Model Safety
Sparse Tokens Suffice: Jailbreaking Audio Language Models via Token-Aware Gradient Optimization
May 6, 2026Zheng Fang, Xiaosen Wang, Shenyi Zhang +2Audio Tokens Large Language Model Jailbreaks
Self-Mined Hardness for Safety Fine-Tuning
May 4, 2026Prakhar Gupta, Garv Shah, Donghua ZhangLarge Language Model Jailbreaks Safety
ContextualJailbreak: Evolutionary Red-Teaming via Simulated Conversational Priming
May 4, 2026Mario Rodríguez Béjar, Francisco J. Cortés-Delgado, S. Braghin +1Large Language Model Jailbreaks Red-Teaming
Disentangling Intent from Role: Adversarial Self-Play for Persona-Invariant Safety Alignment
May 3, 2026Jiajia Li, Xiaoyu Wen, Zhongtian Ma +3Safety Alignment Jailbreak Evaluations
Multilingual Safety Alignment via Self-Distillation
May 3, 2026Ruiyang Qin, Qingzhuo Wang, Dongrui Liu +3Multilingual Safety Large Language Model Adaptation
TrajShield: Trajectory-Level Safety Mediation for Defending Text-to-Video Models Against Jailbreak Attacks
May 3, 2026Quanchen Zou, Nizhang Li, Wenxin Zhang +4Text-To-Video Models Inference-Time Defense
Tracing the Dynamics of Refusal: Exploiting Latent Refusal Trajectories for Robust Jailbreak Detection
May 2, 2026Xulin Hu, Che Wang, Wei Yang Bryan Lim +2Jailbreak Detection Refusals
SRTJ: Self-Evolving Rule-Driven Training-Free LLM Jailbreaking
May 1, 2026Jindong Li, Ying Liu, Yali Fu +4Jailbreak Evaluations Jailbreaks
RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs
May 1, 2026Zhiyuan Xu, Joseph Gardiner, Sana Belguith +1Hijacking Mixture-of-Experts Models
Jailbreaking Vision-Language Models Through the Visual Modality
May 1, 2026Aharon Azulay, Jan Dubiński, Zhuoyun Li +2Large Language Model Jailbreaks Jailbreak Attacks
Jailbroken Frontier Models Retain Their Capabilities
Apr 30, 2026Daniel Zhu, Zihan Wang, Xuchan Bao +1Novel Jailbreak Method Jailbreaks
Attention Is Where You Attack
Apr 30, 2026Aviral Srivastava, Sourav PandaAdversarial Examples Jailbreak Evaluations
Minimal, Local, Causal Explanations for Jailbreak Success in Large Language Models
Apr 30, 2026Shubham Kumar, Narendra AhujaLarge Language Model Jailbreaks Novel Jailbreak Method
TwinGate: Stateful Defense against Decompositional Jailbreaks in Untraceable Traffic via Asymmetric Contrastive Learning
Apr 30, 2026Bowen Sun, Chaozhuo Li, Yaodong Yang +2Jailbreaks Malicious Code
Cross-Lingual Jailbreak Detection via Semantic Codebooks
Apr 28, 2026Shirin Alanova, Bogdan Minko, Sabrina Sadiekh +1Multilingual Safety Large Language Model Jailbreaks
Adaptive Prompt Embedding Optimization for LLM Jailbreaking
Apr 27, 2026Miles Q. Li, Benjamin C. M. Fung, Boyang Li +2Large Language Model Jailbreaks Jailbreak Evaluations
Layerwise Convergence Fingerprints for Runtime Misbehavior Detection in Large Language Models
Apr 27, 2026Nay Myat Min, Long H. Pham, Jun SunFingerprint Backdoor Attacks
Jailbreaking Frontier Foundation Models Through Intention Deception
Apr 27, 2026Xinhe Wang, Katia Sycara, Yaqi XieLarge Language Model Jailbreaks Jailbreaks
Evaluating Jailbreaking Vulnerabilities in LLMs Deployed as Assistants for Smart Grid Operations: A Benchmark Against NERC Standards
Apr 25, 2026Taha Hammadia, Lucas Rea, Ahmad Mohammad Saber +2Large Language Model Jailbreaks Jailbreaks
From Concept-Aligned Tokens to Vulnerable Features: Mechanistic Localization of Jailbreaks
Apr 25, 2026Nilanjana Das, Mathew Dawit, Aman Chadha +1Jailbreaks Vulnerable Code
SHAPE: Unifying Safety, Helpfulness and Pedagogy for Educational LLMs
Apr 24, 2026Sihang Zhao, Kangrui Yu, Youliang Yuan +2Pedagogy Tutors
AVISE: Framework for Evaluating the Security of AI Systems
Apr 22, 2026Mikko Lempinen, Joni Kemppainen, Niklas RaesalmiArtificial Intelligence Safety Security Analysis
Breaking Bad: Interpretability-Based Safety Audits of State-of-the-Art LLMs
Apr 22, 2026Krishiv Agarwal, Ramneet Kaur, Colin Samplawski +6Jailbreak Evaluations Llm-As-A-Judge
One Jailbreak, Many Tongues: Learning Language-Insensitive Intention Representations for Multilingual Jailbreak Detection
Apr 22, 2026Shuyu Jiang, Kaiyu Xu, Xingshu Chen +5Large Language Model Jailbreaks Multilingual Safety
EvoJail: Evolutionary Diverse Jailbreak Prompt Generation for Large Language Models
Apr 22, 2026Rui Tang, Kaiyu Xu, Pengsen Cheng +3Jailbreak Evaluations Jailbreak Detection
HarDBench: A Benchmark for Draft-Based Co-Authoring Jailbreak Attacks for Safe Human-LLM Collaborative Writing
Apr 21, 2026Euntae Kim, Soomin Han, Buru ChangLarge Language Model Safety Adversarial Jailbreaks
STAR-Teaming: A Strategy-Response Multiplex Network Approach to Automated LLM Red Teaming
Apr 21, 2026MinJae Jung, YongTaek Lim, Chaeyun Kim +3Red-Teaming Language Model Evasion Attacks
An Empirical Study of Multi-Generation Sampling for Jailbreak Detection in Large Language Models
Apr 20, 2026Hanrui Luo, Shreyank N GowdaLarge Language Model Jailbreaks Jailbreak Detection
Towards Understanding the Robustness of Sparse Autoencoders
Apr 20, 2026Ahson Saiyed, Sabrina Sadiekh, Chirag AgarwalAdversarial Jailbreaks Transformer Architectures
Different Paths to Harmful Compliance: Behavioral Side Effects and Mechanistic Divergence Across LLM Jailbreaks
Apr 20, 2026Md Rysul Kabir, Zoran TiganjLarge Language Model Jailbreaks Jailbreaks
Jailbreaking Large Language Models with Morality Attacks
Apr 18, 2026Ying Su, Mingen Zheng, Weili Diao +1Large Language Model Jailbreaks Jailbreak Attacks
SafeDream: Safety World Model for Proactive Early Jailbreak Detection
Apr 18, 2026Bo Yan, Weikai Lin, Yada Zhu +1Jailbreak Detection Jailbreak Attacks
When Safe Concepts Become Unsafe: Multi-Concept Compositional Vulnerabilities in Text-to-Image Models
Apr 17, 2026Chaoshuo Zhang, Yibo Liang, Mengke Tian +7Model-Agnostic Defense Vulnerability Detection & Repair
Reasoning-targeted Jailbreak Attacks on Large Reasoning Models via Semantic Triggers and Psychological Framing
Apr 17, 2026Zehao Wang, Lanjun WangJailbreak Attacks Large Reasoning Models
On Optimizing Multimodal Jailbreaks for Spoken Language Models
Mar 19, 2026Aravind Krishnan, Karolina Stańczak, Dietrich KlakowLarge Language Model Jailbreaks Jailbreak Evaluations
Sparse Autoencoders are Capable LLM Jailbreak Mitigators
Feb 12, 2026Yannick Assogba, Jacopo Cortellazzi, Javier Abad +3Novel Jailbreak Method Large Language Model Safety
When the Prompt Becomes Visual: Vision-Centric Jailbreak Attacks for Large Image Editing Models
Feb 10, 2026Jiacheng Hou, Yining Sun, Ruochong Jin +4Adversarial Jailbreaks Image Editing
Robustness of Vision Language Models Against Split-Image Harmful Input Attacks
Feb 8, 2026Md Rafi Ur Rashid, MD Sadik Hossain Shanto, Vishnu Asutosh Dasu +1Large Vision Language Models Adversarial Jailbreaks
SoK: Systematizing LLM Prompt Security: Taxonomies, Datasets, and Unified Evaluation of Attacks and Defenses
Oct 17, 2025Hanbin Hong, Shuang Wu, Shuya Feng +6Large Language Model Safety Large Language Model Evaluation
Echoes of Human Malice in Agents: Benchmarking LLMs for Multi-Turn Online Harassment Attacks
Oct 16, 2025Trilok Padhi, Pinxian Lu, Abdulkadir Erol +5Language Model Evasion Attacks Multi-Turn Interactions
Attention Misses Visual Risk: Risk-Adaptive Steering for Multimodal Safety Alignment
Oct 15, 2025Jonghyun Park, Minhyuk Seo, Chaewon Yeo +1Inference-Time Defense Safety Alignment
MetaBreak: Jailbreaking Online LLM Services via Special Token Manipulation
Oct 11, 2025Wentian Zhu, Zhen Xiang, Wei Niu +1Large Language Model Jailbreaks Prompt-Level Mitigations
NonTextual Target Attack
Oct 3, 2025Xinzhe Huang, Wenjing Hu, Tianhang Zheng +6Jailbreak Attacks
Breaking the Code: Security Assessment of AI Code Agents Through Systematic Jailbreaking Attacks
Oct 1, 2025Shoumik Saha, Jifan Chen, Sam Mayers +3Adversarial Jailbreaks Security Analysis

May 10, 2026 · cs.CRJ/K move · Enter open · S save

MT-JailBench: A Modular Benchmark for Understanding Multi-Turn Jailbreak Attacks

Xinkai Zhang, Zhipeng Wei, Huanli Gong, Jing Ting Zheng+3

1UC Berkeley · 3International Computer Science Institute · 2UC Riverside · 4Berkeley Lab

Multi-turn jailbreaks exploit the ability of large language models to accumulate and act on conversational context. Instead of stating a harmful request directly, an attacker can gradually steer the conversation toward an unsafe answer. Recent methods demonstrate this risk, but they are usually evaluated as black-box pipelines with different budgets, judges, retry rules, and strategy generation procedures. As a result, it is often unclear whether reported gains reflect stronger attack mechanisms or different experimental conditions. We introduce MT-JailBench, a modular evaluation framework for benchmarking multi-turn jailbreaks under fixed conditions. MT-JailBench implements each attack as five interacting modules: evaluation function, attack strategy, prompt generation, prompt refinement, and flow control. This design enables fair comparison across attack methods and component-wise analysis of what drives attack success. Using MT-JailBench, we find that resource budgets and evaluation functions are major confounders: controlling turns, retries, interactions, sampled strategies, and judges substantially change the ranking of attacks. At the component level, prompt generation accounts for most performance variation, while refinement and flow control provide moderate gains. We also find that explicit dynamic strategy generation is not always necessary; stochastic sampling from a fixed strategy can rival more elaborate diversification mechanisms. Finally, recomposing the best components yields a strong attack configuration that outperforms its source attacks and generalizes across diverse target LLMs. MT-JailBench therefore provides a modular framework for comparing multi-turn jailbreaks, understanding the impact of components, and guiding stronger red-teaming evaluations.

Jailbreak Attacks Jailbreak Detection

Open paper Ask about it PDF