Jailbreak Attacks

Follow this topic Ask about this topic

Momentum

13 papers in the last four weeks, up 30% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 154

All topics

SRTJ: Self-Evolving Rule-Driven Training-Free LLM Jailbreaking
May 1, 2026Jindong Li, Ying Liu, Yali Fu +4Jailbreak Attacks Safety Alignment
1HKUST (GZ) · 2Jilin University · 3Yale University
Jailbreaking Vision-Language Models Through the Visual Modality
May 1, 2026Aharon Azulay, Jan Dubiński, Zhuoyun Li +2Large Language Model Jailbreaks Safety Alignment
Independent · NASK National Research Institute, Warsaw, Poland · Warsaw University of Technology, Warsaw, Poland +3
Jailbroken Frontier Models Retain Their Capabilities
Apr 30, 2026Daniel Zhu, Zihan Wang, Xuchan Bao +1Jailbreaks Jailbreak Attacks
Anthropic
Attention Is Where You Attack
Apr 30, 2026Aviral Srivastava, Sourav PandaAdversarial Examples Jailbreak Attacks
Amazon · The Pennsylvania State University
Minimal, Local, Causal Explanations for Jailbreak Success in Large Language Models
Apr 30, 2026Shubham Kumar, Narendra AhujaLarge Language Model Jailbreaks Jailbreak Attacks
University of Illinois Urbana-Champaign
Adaptive Prompt Embedding Optimization for LLM Jailbreaking
Apr 27, 2026Miles Q. Li, Benjamin C. M. Fung, Boyang Li +2Large Language Model Jailbreaks Jailbreak Attacks
School of Information Studies, McGill University, Montreal, QC, Canada · Department of Computer Science, Kean University, Union, NJ, United States · Mila - Quebec AI Institute, Montreal, QC, Canada +1
Jailbreaking Frontier Foundation Models Through Intention Deception
Apr 27, 2026Xinhe Wang, Katia Sycara, Yaqi XieLarge Language Model Jailbreaks Jailbreak Attacks
Carnegie Mellon University
Evaluating Jailbreaking Vulnerabilities in LLMs Deployed as Assistants for Smart Grid Operations: A Benchmark Against NERC Standards
Apr 25, 2026Taha Hammadia, Lucas Rea, Ahmad Mohammad Saber +2Large Language Model Jailbreaks Jailbreak Attacks
ECE Department, University of Toronto, Toronto, ON Canada · CIISE, Concordia University, Montréal, QC, Canada
Transient Turn Injection: Exposing Stateless Multi-Turn Vulnerabilities in Large Language Models
Apr 23, 2026Naheed Rayhan, Sohely JahanAttacker Large Language Model Jailbreak Attacks
Jagannath University · University of Barishal
Dialect vs Demographics: Quantifying LLM Bias from Implicit Linguistic Signals vs. Explicit User Profiles
Apr 22, 2026Irti Haq, Belén SaldíasLarge Language Model Bias Large Language Model Safety
University of Washington, USA
AVISE: Framework for Evaluating the Security of AI Systems
Apr 22, 2026Mikko Lempinen, Joni Kemppainen, Niklas RaesalmiSecurity Artificial Intelligence Evaluation
University of Oulu
Breaking Bad: Interpretability-Based Safety Audits of State-of-the-Art LLMs
Apr 22, 2026Krishiv Agarwal, Ramneet Kaur, Colin Samplawski +6Jailbreak Attacks Llm-As-A-Judge
University of Florida · SRI
One Jailbreak, Many Tongues: Learning Language-Insensitive Intention Representations for Multilingual Jailbreak Detection
Apr 22, 2026Shuyu Jiang, Kaiyu Xu, Xingshu Chen +5Large Language Model Jailbreaks Multilingual Safety
School of Cyber Science and Engineering, Sichuan University, Chengdu, 610065, China · School of Computer Science and Engineering, Nanyang Technological University · School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China
EvoJail: Evolutionary Diverse Jailbreak Prompt Generation for Large Language Models
Apr 22, 2026Rui Tang, Kaiyu Xu, Pengsen Cheng +3Jailbreak Attacks Jailbreaks
aSchool of Cyber Science and Engineering, Sichuan University, Chengdu 610065, China · dCollege of Computer Science, Sichuan University, Chengdu 610065, China · aSchool of Cyber Science and Engineering, Sichuan University, Chengdu 610065, China bKey Laboratory of Data Protection and Intelligent Management (Sichuan University), Ministry of Education, Chengdu 610065, China
HarDBench: A Benchmark for Draft-Based Co-Authoring Jailbreak Attacks for Safe Human-LLM Collaborative Writing
Apr 21, 2026Euntae Kim, Soomin Han, Buru ChangLarge Language Model Safety Jailbreak Attacks
Korea University · Sogang University
STAR-Teaming: A Strategy-Response Multiplex Network Approach to Automated LLM Red Teaming
Apr 21, 2026MinJae Jung, YongTaek Lim, Chaeyun Kim +3Red-Teaming Attacker Large Language Model
DATUMO INC.
An Empirical Study of Multi-Generation Sampling for Jailbreak Detection in Large Language Models
Apr 20, 2026Hanrui Luo, Shreyank N GowdaLarge Language Model Jailbreaks Jailbreak Attacks
School of Computer Science, University of Nottingham, Nottingham, United Kingdom.
Jailbreaking Large Language Models with Morality Attacks
Apr 18, 2026Ying Su, Mingen Zheng, Weili Diao +1Large Language Model Jailbreaks Moral Reasoning
South China University of Technology1 · HKUST2 · Beihang University3
SafeDream: Safety World Model for Proactive Early Jailbreak Detection
Apr 18, 2026Bo Yan, Weikai Lin, Yada Zhu +1Jailbreak Attacks Jailbreak Success Rates
University of Central Florida · University of Rochester · IBM Research
Reasoning-targeted Jailbreak Attacks on Large Reasoning Models via Semantic Triggers and Psychological Framing
Apr 17, 2026Zehao Wang, Lanjun WangLarge Language Model Jailbreaks Jailbreak Attacks
College of Intelligence and Computing, Tianjin University, Tianjin 300350, China. · School of New Media and Communication, Tianjin University, Tianjin 300072, China. · Shanghai Key Laboratory of Data Science,[cs.LG] Shanghai 200438, China.
On Optimizing Multimodal Jailbreaks for Spoken Language Models
Mar 19, 2026Aravind Krishnan, Karolina Stańczak, Dietrich KlakowLarge Language Model Jailbreaks Jailbreak Attacks
Saarland University, Germany · DFKI GmbH, Saarbrücken, Germany · ETH AI Center, Switzerland
Sparse Autoencoders are Capable LLM Jailbreak Mitigators
Feb 12, 2026Yannick Assogba, Jacopo Cortellazzi, Javier Abad +3Jailbreak Attacks Large Language Model Safety
1Apple · 2ETH Zurich
When the Prompt Becomes Visual: Vision-Centric Jailbreak Attacks for Large Image Editing Models
Feb 10, 2026Jiacheng Hou, Yining Sun, Ruochong Jin +4Image Editing Jailbreak Attacks
Tsinghua University, China · Pengcheng Laboratory, Shenzhen, China · Central South University, Changsha, China.
Robustness of Vision Language Models Against Split-Image Harmful Input Attacks
Feb 8, 2026Md Rafi Ur Rashid, MD Sadik Hossain Shanto, Vishnu Asutosh Dasu +1Recent Vision-Language Models White-Box Spectral-Subspace-Guided Attack
Pennsylvania State University · Bangladesh University of Engineering and Technology
In Vino Veritas and Vulnerabilities: Examining LLM Safety via Drunk Language Inducement
Jan 19, 2026Anudeex Shetty, Aditya Joshi, Salil S. KanhereLarge Language Model Safety Jailbreak Attacks
School of Computer Science and Engineering, UNSW Sydney, Australia · School of Computing and Information System, the University of Melbourne, Australia
SoK: Systematizing LLM Prompt Security: Taxonomies, Datasets, and Unified Evaluation of Attacks and Defenses
Oct 17, 2025Hanbin Hong, Shuang Wu, Shuya Feng +6Large Language Model Safety Large Language Model Evaluation
University of Connecticut · University of Alabama at Birmingham · Independent
Attention Misses Visual Risk: Risk-Adaptive Steering for Multimodal Safety Alignment
Oct 15, 2025Jonghyun Park, Minhyuk Seo, Chaewon Yeo +1Safety Alignment Inference-Time Defense
Seoul National University · KU Leuven
NonTextual Target Attack
Oct 3, 2025Xinzhe Huang, Wenjing Hu, Tianhang Zheng +6Attacker Large Language Model Gradient-Based Attacks
State Key Laboratory of Blockchain and Data Security, Zhejiang University, Hangzhou 310007, China · Hangzhou High-Tech Zone, Binjiang Institute of Blockchain and Data Security, Hangzhou 310053, China · School of Cyberspace Security, Nanjing University of Science and Technology, Nanjing 210094, China +3
Breaking the Code: Security Assessment of AI Code Agents Through Systematic Jailbreaking Attacks
Oct 1, 2025Shoumik Saha, Jifan Chen, Sam Mayers +3Jailbreak Attacks Security Evaluation
University of Maryland – College Park · AWS AI Labs · Meta Superintelligence Labs
Context Misleads LLMs: The Role of Context Filtering in Maintaining Safe Alignment of LLMs
Aug 9, 2025Jinhwa Kim, Ian G. HarrisJailbreak Attacks Large Language Models Fail
Department of Computer Science University of California, Irvine
Decoding One Safety Trigger Token for Balancing Safety and Usability in Large Language Models
May 12, 2025Haoran Gu, Handing Wang, Yi Mei +2Large Language Model Safety Jailbreak Attacks
Xidian University · Victoria University of Wellington · Westlake University
GuidedBench: Measuring and Mitigating the Evaluation Discrepancies of In-the-wild LLM Jailbreak Methods
Feb 24, 2025Ruixuan Huang, Xunguang Wang, Zongjie Li +2Large Language Model Jailbreaks Jailbreak Attacks
The Hong Kong University of Science and Technology, Hong Kong SAR, China
Easier Said Than Done: Unpacking Intent-Behavior Gap in Jailbreaking LLM-Based Robots
Dec 21, 2024Xuancun Lu, Zhengxian Huang, Xinfeng Li +3Large Language Model Jailbreaks Jailbreak Attacks
Zhejiang University
Divide and Conquer: A Hybrid Strategy Defeats Multimodal Large Language Models
Dec 21, 2024Yanxu Mao, Peipei Liu, Tiehan Cui +3Large Language Model Jailbreaks Jailbreak Attacks
School of Computer Science and Technology, Shanghai Jiao Tong University, Shanghai, China · Zhongguancun Laboratory, Beijing, China · School of Software, Henan University, Kaifeng, China +1

May 1, 2026, cs.CRJ/K move · Enter open · S save

SRTJ: Self-Evolving Rule-Driven Training-Free LLM Jailbreaking

Jindong Li, Ying Liu, Yali Fu, Jinjing Zhu+3

1HKUST (GZ) · 2Jilin University · 3Yale University

Jailbreak Attacks Safety Alignment

Open paper AskPDF arXiv

LLMs are increasingly equipped with safety alignment mechanisms, yet recent studies demonstrate that they remain vulnerable to jailbreaking attacks that elicit harmful behaviors without explicit policy violations. While a growing body of work has explored automated jailbreak strategies, existing methods face several fundamental challenges, including the lack of systematic utilization of both successful and failed attack experiences, as well as the absence of principled mechanisms for composing and selecting reusable attack rules under diverse constraints. As a result, existing methods struggle to accumulate transferable knowledge over time and to reliably adapt attack strategies across different targets and evolving safety mechanisms. To address these issues, we propose a Self-Evolving Rule-Driven Training-Free Jailbreak (SRTJ) framework that systematically discovers, composes, and refines attack strategies through interaction and feedback, without updating model parameters. Specifically, SRTJ couples experience-driven attack generation with answer set programming (ASP)-based rule selection and constraint-aware composition, where iterative verifier feedback is leveraged to jointly refine successful strategies and analyze failure patterns. The resulting rule memory evolves in a hierarchical multi-level manner, explicitly organizing distilled attack knowledge into long-term, middle-term, and short-term rules, thereby capturing both stable transferable strategies and transient adaptive behaviors to effectively balance exploration and exploitation across attack attempts. Extensive experiments on mainstream jailbreak benchmark (HarmBench) demonstrate that SRTJ achieves strong and stable attack performance across different target LLMs, while exhibiting improved robustness and generalization compared to existing jailbreak methods. The code is available at https://github.com/TheSolkatt/SRTJ.

Momentum

Related topics

Latest papers 154