LLM Jailbreak Attacks

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, down 12% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 137

All topics

MJ: Multi-turn LLM Jailbreaking via Decomposed Credit Assignment
Jul 13, 2026Junyoung Park, Namgyu Park, Sechan Lee +3RL for Language Models LLM Jailbreak Attacks
POSTECH GSAI · Samsung SDS · POSTECH GSAI & CSE
Trivial Prompt Reframing Bypasses Safety Guardrails in Googleś MedGemma-4B
Jul 9, 2026Avi-ad Avraam BuskilaLLM Safety Benchmarks Language Model Safety Evaluation
Department of Information Science and Applied Artificial Intelligence, Bar-Ilan University, Ramat Gan, Israel
Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs
Jul 8, 2026Anupam Wagle, Ifrat Ikhtear Uddin, Chaowei Zhang +1LLM Interpretability Adversarial Attacks on LLMs
Department of Computer Science, University of South Dakota, USA · School of Information and Artificial Intelligence, Yangzhou University, Yangzhou, China
Retroactive Chain-of-Thought (RetroCoT): Forensic Reconstruction Prompts as a Safety Diagnostic Across Model Generations
Jul 6, 2026Samira HajizadehPragmatic Reasoning in Language Models Adversarial Attacks on LLMs
Department of Computer Science Columbia University New York, NY, USA
Beyond the Prompt: Jailbreaking Function-Calling LLMs via Simulated Moderation Traces
Jul 1, 2026Junlong Liu, Haobo Wang, Weiqi Luo +1LLM Security LLM Jailbreak Attacks
1Sun Yat-sen University · 2Nanyang Technological University
Jailbreaking for the Average Jane: Choosing Optimal Jailbreaks via Bandit Algorithms for Automatically Enhanced Queries
Jun 25, 2026Prarabdh Shukla, Ritik, Suhas Rao +2Adversarial Attacks on LLMs LLM Jailbreak Attacks
Centre for Machine Intelligence and Data Science, IIT Bombay · Department of Computer Science and Engineering, IIT Bombay
What Intermediate Layers Know: Detecting Jailbreaks from Entropy Dynamics
Jun 23, 2026Sofiia Nikolenko, Michele Papucci, Mina Rezaei +1LLM Interpretability LLM Jailbreak Attacks
LMU Munich, Munich, Germany · relAI – Konrad Zuse School of Excellence in Reliable AI · University of Pisa, Pisa, Italy +2
The Geometry of Refusal: Linear Instability in Safety-Aligned LLMs
Jun 21, 2026Shivam Ratnakar, Kartikeya VatsLanguage Model Steering Adversarial Attacks on LLMs
University of Southern California · Independent Researcher
OTTER: A Red-Teaming System for Toxicity-Evading Jailbreak Prompt Optimization
Jun 19, 2026Jerry Wang, Hsin-Ling Hsu, Yi-Cheng Lai +2Adversarial Prompt Generation Adversarial Attacks on LLMs
1National Chengchi University, Taipei, Taiwan
What Do Safety-Aligned LLMs Learn From Mixed Compliance Demonstrations?
Jun 18, 2026Sihui Dai, Mann PatelAdversarial Attacks on LLMs In-Context Learning
CapitalOne
Analyzing Defensive Misdirection Against Model-Guided Automated Attacks on Agentic AI Systems
Jun 18, 2026Reza Soosahabi, Vivek NamsaniAdversarial Robustness Jailbreak Attacks
Application & Threat Intelligence Research Center Keysight Technologies Inc., USA
A Red-Team Study of Anthropic Fable 5 & Opus 4.8 Models
Jun 16, 2026Nicola FrancoLanguage Model Safety Evaluation Neural Network Robustness
Head of AI Security Lab The Italian Institute of Artificial Intelligence (AI4I) Corso Castelfidardo 22, 10129 Turin, Italy
Automated jailbreak attack targeting multiple defense strategies
Jun 15, 2026Qi Wang, Chengcheng Wan, Weijia He +4Adversarial Prompt Generation LLM Jailbreak Attacks
East China Normal University Shanghai, China · East China Normal University, Shanghai Innovation Institute Shanghai, China · University of Southampton Southampton, England +2
DoubtProbe: Black-Box Jailbreak Defense via Structural Verification and Semantic Auditing
Jun 15, 2026Xuanyu Yin, Yilin Jiang, Jun Zhou +3LLM Auditing LLM Jailbreak Attacks
East China Normal University Shanghai, China · The Hong Kong University of Science and Technology (Guangzhou) Guangzhou, China · Institute of Information Engineering, Chinese Academy of Sciences Beijing, China
GAS-Leak-LLM: Genetic Algorithm-Based Suffix Optimization for Black-Box LLM Jailbreaking
Jun 14, 2026Aman Anifer, Vignesh Kumar Kembu, Vishnu M +4Adversarial Prompt Generation LLM Safety
Department of Computer Applications, Cochin University of Science and Technology, Kerala, India. · Department of Electrical, Computer and Biomedical Engineering, University of Pavia, A. Ferrata, 5, Pavia, 27100, Italy.
Grammar-Constrained Decoding Can Jailbreak LLMs into Generating Malicious Code
Jun 10, 2026Yitong Zhang, Shiteng Lu, Jia LiLLM Safety Alignment LLM Jailbreak Attacks
College of AI Tsinghua University Beijing, China · Yingcai Honors College University of Electronic Science and Technology of China Chengdu, China
JailbreakOPT: Tool-Assisted Iterative Jailbreak Prompt Optimization
Jun 9, 2026Ge Shi, Jun Yin, Donglin Xie +3Adversarial Prompt Generation Large Language Model-Guided Optimization
University of California, Davis · The Renmin University of China · Independent Researcher +3
Risk Under Pressure: Compute-Aware Evaluation of Adversarial Robustness in Language Models
Jun 9, 2026Malikeh Ehghaghi, Boglárka Ecsedi, Marsha Chechik +1LLM Alignment Neural Network Robustness
University of Toronto · Vector Institute · Hugging Face
Steering Vectors are an Adversarial Attack Surface
Jun 4, 2026Abzal Aidakhmetov, Donato Crisostomi, Tommaso Mencattini +3Language Model Steering Adversarial Attacks on LLMs
1Sapienza University of Rome · 2EPFL
Membrane: A Self-Evolving Contrastive Safety Memory for LLM Agent Defense
Jun 4, 2026Minseok Choi, Seungbin Yang, Dongjin Kim +5LLM Guardrails Safety Filtering
♡KAIST AI · ♣Financial Tech Lab, KakaoBank Corp
Safety Paradox: How Enhanced Safety Awareness Leaves LLMs Vulnerable to Posterior Attack
Jun 4, 2026Long P. Hoang, Hai V. Le, Shaoyang Xu +2Adversarial Attacks on LLMs LLM Safety Alignment
Singapore University of Technology and Design · Nanyang Technological University
SlotGCG: Exploiting the Positional Vulnerability in LLMs for Jailbreak Attacks
Jun 4, 2026Seungwon Jeong, Jiwoo Jeong, Hyeonjin Kim +2Adversarial Attacks on LLMs Jailbreak Attacks
Dongguk University-Seoul
Voices Across Registers: Corpus-Conditioned Vernacular Jailbreaks against Aligned LLMs via Fanfiction Subgenres
Jun 3, 2026Zhongze Luo, Ruihe Shi, Zhenshuai Yin +3Adversarial Prompt Generation Language Model Safety Evaluation
School of Science and Engineering, The Chinese University of Hong Kong (Shenzhen) · School of Microelectronics, Xi’an Jiaotong University · 2The Shenzhen Future Network of Intelligence Institute (FNii-Shenzhen) +1
Black-box, Adaptive, Efficient, Transferable, Harmful, Applicable... Attacks Are All You Need to Break LLMs
Jun 2, 2026Vincent Limbach, Jonas Dornbusch, David Lüdke +2LLM Jailbreak Attacks LLM Safety Evaluation
Department of Computer Science, Technical University of Munich, Germany · Munich Data Science Institute · Munich Center for Machine Learning +1
NeuroArmor: Safe-Variant-Guided Representation Consistency for Selective Re-Anchoring in Jailbreak Defense
Jun 2, 2026Zhongyang Lin, Ziran Zhao, Feifei Zhai +1LLM Jailbreak Attacks Jailbreak Defense
Which Defense Closes Which Threat? Attributing OWASP-LLM-Top-10 Coverage and Its Brittleness Under Paraphrasing
Jun 1, 2026Alexandre Cristovão MaioranoLLM Red Teaming AI Agent Security Benchmarks
Lumytics
TukaBench: A Culturally Grounded Jailbreak Benchmark for African Languages
May 31, 2026Victor Akinode, Senyu Li, Wassim Hamidouche +3LLM Safety Benchmarks Multilingual Language Model Evaluation
Mila - Quebec AI Institute · McGill University · Microsoft AI for Good Research Lab +1
Quality-Diversity Evolution for Discovering Diverse Vulnerabilities in LLM Safety
May 30, 2026Subhadip MitraAdversarial Prompt Generation Adversarial Attacks on LLMs
Research Lead, Rota Labs
Persona Attack: Incremental Memory Injection Jailbreak Attack against Large Language Models
May 29, 2026Junyoung Park, Seongyong Ju, Sunghwan Park +1Adversarial Attacks on LLMs LLM Safety
Chung-Ang University
Audio Jailbreaks in Large Audio-Language Models: Taxonomy, Attack-Defense Analysis, and Cost-Aware Evaluation
May 28, 2026Bo-Han Feng, Yu-Hsuan Li Liang, Chien-Feng Liu +2Audio-Language Model Evaluation Audio-Language Models
National Taiwan University

Jul 13, 2026, cs.CLJ/K move · Enter open · S save

MJ: Multi-turn LLM Jailbreaking via Decomposed Credit Assignment

Junyoung Park, Namgyu Park, Sechan Lee, Yoon-Chan Jhi+2

POSTECH GSAI · Samsung SDS · POSTECH GSAI & CSE

RL for Language Models LLM Jailbreak Attacks Multi-Turn Jailbreak Attacks Step-Level Credit Assignment Fine-Grained Credit Assignment

Open paper AskPDF arXiv

Modern large language models (LLMs) operate in interactive multi-turn settings, making multi-turn jailbreaking a realistic threat model and an important setting for automated red teaming. A core challenge in learning multi-turn jailbreak attackers is credit assignment: different turns contribute differently to the final outcome, yet existing learning signals are often too coarse to identify their individual contributions. We propose decomposed credit GRPO (DC-GRPO), a unified turn-level credit assignment framework for Group Relative Policy Optimization in multi-turn jailbreak learning. DC-GRPO assigns a separate group-relative learning signal to each turn by combining immediate and future credit, avoiding the credit misassignment induced by broadcasting a single trajectory-level score across the dialogue. We instantiate this framework with static and dynamic weighting rules that differ in how the two credit sources are balanced while sharing the same turn-level structure. Across multiple victim LLMs and benchmarks, the dynamic- and static-weighted variants achieve average ASR5@3 scores of 98.26% and 97.88%, respectively, substantially outperforming the state-of-the-art methods, including SEMA (86.58%) and TROJail (86.23%). Their consistently strong performance indicates that the central empirical benefit comes from turn-level group-relative credit assignment rather than a particular weighting rule. Warning: This paper contains examples of harmful content.

Momentum

Related topics

Latest papers 137