LLM Jailbreak Attacks

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, down 12% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 137

All topics

On Optimizing Multimodal Jailbreaks for Spoken Language Models
Mar 19, 2026Aravind Krishnan, Karolina Stańczak, Dietrich KlakowAdversarial Attacks LLM Jailbreak Attacks
Saarland University, Germany · DFKI GmbH, Saarbrücken, Germany · ETH AI Center, Switzerland
Sparse Autoencoders are Capable LLM Jailbreak Mitigators
Feb 12, 2026Yannick Assogba, Jacopo Cortellazzi, Javier Abad +3Sparse Autoencoders LLM Jailbreak Attacks
1Apple · 2ETH Zurich
In Vino Veritas and Vulnerabilities: Examining LLM Safety via Drunk Language Inducement
Jan 19, 2026Anudeex Shetty, Aditya Joshi, Salil S. KanhereLanguage Model Safety Evaluation Adversarial Attacks on LLMs
School of Computer Science and Engineering, UNSW Sydney, Australia · School of Computing and Information System, the University of Melbourne, Australia
Safety Is Not Universal: The Selective Safety Trap in LLM Alignment
Jan 7, 2026Iago Alves Brito, Walcy Santos Rezende Rios, Julia Soares Dollis +2LLM Safety Benchmarks LLM Alignment
Advanced Knowledge Center for Immersive Technologies (AKCIT) Federal University of Goiás (UFG)
SoK: Systematizing LLM Prompt Security: Taxonomies, Datasets, and Unified Evaluation of Attacks and Defenses
Oct 17, 2025Hanbin Hong, Shuang Wu, Shuya Feng +6LLM Security LLM Jailbreak Attacks
University of Connecticut · University of Alabama at Birmingham · Independent
Echoes of Human Malice in Agents: Benchmarking LLMs for Multi-Turn Online Harassment Attacks
Oct 16, 2025Trilok Padhi, Pinxian Lu, Abdulkadir Erol +5Adversarial Attacks on LLMs AI Agent Security Benchmarks
1Georgia State University · 2Georgia Institute of Technology · University of California, Berkeley
MetaBreak: Jailbreaking Online LLM Services via Special Token Manipulation
Oct 11, 2025Wentian Zhu, Zhen Xiang, Wei Niu +1Adversarial Attacks on LLMs LLM Security
University of Georgia
NonTextual Target Attack
Oct 3, 2025Xinzhe Huang, Wenjing Hu, Tianhang Zheng +6Adversarial Prompt Generation Adversarial Attacks on LLMs
State Key Laboratory of Blockchain and Data Security, Zhejiang University, Hangzhou 310007, China · Hangzhou High-Tech Zone, Binjiang Institute of Blockchain and Data Security, Hangzhou 310053, China · School of Cyberspace Security, Nanjing University of Science and Technology, Nanjing 210094, China +3
Breaking the Code: Security Assessment of AI Code Agents Through Systematic Jailbreaking Attacks
Oct 1, 2025Shoumik Saha, Jifan Chen, Sam Mayers +3AI Coding Agents AI Agent Security
University of Maryland – College Park · AWS AI Labs · Meta Superintelligence Labs
Context Misleads LLMs: The Role of Context Filtering in Maintaining Safe Alignment of LLMs
Aug 9, 2025Jinhwa Kim, Ian G. HarrisLLM Safety Alignment LLM Safety
Department of Computer Science University of California, Irvine
LLMs Encode Harmfulness and Refusal Separately
Jul 16, 2025Jiachen Zhao, Jing Huang, Zhengxuan Wu +2LLM Interpretability LLM Refusal Behavior
Northeastern University · Stanford University
HauntAttack: When Attack Follows Reasoning as a Shadow
Jun 8, 2025Jingyuan Ma, Rui Li, Zheng Li +4Adversarial Attacks on LLMs Jailbreak Attacks
State Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University · StepFun · Department of Computing, The Hong Kong Polytechnic University +1
Decoding One Safety Trigger Token for Balancing Safety and Usability in Large Language Models
May 12, 2025Haoran Gu, Handing Wang, Yi Mei +2LLM Safety Alignment LLM Safety
Xidian University · Victoria University of Wellington · Westlake University
Using Mechanistic Interpretability to Craft Adversarial Attacks against Large Language Models
Mar 8, 2025Thomas Winninger, Boussad Addad, Katarzyna KapustaAdversarial Prompt Generation Adversarial Attacks on LLMs
*Work started during internship at Thales.
GuidedBench: Measuring and Mitigating the Evaluation Discrepancies of In-the-wild LLM Jailbreak Methods
Feb 24, 2025Ruixuan Huang, Xunguang Wang, Zongjie Li +2Language Model Safety Evaluation LLM Jailbreak Attacks
The Hong Kong University of Science and Technology, Hong Kong SAR, China
Easier Said Than Done: Unpacking Intent-Behavior Gap in Jailbreaking LLM-Based Robots
Dec 21, 2024Xuancun Lu, Zhengxian Huang, Xinfeng Li +3Large Language Model-Based Robot Planning Adversarial Attacks on LLMs
Zhejiang University
Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledge
Apr 8, 2024Weikai Lu, Ziqian Zeng, Jianwei Wang +5LLM Safety Alignment LLM Jailbreak Attacks
South China University of Technology, China · Pazhou Laboratory, China

Mar 19, 2026, cs.LGJ/K move · Enter open · S save

On Optimizing Multimodal Jailbreaks for Spoken Language Models

Aravind Krishnan, Karolina Stańczak, Dietrich Klakow

Saarland University, Germany · DFKI GmbH, Saarbrücken, Germany · ETH AI Center, Switzerland

Adversarial Attacks LLM Jailbreak Attacks Multimodal Jailbreak Attacks Speech Language Models

Open paper AskPDF arXiv

As Spoken Language Models (SLMs) integrate speech and text modalities, they inherit the safety vulnerabilities of their LLM backbone while introducing an expanded attack surface. SLMs have been previously shown to be susceptible to jailbreaking, where adversarial prompts induce harmful responses. Yet existing attacks largely remain unimodal, optimizing either text or audio in isolation. We explore gradient-based multimodal jailbreaks by introducing JAMA (Joint Audio-text Multimodal Attack), a joint multimodal optimization framework combining Greedy Coordinate Gradient (GCG) for text and Projected Gradient Descent (PGD) for audio, to simultaneously perturb both modalities. Evaluations across four state-of-the-art SLMs and four audio types demonstrate that JAMA surpasses unimodal jailbreak rate by 1.5x to 20x. We analyze the operational dynamics of this joint attack and show that a sequential approximation method makes it 4x to 6x faster. Our findings suggest that unimodal safety is insufficient for robust SLMs. The code and data are available at https://repos.lsv.uni-saarland.de/akrishnan/multimodal-jailbreak-slm.

Momentum

Related topics

Latest papers 137