LLM Jailbreak Attacks

LLM: Large Language Model

Overview

LLM jailbreak research examines how prompts and interactions can circumvent safety alignment, and how to make models resist those attempts. Attacks range from roleplay, obfuscation, and multi-turn persuasion to automated prompt optimization, internal activation steering, and attacks on audio, code, and tool-using agents. Defenses include input filters, intent detectors, safety fine-tuning, representation-level interventions, and safeguards that track risk across a conversation; evaluations increasingly test diverse languages, adaptive attacks, and harmful actions that actually execute. A central challenge is improving robustness without rejecting benign requests, while inconsistent judges, budgets, and test settings make reported attack success difficult to compare.

Latest papers

CardsList

217 papers13 papers in the last four weeks, down 43% on the four weeks before. 0.1% of all new papers.

  1. POEM: Output-Relative Block-Sparse Attention for Long-Context Prefilling

    Nov 10, 2026Haoyi Wu, Yunkai Dang, Wanyu Zhang +2LLM SafetyJailbreak Defense

  2. TERM: Target-Free Jailbreak Defense via Entropy-Guided Residual Modulation

    Nov 10, 2026Yunkai Dang, Wanyu Zhang, Meiyi Zhu +3LLM SafetyJailbreak Defense

  3. AttentionSwitch: Jailbreak Defense for LLMs via Joint Learning of Sparse Attention-Head Selection and Scaling

    Nov 5, 2026Doniyorkhon Obidov, Honggang Yu, Xiaolong Guo +1Jailbreak DefenseLLM Safety

  4. "Blind Compliance": Coercive Control in AI Jailbreaking

    Nov 5, 2026Acacia L. Ackles, Elliott WhitsonJailbreak AttacksLLM Jailbreak Attacks

  5. J-Anchor: Defending Against Prefill Attacks via J-Space Selective Refusal Restoration

    Oct 31, 2026Running Yang, Beidi Zhao, Xiaoxiao LiJailbreak DefenseLLM Jailbreak Attacks

  6. CoFiBreak: A Coarse-to-Fine Diversity Reward for Effective Multi-Turn Jailbreak

    Oct 29, 2026Jialin Song, Xiaodong Liu, Weiwei Yang +7LLM Red TeamingJailbreak Attacks

  7. Discovering Jailbreaks via Curriculum of Models

    Oct 28, 2026Michał Burzyński, Noah T. Rossi, Shomit Basu +1LLM SecurityLLM Jailbreak Attacks

  8. Poisoned Skills: Propagating Jailbreaks Through Agent Markdown Files

    Oct 27, 2026Kashyap R Manjusha, Murali EmaniPrompt Injection Attacks on AI AgentsLLM Jailbreak Attacks

  9. SEMA-Auto: Sighted and Efficient Multi-Turn Attack with Autonomy

    Oct 26, 2026Mingqian Feng, Xiaodong Liu, Weiwei Yang +8Adversarial Attacks on LLMsJailbreak Attacks

  10. Identically Trained Language Models Break on Different Jailbreaks

    Oct 25, 2026Chi-Wei Chang, Mu-Tien Kuo, Kuan-Wei Lee +1Language Model Safety EvaluationLLM Jailbreak Attacks

  11. Harmful Responses Are Jailbreak Templates: Transferring Autoregressive Jailbreaks to Diffusion Language Models

    Oct 22, 2026Jinwei Gan, Zifeng Cheng, Zhiwei Jiang +3LLM Jailbreak AttacksAdversarial Attacks on Diffusion Models

  12. Budgeted Attack Scheduling for LLM Red-Teaming: The Roles of Static Priors, Semantic Guidance, and Online Feedback

    Oct 19, 2026Zhicheng Fang, Han Sun, Jiachen Lei +5LLM Red TeamingLanguage Model Safety Evaluation

  13. Pair-Aware Optimization: Coordinating Exploration and Refinement for Jailbreaking LLM Agents

    Oct 17, 2026Juanyang Xu, Zheng Wang, Xingyu Zhao +2Adversarial Attacks on LLMsJailbreak Attacks

  14. ECHO: Replacing the Compliance Proxy with Response Harmfulness in Optimization-Based Jailbreak Attack

    Oct 16, 2026Yuanwei Wu, Lingdong Huang, Yunlong Mao +3LLM Jailbreak Attacks

  15. RedDarwin: Evolving Jailbreak Skills against Frontier LLMs

    Oct 14, 2026Zhouyuan Ma, Yutao Wu, Hanxun Huang +3LLM Jailbreak AttacksLLM Red Teaming

  16. Did the LLM Answer the Question? A Semantic Reconstruction Game for Jailbreak Evaluation

    Oct 13, 2026Liam Davis, Romain Emil-Popescu, Suman JanaJailbreak Attack EvaluationLLM Safety Evaluation

  17. SpecCloak: Probing Harmful Code Generation through Engineering Specifications

    Oct 13, 2026Wenbin Chen, Jiexin Wang, Guanting Wu +2LLM SecurityLLM Code Generation

  18. Narrative Paradoxes in LLM Inference: Shaping Reasoning Trajectories toward Misalignment

    Oct 12, 2026Haoming Yang, Ke Ma, Yangbangyan Jiang +6Adversarial Attacks on LLMsLLM Safety

  19. ATTCK-R: Knowledge-Aware Long-Horizon Jailbreaking for Protected LLMs

    Oct 12, 2026Md Mushfiqur Rahman, Tobias Rohde, Rahul Tripathi +2LLM Jailbreak AttacksLLM Red Teaming

  20. Exploring Jailbreak Vulnerability Across Depth-Based Dynamic Inference in Large Language Models

    Oct 10, 2026Lass Najmuldeen, Seyedhamidreza MousaviAdversarial Robustness of Language ModelsLLM Jailbreak Attacks

  21. How Narrative Wrapping Affects LLM Refusal: A Cross-Language Benchmark and Defense

    Oct 7, 2026Zhankai Ye, Yanning Wang, Yukai Jin +5Multi-Turn Language Model Safety EvaluationRefusal Behavior in Language Models

  22. PatchBench: Measuring Collateral Damage in Activation Patching

    Oct 7, 2026Alexi Canesse, Mathis Le Bail, Maël Jenny +3Jailbreak Attack EvaluationLanguage Model Safety Evaluation

  23. From Expected Harmfulness to Likelihood: A Probabilistic Reformulation of Jailbreaking LLM Agents

    Oct 7, 2026Juanyang Xu, Zheng Wang, Xingyu Zhao +2Jailbreak AttacksLLM Jailbreak Attacks

  24. Secure Speculative Decoding for Large Language Models

    Oct 6, 2026Yichi Zhang, Zhiqi Wang, Neil Gong +1Adversarial Attacks on LLMsSpeculative Decoding

  25. Jailbreaking Open-Weight LLMs via Random Embedding Perturbations

    Oct 5, 2026Abhinav Sudhakar Dubey, Scott Sirri, Vaggos Chatziafratis +1Adversarial AttacksAdversarial Attacks on LLMs

  26. Benchmarking Jailbreak Guardrails for Embodied Agents

    Oct 5, 2026Xunguang Wang, Qingyue Wang, Yuguang Zhou +3LLM GuardrailsAI Agent Safety

  27. Red-TTT: Test-Time Training for Automated Jailbreaking Large Language Models

    Oct 4, 2026Tongyan Hu, Hao Li, Xiaogeng Liu +8Test-Time TrainingLLM Jailbreak Attacks

  28. Reactivating Alignment: Defending LLMs from Jailbreaks via Intention-Aware Input-Output Matching

    Oct 3, 2026Luoyu Chen, Weiqi Wang, Chenhan Zhang +2Jailbreak DefenseLLM Safety Alignment

  29. Target-free Latent Safety Alignment

    Oct 3, 2026Luoyu Chen, Weiqi Wang, Chenhan Zhang +3LLM Safety AlignmentAdversarial Robustness of Language Models