Jailbreak Attack Evaluation

Latest papers

CardsList

36 papers10 papers in the last four weeks, up 43% on the four weeks before. 0.1% of all new papers.

  1. SEMA-Auto: Sighted and Efficient Multi-Turn Attack with Autonomy

    Oct 26, 2026Mingqian Feng, Xiaodong Liu, Weiwei Yang +7Adversarial Attacks on LLMsJailbreak Attacks

  2. Identically Trained Language Models Break on Different Jailbreaks

    Oct 25, 2026Chi-Wei Chang, Mu-Tien Kuo, Kuan-Wei Lee +1Language Model Safety EvaluationLLM Jailbreak Attacks

  3. Concerns in Benchmarking Jailbreaks: An Empirical Study of Attack Success Rates

    Oct 19, 2026Leon Tu Nguyen, Rohan Menon, Rafael Tappe Maestro +2Jailbreak Attack EvaluationLLM Safety Benchmarks

  4. Beyond Attack Success Rate: Cost-Aware Metric for Evaluating Iterative LLM Jailbreaks

    Oct 19, 2026Rohan Menon, Chih-Hong ChengJailbreak Attack EvaluationJailbreak Attacks

  5. Multiple Turns, Short Horizons: Measuring Effective-Horizon Compression in Jailbreaks

    Oct 16, 2026Zhipeng Wei, Michael Lee, N. Benjamin ErichsonMulti-Turn Jailbreak AttacksJailbreak Attack Evaluation

  6. RedDarwin: Evolving Jailbreak Skills against Frontier LLMs

    Oct 14, 2026Zhouyuan Ma, Yutao Wu, Hanxun Huang +3LLM Jailbreak AttacksLLM Red Teaming

  7. Did the LLM Answer the Question? A Semantic Reconstruction Game for Jailbreak Evaluation

    Oct 13, 2026Liam Davis, Romain Emil-Popescu, Suman JanaJailbreak Attack EvaluationLLM Safety Evaluation

  8. ATTCK-R: Knowledge-Aware Long-Horizon Jailbreaking for Protected LLMs

    Oct 12, 2026Md Mushfiqur Rahman, Tobias Rohde, Rahul Tripathi +2LLM Jailbreak AttacksLLM Red Teaming

  9. PatchBench: Measuring Collateral Damage in Activation Patching

    Oct 7, 2026Alexi Canesse, Mathis Le Bail, Maël Jenny +3Jailbreak Attack EvaluationLanguage Model Safety Evaluation

  10. MLCommons Jailbreak Benchmark v1.0

    Oct 2, 2026Carsten Maple, Cagatay Yucel, Isaac Holeman +35Jailbreak Attack EvaluationLLM Safety Benchmarks

  11. Escaping Alignment: A Physical Trap Model of Best-of-N Jailbreaking

    Sep 26, 2026Marco BiroliJailbreak AttacksLLM Jailbreak Attacks

  12. SoK: Rethinking Jailbreaking in the Era of Agentic AI: Attacks, Defenses, and Practical Consideration

    Sep 11, 2026Md Jueal Mia, Yanzhao Wu, Selcuk Uluagac +1Language Model Safety EvaluationJailbreak Robustness

  13. Style Over Substance: Content-Invariant Wrappers Flip LLM Safety-Judge Verdicts

    Sep 8, 2026Yongxi Zhou, Wenbo Ye, Yuanzhe Liu +3LLM GuardrailsLLM-as-a-Judge

  14. Validity-Aware Jailbreak Evaluation for Large Language Models

    Aug 31, 2026Qilong Wu, Sahil Wadhwa, Pranab Mohanty +2Language Model Safety EvaluationLLM Auditing

  15. The Fragility of Jailbreak Robustness Across Operational States

    Aug 31, 2026Yuna Park, Hwang Youn Kim, Yujin Kim +3Prompt SensitivityLanguage Model Safety Evaluation

  16. Fair ASR: Re-Evaluating Black-Box Jailbreaks under Shared Target-Call Budgets

    Aug 18, 2026Zhida He, Xiaoyu Wen, Han Qi +5Jailbreak AttacksLLM Jailbreak Attacks

  17. Measuring the Wrong Thing: Internal Harmfulness Scores Anti-Rank Successful Jailbreaks

    Aug 10, 2026Mingyu Luo, Ming Deng, Zilang Qiu +8Safety FilteringLLM Jailbreak Attacks

  18. JailMeter: An Evidence-Based Evaluation Framework for Jailbreak Attacks on Large Language Models

    Jul 20, 2026Qingjia Huang, Jingyu Zhang, Jianguo Wu +6LLM Safety BenchmarksLLM Jailbreak Attacks

  19. Jailbreaking for the Average Jane: Choosing Optimal Jailbreaks via Bandit Algorithms for Automatically Enhanced Queries

    Jun 25, 2026Prarabdh Shukla, Ritik, Suhas Rao +2Adversarial Attacks on LLMsLLM Jailbreak Attacks

  20. Black-box, Adaptive, Efficient, Transferable, Harmful, Applicable... Attacks Are All You Need to Break LLMs

    Jun 2, 2026Vincent Limbach, Jonas Dornbusch, David Lüdke +2LLM Jailbreak AttacksLLM Safety Evaluation

  21. New Wide-Net-Casting Jailbreak Attacks Risk Large Models

    May 16, 2026Qiuchi Xiang, Haoxuan Qu, Hossein Rahmani +1Language Model Safety EvaluationJailbreak Attacks

  22. The Great Pretender: A Stochasticity Problem in LLM Jailbreak

    May 14, 2026Jean-Philippe Monteuuis, Cong Chen, Jonathan PetitLLM Safety BenchmarksLLM Evaluation

  23. MT-JailBench: A Modular Benchmark for Understanding Multi-Turn Jailbreak Attacks

    May 10, 2026Xinkai Zhang, Zhipeng Wei, Huanli Gong +4Language Model Safety EvaluationJailbreak Attacks