Adversarial Robustness of Language Models

Overview

The field examines whether language models preserve safe, accurate, and consistent behavior when facing jailbreaks, prompt injections, meaning-preserving edits, misleading evidence, or pressure across multiple turns. Researchers test models with red-teaming and adversarial benchmarks, then strengthen them through adversarial training, preference and reinforcement learning, parameter-efficient updates, and inference-time guards or steering. Mechanistic methods also inspect and modify internal representations, while certification aims to provide guarantees for defined threat models. A central challenge is that defenses that work on known attacks may fail against adaptive or out-of-distribution ones, and stronger protection can reduce utility or cause over-refusal; evaluations therefore increasingly measure both robustness and capability across diverse settings.

Latest papers

CardsList

207 papers17 papers in the last four weeks, up 21% on the four weeks before. 0.1% of all new papers.

  1. DACE: Diversity-Driven Adversarial Co-Evolution for Robust LLM Safety Alignment

    Nov 17, 2026Peng Yu, Xiaoyu Wen, Zhida He +6LLM SafetyLLM Safety Alignment

  2. Model Immunization Beyond Condition Numbers: The Importance of Plateau Regions

    Nov 16, 2026Quoc Nguyen, Trung Le, Dinh Phung +1Language Model RobustnessAdversarial Robustness of Language Models

  3. Ambiguous Examples Help, But Full Data Wins: Revisiting Dataset Cartography for Extractive Adversarial QA

    Nov 15, 2026Paul K. MandalTraining Data SelectionQuestion Answering

  4. Adversarial Evaluation of Large Language Models for Patient-Friendly Radiology Report Summarization

    Nov 6, 2026Magdalini Paschali, Asad Aali, Arogya Koirala +6Clinical Language Model EvaluationAdversarial Robustness of Language Models

  5. META-IR: Meta-Introspective Reasoning for Adaptive Safety Alignment in LLM

    Nov 6, 2026Mahabubur Rahman Miraj, Hongyu Huang, Nankun Mu +2LLM Safety AlignmentAdversarial Robustness of Language Models

  6. Addition by Subtraction: Toward Mitigating Fragile Safety Alignment in Large Language Models

    Nov 4, 2026Hamid Dashtbani, Alexandra DmitrienkoLLM Safety AlignmentSafety-Preserving Fine-Tuning of Language Models

  7. TraceRouter++: Causal Semantic Routing Realignment via Optimal Transport

    Nov 3, 2026Chuancheng Shi, Shangze Li, Wenhua Wu +5LLM SafetyLLM Safety Alignment

  8. FlipJev: Fast Black-Box Red Teaming Finds Universal Adversarial Suffixes for Typed Decision Models

    Oct 28, 2026Xiaogeng Liu, Xinyan Wang, Chaowei XiaoTyped Decision ModelsAdversarial Attacks

  9. Adversarial Self-Distillation

    Oct 28, 2026Mohammad Sadegh Akhondzadeh, Soroush H. Zargarbashi, Aleksandar BojchevskiAdversarial Robustness of Language ModelsSafety-Preserving Fine-Tuning of Language Models

  10. Uncovering Why LLMs Fail: From Internal Mechanisms to Adversarial Reasoning Trajectories

    Oct 27, 2026Zirui Ding, Xinxin Fan, Hao Yuan +4LLM AuditingMechanistic Interpretability

  11. SentryBench: A Cost-Sensitive Benchmark for Adversarial Robustness of Tool-Using LLM Agents in Public-Safety Deployments

    Oct 25, 2026Md Abu Yusuf, Oyshi Tabassum Aditi, Md Faysal Hosain MazedLLM Agent SafetyAI Agent Safety Benchmarks

  12. Polarity Blindness in LLM Safety: A Systematic Study of Negation, Antonym Substitution, and Adversarial Framing

    Oct 20, 2026Diego Miguel Lozano, Erik Derner, Juan Antonio Pérez-Ortiz +1Language Model Safety EvaluationAdversarial Robustness of Language Models

  13. ABench: Adversarily Benchmarking Large Language Models across Taxonomized Values

    Oct 20, 2026Liping Yang, Yongqi Leng, Jingting Zheng +3LLM Safety BenchmarksLanguage Model Safety Evaluation

  14. Exposing Vulnerability Monoculture Through Systemic Adversarial Robustness

    Oct 19, 2026Leo Elmecker-Plakolm, Lukasz Szpruch, Avishek Joey Bose +1Adversarial RobustnessAdversarial Robustness of Language Models

  15. When Safety Fails Collectively: Robust Alignment Against Harmful Fine-Tuning via Joint Weight Perturbations

    Oct 19, 2026Zhiyuan Wang, Yuezhi Zhou, Zhu Zhang +1Safety-Preserving Fine-Tuning of Language ModelsAdversarial Robustness of Language Models

  16. StableJudge: A Lightweight Adversarial Defense Framework for LLM-as-a-Judge

    Oct 12, 2026Anning Hu, Yangyu Li, Yuqi Huang +2LLM-as-a-JudgePrompt Injection Defense

  17. Exploring Jailbreak Vulnerability Across Depth-Based Dynamic Inference in Large Language Models

    Oct 10, 2026Lass Najmuldeen, Seyedhamidreza MousaviAdversarial Robustness of Language ModelsLLM Jailbreak Attacks

  18. MADS: Multi-Agent Dialog Simulation for Robust Conversational Agents

    Oct 8, 2026Arkajyoti Chakraborty, Adam Zernik, Ishika Kulkarni +6Task-Oriented Dialogue SystemsAdversarial Robustness of Language Models

  19. Target-free Latent Safety Alignment

    Oct 3, 2026Luoyu Chen, Weiqi Wang, Chenhan Zhang +3LLM Safety AlignmentAdversarial Robustness of Language Models

  20. Counting Moves, Weighing Voices: Bayesian Dialectical Argumentation for Calibrated Multi-LLM Councils under Persistent Adversaries

    Oct 1, 2026Ionel Eduard Stan, Paolo NapoletanoLanguage Model CalibrationComputational Argumentation

  21. DeBERTa-ConPara: Attack-Aware and Deployment-Realistic Detection of AI-Generated Text

    Oct 1, 2026Mohamed Mady, Yupei Li, Johannes Reschke +1AI-Generated Text DetectionAdversarial Robustness of Language Models

  22. Towards Robust Numerical Claim Verification

    Sep 30, 2026Peter Røysland Aarnes, Vinay SettyNumerical Reasoning in Language ModelsClaim Verification

  23. ACTR: Aligning Thoughts and Responses for Multilingual Safety in Reasoning LLMs

    Sep 29, 2026Xianhui Zhang, Jian Yu, Chengyu Xie +6Adversarial Attacks on LLMsLLM Safety Alignment

  24. Safer Content or Firmer Refusals? A Hybrid Perturbation Defense for Alignment under Harmful Fine-tuning

    Sep 29, 2026Muhammad Zeeshan Akram, Mufid Kamel Marican, Anvesh Reddy Yenugu +2LLM Safety AlignmentAdversarial Robustness of Language Models

  25. Refusal Localizes, the Damage Relocates: Safety Layers Under Few-Sample Fine-Tuning

    Sep 29, 2026Jungseob Lee, Dongyub Jude Lee, Sugyeong Eo +3LLM SafetyAdversarial Robustness of Language Models