Adversarial Training

Ask about this topic

Overview

Adversarial training studies how to make models perform reliably when inputs, environments, or data distributions are deliberately or naturally shifted. A common approach alternates between finding difficult examples—using methods such as projected-gradient attacks, distributionally robust optimization, or learned attackers—and training the model to handle them; related methods target latent representations, domains, or interaction policies. These techniques are used in vision, language-model safety, detection, and reinforcement learning, with evaluations ranging from bounded perturbation benchmarks to adaptive attacks and shifted environments. A central tension is that robustness to trained or tested threats may not transfer to unseen attacks, while stronger training can cost accuracy, utility, or computation.

Latest papers

CardsList

187 papers31 papers in the last four weeks, up 121% on the four weeks before. 0.2% of all new papers.

  1. Robust Biomedical Publication Type and Study Design Classification with Knowledge-Guided Perturbations

    May 12, 2026Shufan Ming, Joe D. Menke, Neil R. Smalheiser +1Adversarial TrainingDistribution Shift Robustness

    School of Information Sciences University of Illinois Urbana-Champaign Champaign, USA · Department of Psychiatry University of Illinois Chicago Chicago, USA

  2. Robust Multi-Agent Path Finding under Observation Attacks: A Principled Adversarial-Plus-Smoothing Training Recipe

    May 12, 2026Riad AhmedMulti-Agent Path FindingAdversarial Robustness

    University of New Hampshire

  3. PROWL: Prioritized Regret-Driven Optimization for World Model Learning

    May 11, 2026Ahmet H. Güzel, Jenny Seidenschwarz, Benjamin Graham +3Adversarial TrainingWorld Model Learning

    University College London AI Centre · Odyssey · University of Basel

  4. Enhancing Adversarial Robustness in Network Intrusion Detection: A Layer-wise Adaptive Regularization Approach

    May 9, 2026Hira Nasir, Eiman Javed, Balawal Shabir +2Adversarial TrainingNetwork Intrusion Detection

    National Cyber Security Academy (NCSA), Air University, Islamabad, Pakistan. · School of Science, Edith Cowan University, Australia.

  5. Latent Personality Alignment: Improving Harmlessness Without Mentioning Harms

    May 8, 2026Linh Le, David Williams-King, Mohamed Amine Merzouk +2Adversarial TrainingNeural Network Robustness

    McGill University · Mila – Quebec AI Institute · ERA +1

  6. Exposing and Mitigating Temporal Attack in Deepfake Video Detection

    May 8, 2026Zheyuan Gu, Minghao Shao, Zhen Wang +4Adversarial TrainingAdversarial Robustness

    1Peking University · 2New York University · 3Huzhou University +2

  7. Dual-Agent Co-Training for Health Coaching via Implicit Adversarial Preference Optimization

    May 7, 2026Da Long, Lingyi Fu, Diya Michelle Rao +3Adversarial TrainingMulti-Agent LLM Systems

    Kahlert School of Computing University of Utah · Department of Health and Kinesiology University of Utah

  8. Streaming Adversarial Robustness in Fuzzy ARTMAP: Mechanism-Aligned Evaluation, Progressive Training, and Interpretable Diagnostics

    May 7, 2026Shane Cairns, Leonardo Enzo Brito da Silva, Sasha Petrenko +2Adversarial TrainingNeural Network Robustness

    Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, MO, USA · Instituto Metrópole Digital, Universidade Federal do Rio Grande do Norte, Natal, RN 59078-900, Brazil · Kummer Institute Center for Artificial Intelligence and Autonomous Systems (KICAIAS), Missouri University of Science and Technology, Rolla, MO, USA

  9. Band Together: Untargeted Adversarial Training with Multimodal Coordination against Evasion-based Promotion Attacks

    May 7, 2026Guanmeng Xian, Ning Yang, Philip S. YuAdversarial TrainingMultimodal Robustness

    Sichuan University, Chengdu, China · University of Illinois at Chicago, USA

  10. Information Theoretic Adversarial Training of Large Language Models

    May 6, 2026Yiwei Zhang, Jeremiah Birrell, Reza Ebrahimi +3Adversarial TrainingLLM Alignment

    Purdue University · West Lafayette, IN 47907, USA · Texas State University +5

  11. Fight Poison with Poison: Enhancing Robustness in Few-shot Machine-Generated Text Detection with Adversarial Training

    May 4, 2026Wenjing Duan, Qi Zhou, Yuanfan LiAdversarial TrainingAI-Generated Text Detection

    Faculty of Electronic and Information Engineering, Xi’an Jiaotong University

  12. Manifold-Constrained Adversarial Training for Long-Tailed Robustness via Geometric Alignment

    May 4, 2026Guanmeng Xian, Ning Yang, Philip S. YuAdversarial TrainingLong-Tailed Classification

    Sichuan University, Chengdu, China · University of Illinois at Chicago, USA

  13. Asymmetric Invertible Threat: Learning Reversible Privacy Defense for Face Recognition

    May 2, 2026Jiabei Zhang, Ziyuan Yang, Andrew Beng Jin Teoh +1Adversarial TrainingAdversarial Attacks

    School of Cyber Science and Engineering, Sichuan University · Lee Kong Chian School of Medicine, Nanyang Technological University · School of Electrical and Electronic Engineering, Yonsei University

  14. LASE: Language-Adversarial Speaker Encoding for Indic Cross-Script Identity Preservation

    May 1, 2026Venkata Pushpak Teja MentaAdversarial TrainingAdversarial Representation Learning

    Praxel Ventures

  15. Quantum Interval Bound Propagation for Certified Training of Quantum Neural Networks

    May 1, 2026Emma Andrews, Nahyeon Kim, Prabhat MishraAdversarial TrainingAdversarial Robustness

    University of Florida, Gainesville, FL, USA

  16. Dynamic Adversarial Fine-Tuning Reorganizes Refusal Geometry

    Apr 29, 2026Wenhao Lan, Shan Li, Xinhua Lai +4Adversarial TrainingLanguage Model Safety Evaluation

    University of Chinese Academy of Sciences, Beijing, China · Inner Mongolia University of Technology, Inner Mongolia, China · Tsinghua University, Beijing, China +1

  17. SafeReview: Defending LLM-based Review Systems Against Adversarial Hidden Prompts

    Apr 29, 2026Yuan Xin, Yixuan Weng, Minjun Zhu +5Adversarial TrainingAdversarial Prompt Generation

    1CISPA · 2Westlake University · 3Southern University of Science and Technology +1

  18. Robust Alignment: Harmonizing Clean Accuracy and Adversarial Robustness in Adversarial Training

    Apr 29, 2026Yanyun Wang, Qingqing Ye, Li Liu +2Adversarial TrainingNeural Network Robustness

    1HK PolyU · 2HKUST (GZ) · 2HKUST (GZ

  19. Unveiling the Backdoor Mechanism Hidden Behind Catastrophic Overfitting in Fast Adversarial Training

    Apr 27, 2026Mengnan Zhao, Lihe Zhang, Tianhang Zheng +2Adversarial TrainingNeural Network Generalization

    School of Computer Science and Technology, Anhui University, Hefei 230601, China · School of Information and Communication Engineering, Dalian University of Technology (DUT), Dalian 116024, China · School of Computer Science and Technology, Zhejiang University, Hangzhou 310058, China +1

  20. Mitigating Error Amplification in Fast Adversarial Training

    Apr 27, 2026Mengnan Zhao, Lihe Zhang, Bo Wang +3Adversarial TrainingNeural Network Generalization

    Anhui University, Anhui, China · Dalian University of Technology, Liaoning, China · Zhejiang University, Zhejiang, China +1

  21. Supervised Learning Has a Necessary Geometric Blind Spot: Theory, Consequences, and Minimal Repair

    Apr 23, 2026Vishal RajputAdversarial TrainingRepresentation Geometry

    1KU Leuven, Belgium.

  22. FastAT Benchmark: A Comprehensive Framework for Fair Evaluation of Fast Adversarial Training Methods

    Apr 22, 2026Chao Pan, Xin YaoAdversarial TrainingAdversarial Robustness

    Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen 518055, China · School of Data Science, Lingnan University, Hong Kong, China

  23. Benign Overfitting in Adversarial Training for Vision Transformers

    Apr 21, 2026Jiaming Zhang, Meng Ding, Shaopeng Fu +2Adversarial TrainingNeural Network Generalization

    Division of CEMSE, King Abdullah University of Science and Technology · School of Statistics, Renmin University of China · Department of Computer Science and Engineering, State University of New York at Buffalo +1

  24. Improving LLM Code Reasoning via Semantic Equivalence Self-Play with Formal Verification

    Apr 18, 2026Antonio Valerio Miceli Barone, Poon Tsz NokAdversarial TrainingSelf-Play RL

    School of Informatics, University of Edinburgh

  25. Beyond Uniform Sampling: Synergistic Active Learning and Input Denoising for Robust Neural Operators

    Apr 14, 2026Samrendra Roy, Souvik Chakraborty, Syed Bahauddin AlamAdversarial RobustnessNeural Operators

    Department of Nuclear, Plasma, and Radiological Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA · Department of Applied Mechanics, Indian Institute of Technology Delhi, New Delhi, India · National Center for Supercomputing Applications, University of Illinois Urbana-Champaign, Urbana, IL, USA

  26. Understanding and Improving Continuous Adversarial Training for LLMs via In-context Learning Theory

    Apr 14, 2026Shaopeng Fu, Di WangAdversarial TrainingAdversarial Robustness of Language Models

    Provable Responsible AI and Data Analytics (PRADA) Lab, King Abdullah University of Science and Technology, Saudi Arabia

  27. Efficient Adversarial Training via Criticality-Aware Fine-Tuning

    Apr 14, 2026Wenyun Li, Zheng Zhang, Dongmei Jiang +2Adversarial TrainingAdversarial Robustness

    Harbin Institute of Technology, Shenzhen · Pengcheng Laboratory · Pazhou Laboratory (Huangpu)

  28. Combating Pattern and Content Bias: Adversarial Feature Learning for Generalized AI-Generated Image Detection

    Apr 14, 2026Haifeng Zhang, Qinghui He, Xiuli Bi +3Adversarial DebiasingAI-Generated Image Detection

    Chongqing Key Laboratory of Image Cognition, School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China · School of Artificial Intelligence, Chongging Key Laboratory of Image Cognition, Chongging University of Posts and Telecommunications, Chongqing 400065, China · Faculty of Science and Technology of the University of Macau, Macau 999078, China +1

  29. Self-Adversarial One Step Generation via Condition Shifting

    Apr 14, 2026Deyuan Liu, Peng Sun, Yansen Han +3One-Step Generative ModelingT2I Diffusion Models

    Westlake University · Zhejiang University · Shanghai Innovation Institute +1

  30. Learning Robustness at Test-Time from a Non-Robust Teacher

    Apr 13, 2026Stefano Bianchettin, Giulio Rossolini, Giorgio ButtazzoAdversarial RobustnessTest-Time Adaptation

    Department of Excellence in Robotics and AI, Sant’Anna School of Advanced Study, Via Moruzzi, 1, Pisa, 56124, Tuscany, Italy