Adversarial Robustness

Ask about this topic

Overview

Adversarial robustness asks whether a model still predicts or acts reliably when an attacker makes small, strategic changes to its inputs, training data, or operating environment. Common approaches include adversarial training, which exposes models to attacks during learning; randomized smoothing and other certification methods, which provide conditional guarantees; and input purification, representation regularization, and test-time adaptation. Evaluations span image classifiers and detectors, language and multimodal models, graphs, time series, and safety-critical systems, using both empirical attacks and formal bounds. A central tension is that gains can depend on the attack, data, and deployment setting, while stronger robustness may cost clean accuracy or compute; adaptive, realistic evaluation and guarantees that match real threats remain open challenges.

Latest papers

CardsList

481 papers49 papers in the last four weeks, up 26% on the four weeks before. 0.3% of all new papers.

  1. TraderBench: How Robust Are AI Agents in Adversarial Capital Markets?

    Feb 27, 2026Xiaochuang Yuan, Hui Xu, Silvia Xu +2AI Agent EvaluationAI Agent Benchmarks

    UC Santa Cruz

  2. ThreatFormer-IDS: Robust Transformer Intrusion Detection with Zero-Day Generalization and Explainable Attribution

    Feb 26, 2026Srikumar NayakExplainable Intrusion DetectionIoT Intrusion Detection

    Incedo Inc, USA

  3. Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemes

    Feb 25, 2026Xavier Pleimling, Sifat Muhammad Abdullah, Gunjan Balde +4Adversarial AttacksAdversarial Robustness

    University of Texas at San Antonio San Antonio, TX, USA

  4. Robustness in sparse artificial neural networks trained with adaptive topology

    Feb 25, 2026Bendegúz Sulyok, Gergely Palla, Filippo Radicchi +1Dynamic Sparse TrainingSparse Neural Networks

    Dept. of Biological Physics, Eötvös Loránd University, Budapest, Hungary · Semmelweis University, Faculty of Health and Public Administration, Health Services Management Training Centre, Budapest, Hungary · Center for Complex Networks and Systems Research Luddy School of Informatics, Computing, and Engineering Indiana University Bloomington, USA

  5. Resilient Federated Chain: Transforming Blockchain Consensus into an Active Defense Layer for Federated Learning

    Feb 25, 2026Mario García-Márquez, Nuria Rodríguez-Barroso, M. Victoria Luzón +1Blockchain-Based Federated LearningFederated Learning

    Department of Computer Science and Artificial Intelligence, Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI) University of Granada Granada · Department of Software Engineering, Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI) University of Granada Granada

  6. Adversarial Robustness of Deep Learning-Based Thyroid Nodule Segmentation in Ultrasound

    Feb 25, 2026Nicholas Dietrich, David McShannonAdversarial RobustnessBlack-Box Adversarial Attacks

    Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada · Faculty of Engineering, McMaster University, Hamilton, Ontario, Canada

  7. Robust Spiking Neural Networks Against Adversarial Attacks

    Feb 24, 2026Shuai Wang, Malu Zhang, Yulin Jiang +7Adversarial RobustnessSpiking Neural Networks

    University of Electronic Science and Technology of China · Shenzhen Loop Area Institute · Northumbria University +1

  8. BiRQA: Bidirectional Robust Quality Assessment for Images

    Feb 23, 2026Aleksandr Gushchin, Dmitriy S. Vatolin, Anastasia AntsiferovaImage Quality AssessmentAdversarial Robustness

    ISP RAS Research Center for Trusted Artificial Intelligence, Moscow, Russia · MSU Institute for Artificial Intelligence, Moscow, Russia · Lomonosov Moscow State University, Moscow, Russia +1

  9. Reliable Abstention under Adversarial Injections: Tight Lower Bounds and New Upper Bounds

    Feb 23, 2026Ezra Edelman, Surbhi GoelStatistical Learning TheoryAdversarial Robustness

    University of Pennsylvania

  10. Decoupling Defense Strategies for Robust Image Watermarking

    Feb 23, 2026Jiahui Chen, Zehang Deng, Zeyu Zhang +3Robust WatermarkingAdversarial Robustness

    Tsinghua University · Swinburne University of Technology · The Australian National University +2

  11. Expanding the Role of Diffusion Models for Robust Classifier Training

    Feb 23, 2026Pin-Han Huang, Shang-Tse Chen, Hsuan-Tien LinAdversarial RobustnessAdversarial Training

    National Taiwan University

  12. DefenseSplat: Enhancing the Robustness of 3D Gaussian Splatting via Frequency-Aware Filtering

    Feb 22, 2026Yiran Qiao, Yiren Lu, Yunlai Zhou +43D Gaussian Splatting3D Reconstruction

    Case Western Reserve University, Cleveland OH 44106, USA

  13. MANATEE: Inference-Time Lightweight Diffusion Based Safety Defense for LLMs

    Feb 21, 2026Chun Yan Ryan Kan, Tommy Tran, Vedant Yadav +4Jailbreak DefenseLLM Safety

  14. Theoretical Lower Bounds on the Robustness of Deep ReLU Networks

    Feb 21, 2026Věra KůrkováNeural Network RobustnessAdversarial Robustness

    Institute of Computer Science of the Czech Academy of Sciences, Pod Vodárenskou věží 2, 18207 Prague, Czech Republic

  15. On the Adversarial Robustness of Discrete Image Tokenizers

    Feb 20, 2026Rishika Bhagwatkar, Irina Rish, Nicolas Flammarion +1Adversarial RobustnessAdversarial Examples

    Mila - Quebec AI Institute · EPFL · ELLIS Institute Finland - Aalto University

  16. A Geometric Probe of the Accuracy-Robustness Trade-off: Sharp Boundaries in Symmetry-Breaking Dimensional Expansion

    Feb 20, 2026Yu Bai, Zhe Wang, Jiarui Zhang +3Adversarial RobustnessAdversarial Attacks

    Northwest Institute of Nuclear Technology, Xi’an, 710024, P.R. China

  17. Bigger Is Safer: Provable Robustness in In-Context Learning Scales with Capacity

    Feb 19, 2026Di Zhang, Ningxu Zhang, Zimeng LiuIn-Context LearningDistribution Shift Robustness

    School of AI and Advanced Computing Xi’an Jiaotong-Liverpool University

  18. Benchmarking Adversarial Robustness and Adversarial Training Strategies for Object Detection

    Feb 18, 2026Alexis Winter, Jean-Vincent Martini, Romaric Audigier +2Adversarial Attacks on Object DetectorsAdversarial Robustness

    Universit´e Paris-Saclay, CEA, List, F-91191, Palaiseau, France.

  19. Is Mamba Reliable for Medical Imaging?

    Feb 16, 2026Banafsheh Saber Latibari, Najmeh Nazari, Daniel Brignac +3Adversarial RobustnessMamba

    Department of Electrical and Computer Engineering, University of Arizona, Tucson, AZ, USA · Department of Electrical and Computer Engineering, University of California, Davis, CA, USA · Department of Computer Engineering and Computer Science, California State University, Long Beach, Long Beach, CA, USA

  20. Universal Image Immunization against Diffusion-based Image Editing via Semantic Injection

    Feb 16, 2026Chanhui Lee, Donggyu Choi, Seunghyun Shin +2Adversarial RobustnessAdversarial Perturbations

    POSTECH · GIST · Yonsei University

  21. Cross-Modal Robustness Transfer (CMRT): Training Robust Speech Translation Models Using Adversarial Text

    Feb 12, 2026Abderrahmane Issam, Yusuf Can Semerci, Jan Scholtes +1Speech TranslationAdversarial Robustness

    Department of Advanced Computing Sciences Maastricht University

  22. Selective Fine-Tuning for Targeted and Robust Concept Unlearning

    Feb 8, 2026Mansi, Avinash Kori, Francesca Toni +1Fine-TuningAdversarial Robustness

    Department of Computing Imperial College London, United Kingdom

  23. Same Answer, Different Representations: Hidden instability in VLMs

    Feb 6, 2026Farooq Ahmad Wani, Alessandro Suglia, Rohit Saxena +6VLM EvaluationVLM Robustness

    Sapienza University of Rome · University of Edinburgh · University of Oxford +5

  24. Perturbing the Phase: Analyzing Adversarial Robustness of Complex-Valued Neural Networks

    Feb 6, 2026Florian Eilers, Christof Duhme, Xiaoyi JiangAdversarial AttacksNeural Network Robustness

    Department of Computer Science University of Münster Münster, Germany

  25. RVCBench: Benchmarking the Robustness of Voice Cloning Across Modern Audio Generation Models

    Jan 31, 2026Ruinan Jin, Xinting Liao, Hanlin Yu +2Adversarial RobustnessAudio Generation

    The University of British Columbia · Vector Institute

  26. TrojanGYM: A Detector-in-the-Loop LLM for Adaptive RTL Hardware Trojan Insertion

    Jan 23, 2026Saideep Sreekumar, Zeng Wang, Akashdeep Saha +6Backdoor AttacksAdversarial Robustness

    NYU Abu Dhabi, Abu Dhabi, UAE · NYU Tandon School of Engineering, New York, USA

  27. Feature-Space Smoothing: Certified Robustness of Deep Representations

    Jan 22, 2026Song Xia, Meiwen Ding, Chenqi Kong +2Adversarial RobustnessCertified Robustness

    Rapid-Rich Object Search Lab, School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore · Pengcheng Laboratory, Shenzhen, China

  28. DDSA: Dual-Domain Strategic Attack for Spatial-Temporal Efficiency in Adversarial Robustness Testing

    Jan 18, 2026Jinwei Hu, Shiyuan Meng, Yi Dong +1Adversarial AttacksAdversarial Robustness

    University of Liverpool, Liverpool, UK · Shanghai Artificial Intelligence Laboratory, Shanghai, China

  29. Dual Randomized Smoothing: Beyond Global Noise Variance

    Dec 1, 2025Chenhao Sun, Yuhao Mao, Martin VechevRandomized SmoothingNeural Network Robustness

    Department of Computer Science, ETH Zürich, Switzerland

  30. Did Models Learn Sufficiently? Attribution-Guided Training via Subset-Selected Counterfactual Augmentation

    Nov 15, 2025Yannan Chen, Ruoyu Chen, Wei Wang +6Adversarial RobustnessOOD Generalization

    School of Cyber Science and Technology, Sun Yat-Sen University, Guangdong Province, China · Institute of Perception, PC Laboratory, Guangdong Province, China · University of Chinese Academy of Sciences, Beijing, China +3