Adversarial Robustness

Ask about this topic

Overview

Adversarial robustness asks whether a model still predicts or acts reliably when an attacker makes small, strategic changes to its inputs, training data, or operating environment. Common approaches include adversarial training, which exposes models to attacks during learning; randomized smoothing and other certification methods, which provide conditional guarantees; and input purification, representation regularization, and test-time adaptation. Evaluations span image classifiers and detectors, language and multimodal models, graphs, time series, and safety-critical systems, using both empirical attacks and formal bounds. A central tension is that gains can depend on the attack, data, and deployment setting, while stronger robustness may cost clean accuracy or compute; adaptive, realistic evaluation and guarantees that match real threats remain open challenges.

Latest papers

CardsList

481 papers49 papers in the last four weeks, up 26% on the four weeks before. 0.3% of all new papers.

  1. Neural Uncertainty Principle: A Unified View of Adversarial Fragility and LLM Hallucination

    Mar 20, 2026Dong-Xiao Zhang, Hu Lou, Jun-Jie Zhang +2Hallucination in Language ModelsAdversarial Robustness

    Northwest Institute of Nuclear Technology, Xi’an, Shaanxi 710024, China. · Department of Computer Science and Technology, Institute for AI, BNRist Center, THBI Lab, Tsinghua-Bosch Joint Center for ML, Tsinghua University, Beijing 10084, China · the School of Mathematics and Statistics and the Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, China.

  2. Robustness, Cost, and Attack-Surface Concentration in Phishing Detection

    Mar 19, 2026Julian Allagan, Mohamed Elbakary, Zohreh Safari +4Phishing DetectionAdversarial Robustness

    Department of Mathematics, Computer Science, and Engineering Technology Elizabeth City State University, Elizabeth City, NC 27909, USA

  3. Complementary Text-Guided Attention for Zero-Shot Adversarial Robustness

    Mar 19, 2026Lu Yu, Haiyang Zhang, Changsheng XuAttention-Based Adversarial AttacksContrastive Learning for VLMs

    School of Computer Science and Engineering, Tianjin University of Technology, 300384, China · State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China · School of Artificial Intelligence, University of the Chinese Academy of Sciences, Beijing, 100049, China

  4. rSDNet: Unified Robust Neural Learning against Label Noise and Adversarial Attacks

    Mar 18, 2026Suryasis Jana, Abhik GhoshNeural Network RobustnessRobust Classification

    Indian Statistical Institute, Kolkata, India

  5. SLAM Adversarial Lab: An Extensible Framework for Visual SLAM Robustness Evaluation under Adverse Conditions

    Mar 17, 2026Mohamed Hefny, Karthik Dantu, Steven Y. KoVisual SLAMAdversarial Robustness

    Simon Fraser University. · University at Buffalo.

  6. REFORGE: Multi-modal Attacks Reveal Vulnerable Concept Unlearning in Image Generation Models

    Mar 17, 2026Yong Zou, Haoran Li, Fanxiao Li +5Adversarial AttacksAdversarial Robustness

    Yunnan University · Northeastern University · National University of Singapore

  7. RESQ: A Unified Framework for REliability- and Security Enhancement of Quantized Deep Neural Networks

    Mar 16, 2026Ali Soltan Mohammadi, Samira Nazari, Ali Azarpeyvand +5Adversarial RobustnessQuantization Robustness

    University of Zanjan, Zanjan, Iran · Brandenburg Technical University, Cottbus, Germany · Tallinn University of Technology, Tallinn, Estonia +1

  8. Shapes are not enough: CONSERVAttack and its use for finding vulnerabilities and uncertainties in machine learning applications

    Mar 14, 2026Philip Bechtle, Lucie Flek, Philipp Alexander Jung +7Adversarial RobustnessAdversarial Perturbations

    Institute of Physics, University of Bonn, Germany. · Bonn-Aachen Institute of Technology, University of Bonn, Germany. · Physics Institute III A, RWTH Aachen University, Germany. +1

  9. Benchmarking the Energy Cost of Assurance in Neuromorphic Edge Robotics

    Mar 14, 2026Sylvester KaczmarekAdversarial RobustnessNeuromorphic Computing

    Department of Computing, Imperial College London, London, United Kingdom

  10. Diffusion-Based Feature Denoising and Using NNMF for Robust Brain Tumor Classification

    Mar 13, 2026Hiba Adil Al-kharsan, Róbert RajkóAdversarial PurificationMedical Image Classification

    Doctoral School of Computer Science, University of Szeged, Árpád tér 2, H-6720 Szeged, Hungary · University Research and Innovation Center (EKIK), Óbuda University, Bécsi út 96/b, H-1034 Budapest, Hungary · Academic Staff, Doctoral School of Computer Science, University of Szeged, Árpád tér 2, H-6720 Szeged, Hungary

  11. Purify Once, Edit Freely: Breaking Image Protections under Model Mismatch

    Mar 13, 2026Qichen Zhao, Shengfang Zhai, Xinjian Bai +4Adversarial PurificationAdversarial Robustness

    Peking University · National University of Singapore · The University of Western Australia

  12. What Makes VLMs Robust? Towards Reconciling Robustness and Accuracy in Vision-Language Models

    Mar 13, 2026Sen Nie, Jie Zhang, Zhongqi Wang +3VLM RobustnessAdversarial Robustness

    State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China · University of Chinese Academy of Sciences, Beijing 100049, China

  13. Spectral Defense Against Resource-Targeting Attack in 3D Gaussian Splatting

    Mar 13, 2026Yang Chen, Yi Yu, Jiaming He +33D Gaussian SplattingAdversarial Robustness

    Nanyang Technological University · UESTC · Tsinghua University +2

  14. STRAP-ViT: Segregated Tokens with Randomized -- Transformations for Defense against Adversarial Patches in ViTs

    Mar 13, 2026Nandish Chattopadhyay, Anadi Goyal, Chandan Karfa +1Adversarial RobustnessVision Transformer

    Indian Institute of Technology, Guwahati, India · Nanyang Technological University, Singapore

  15. Lyapunov Stable Graph Neural Flow

    Mar 13, 2026Haoyu Chu, Xiaotong Chen, Wei Zhou +4Graph Neural NetworksAdversarial Robustness

    School of Computer Science and Technology / School of Artificial Intelligence, China University of Mining and Technology, Xuzhou 221008, China · School of Information Science and Technology, University of Science and Technology of China, Hefei 230026, China

  16. Evaluating randomized smoothing as a defense against adversarial attacks in trajectory prediction

    Mar 11, 2026Julian F. Schumann, Eduardo Figueiredo, Frederik Baymler Mathiesen +3Probabilistic Trajectory PredictionAdversarial Robustness

    Department of Cognitive Robotics, TU Delft, Delft, Netherlands · Delft Center for Systems and Control, TU Delft, Delft, Netherlands

  17. Backdoor Directions in Vision Transformers

    Mar 11, 2026Sengim Karayalcin, Marina Krcek, Pin-Yu Chen +1Backdoor DetectionVision Transformer

    Leiden University · Radboud University · IBM Research +1

  18. Enhancing Network Intrusion Detection Systems: A Multi-Layer Ensemble Approach to Mitigate Adversarial Attacks

    Mar 11, 2026Nasim Soltani, Shayan Nejadshamsi, Zakaria Abou El Houda +4Network Intrusion DetectionAdversarial Robustness

    Institut national de la recherche scientifique (INRS-EMT), Université du Québec, Montréal, Québec, Canada · INRS-UQO Mixed Research Unit on Cybersecurity, Gatineau, Québec, Canada · Concordia Institute for Information Systems Engineering (CIISE), Concordia University, Montréal, Québec, Canada +2

  19. RESBev: Making BEV Perception More Robust

    Mar 10, 2026Lifeng Zhuo, Kefan Jin, Zhe Liu +1Autonomous Driving PerceptionAdversarial Robustness

    Shanghai Jiao Tong University

  20. All Vehicles Can Lie: Efficient Adversarial Defense in Fully Untrusted-Vehicle Collaborative Perception via Pseudo-Random Bayesian Inference

    Mar 9, 2026Yi Yu, Libing Wu, Zhuangzhuang Zhang +3Adversarial RobustnessCooperative Perception

    School of Cyber Science and Engineering, Wuhan University · Cyberspace Institute of Advanced Technology, Guangzhou University

  21. Obliviator Reveals the Cost of Nonlinear Guardedness in Concept Erasure

    Mar 8, 2026Ramin Akbari, Milad Afshari, Vishnu Naresh BoddetiConcept ErasureAdversarial Robustness

    Michigan State University

  22. Beyond the Patch: Exploring Vulnerabilities of Visuomotor Policies via Viewpoint-Consistent 3D Adversarial Object

    Mar 5, 2026Chanmi Lee, Minsung Yoon, Woojae Kim +2Adversarial AttacksPhysical Adversarial Attacks

    The School of Computing at the Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, Republic of Korea

  23. Differential Privacy in Two-Layer Networks: How DP-SGD Harms Fairness and Robustness

    Mar 5, 2026Ruichen Xu, Kexin ChenDifferentially Private Stochastic Gradient DescentAlgorithmic Fairness

  24. Robustness of Agentic AI Systems via Adversarially-Aligned Jacobian Regularization

    Mar 4, 2026Furkan Mumcu, Yasin YilmazAdversarial RobustnessAdversarial Robustness of Language Models

    University of South Florida

  25. Solving adversarial examples requires solving exponential misalignment

    Mar 3, 2026Alessandro Salvatore, Stanislav Fort, Surya GanguliAdversarial ExamplesAdversarial Robustness

    Department of Applied Physics, Stanford University, CA, USA · Aisle, San Francisco, CA, USA

  26. On the Rate of Convergence of GD in Non-linear Neural Networks: An Adversarial Robustness Perspective

    Mar 2, 2026Guy Smorodinsky, Sveta Gimpleson, Itay SafranNeural Network Training DynamicsGradient Descent Dynamics

    Faculty of Computer and Information Science, Ben-Gurion University of the Negev, Israel · Department of Computer Science, Reichman University, Israel

  27. Explanation-Guided Adversarial Training for Robust and Interpretable Models

    Mar 2, 2026Chao Chen, Yanhui Chen, Shanshan Lin +4Adversarial TrainingAdversarial Robustness

    Harbin Institute of Technology (Shenzhen) · Fuzhou University · NLPR, MAIS, Institute of Automation, Chinese Academy of Sciences

  28. RA-Det: Towards Universal Detection of AI-Generated Images via Robustness Asymmetry

    Mar 2, 2026Xinchang Wang, Yunhao Chen, Yuechen Zhang +4AI-Generated Image DetectionAdversarial Robustness

    Jiangnan University · Fudan University

  29. S2O: Enhancing Adversarial Training with Second-Order Statistics of Weights

    Mar 1, 2026Gaojie Jin, Xinping Yi, Wei Huang +2Adversarial TrainingAdversarial Robustness

    Department of Computer Science, University of Exeter, Exeter, UK · National Mobile Communications Research Laboratory, Southeast University, Nanjing, China · Department of Computer Science, University of Liverpool, Liverpool, UK

  30. AMDS: Attack-Aware Multi-Stage Defense System for Network Intrusion Detection with Two-Stage Adaptive Weight Learning

    Mar 1, 2026Oluseyi Olukola, Nick RahimiNetwork Intrusion DetectionAdversarial Robustness

    School of Computing Sciences and Computer Engineering, University of Southern Mississippi, Hattiesburg, MS, USA