Adversarial Robustness

Ask about this topic

Overview

Adversarial robustness asks whether a model still predicts or acts reliably when an attacker makes small, strategic changes to its inputs, training data, or operating environment. Common approaches include adversarial training, which exposes models to attacks during learning; randomized smoothing and other certification methods, which provide conditional guarantees; and input purification, representation regularization, and test-time adaptation. Evaluations span image classifiers and detectors, language and multimodal models, graphs, time series, and safety-critical systems, using both empirical attacks and formal bounds. A central tension is that gains can depend on the attack, data, and deployment setting, while stronger robustness may cost clean accuracy or compute; adaptive, realistic evaluation and guarantees that match real threats remain open challenges.

Latest papers

CardsList

481 papers49 papers in the last four weeks, up 26% on the four weeks before. 0.3% of all new papers.

  1. Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customization

    Jul 14, 2026Yuxin Huang, Ziming Hong, Mingming Gong +3Video Diffusion ModelsAdversarial Robustness

    1Sydney AI Centre, The University of Sydney · University of Melbourne · 5Mohamed bin Zayed University of Artificial Intelligence +2

  2. VanillaBench: The Hidden Accuracy Cost of Adversarial Robustness

    Jul 14, 2026Niklas BunzelAdversarial TrainingNeural Network Robustness

    Fraunhofer SIT / TU Darmstadt / ATHENE · Darmstadt, Germany

  3. Reducing information dependency does not cause training data privacy. Adversarially non-robust features do

    Jul 14, 2026Rasmus Torp, Shailen K. Smith, Adam BreuerModel Inversion AttacksNeural Network Robustness

    Department of Computer Science Dartmouth College · Department of Computer Science & Department of Government Dartmouth College

  4. Did We Actually Fix It? An Independent Adversarial Stress-Test of Post-Point-Adjustment Evaluation Metrics for Time-Series Anomaly Detection

    Jul 12, 2026Zongye LyuAdversarial RobustnessAutomated Evaluation

    Faculty of Information Technology, Monash University, Melbourne, VIC 3800, Australia

  5. Plug-and-Play Reweighting for Resilient Collaborative Decision-Making in Connected Autonomous Driving

    Jul 10, 2026Jiewen Liu, Rui Liu, Matthew Lee +3Adversarial RobustnessAutonomous Driving

    Department of Computer Science, North Carolina State University · Department of Computer Science, University of Maryland, College Park · University of North Carolina at Chapel Hill

  6. Robustifying Vision-Language Models via Test-Time Prompt Adaptation

    Jul 10, 2026Xingyu Zhu, Huanshen Wu, Shuo Wang +4VLM RobustnessVLM Adaptation

    National University of Singapore · University of Science and Technology of China · The Hong Kong University of Science and Technology

  7. Formal Mechanisms for Market Stability in Self-Interested Agent Societies: A Marketplace Simulation Study

    Jul 9, 2026Eugene Ng Yi Sheng, Bingquan ShenSocial DilemmasMulti-Agent LLM Systems

    DSO National Laboratories · National University of Singapore

  8. Robust Bayesian Decision Making under Adversarial Uncertainty

    Jul 9, 2026Haripriya Harikumar, Sammie Katt, Yasir Zubayr Barlas +1Adversarial RobustnessBayesian Decision Theory

    Department of Computer Science, The University of Manchester, UK · ELLIS Institute Finland · Department of Computer Science, Aalto University, Espoo, Finland

  9. Tubular Neighbourhoods of Pfaffian Sets and Applications to Neural Networks

    Jul 9, 2026Paul Lezeau, Martin LotzNeural Network RobustnessAdversarial Robustness

  10. Adversarial Decoys: Misdirecting Attention-Based Defenses in ViT

    Jul 8, 2026Giulia Marchiori Pietrosanti, Giulio Rossolini, Giorgio ButtazzoAdversarial Patch AttacksAdversarial Attacks

    Department of Excellence in Robotics and AI, Sant’Anna School of Advanced Study, Italy

  11. A law of robustness for two-layer neural networks with arbitrary weights

    Jul 8, 2026Yitzchak ShmaloNeural Network MemorizationMultilayer Perceptrons

  12. PeTeR: Post-Training Robustification of Probabilistic Circuits

    Jul 8, 2026Adrian Ciotinga, Yeming Dai, YooJung ChoiDistribution Shift RobustnessProbabilistic Circuits

    School of Computing and Augmented Intelligence, Arizona State University

  13. LiST: Lipschitz Scaling Training for Robust and Calibrated Neural Networks

    Jul 8, 2026Arthur Chiron, Franck Mamalet, Thomas Massena +2Neural Network RobustnessAdversarial Robustness

    IRIT, EPE UT · IRIT · IRIT, DTIPG - SNCF, UT3 +6

  14. Structural Adversarial Attacks on Relational Deep Learning under Integrity Constraints

    Jul 8, 2026Alan Gany, Bogdan Cautis, Silviu ManiuGraph Neural NetworksAdversarial Attacks

    Univ. Grenoble Alpes, CNRS, Grenoble INP, LIG Grenoble, France

  15. Optimized Instance Alteration for Explaining and Assessing Robustness of Classifiers

    Jul 7, 2026Evgenii Kuriabov, David Miller, Jia LiCounterfactual ExplanationsAdversarial Robustness

    Department of Statistics, The Pennsylvania State University, University Park, PA 16802, USA · Department of Electrical Engineering, The Pennsylvania State University, University Park, PA 16802, USA

  16. When Certificates Fail: A Unified Safety Framework for Embedded Neural Interface Models

    Jul 7, 2026Jasmeet Singh BindraBrain-Computer InterfacesNeural Network Robustness

    IKSMHA Center, IIT Mandi

  17. RoME: Robust Mixture of Low-Rank Experts against Multiple Adversarial Perturbations

    Jul 7, 2026Woo Jae Kim, Kyle Min, Suhyeon Ha +2Adversarial TrainingNeural Network Robustness

    KAIST, Daejeon, Korea · Oracle, Seattle WA, USA

  18. Higher-Order Certified Robustness for Regression

    Jul 6, 2026Jie Zhang, Natalie FrankRobust RegressionRandomized Smoothing

    University of Washington, USA

  19. Real-World Perturbation Testing of Autonomous Driving Systems

    Jul 6, 2026Stefano Carlo Lambertenghi, Matthias Weil, Andrea StoccoAutonomous Driving Safety EvaluationAdversarial Robustness

    Technical University of Munich · fortiss GmbH · Germany

  20. LipSSD: Lipschitz-Constrained Single-Shot Detection for Adversarially Robust Object Detection

    Jul 6, 2026Vincent Lébé, Yannick Prudent, Corentin Friedrich +3Adversarial RobustnessObject Detection

    IRIT, DTIPG - SNCF, UT3 · IRT Saint-Exup´ery · Alstom +2

  21. Occluding the Solution Space: Planner-Agnostic Adversarial Attacks on Tolerance-Aware Manipulation

    Jul 4, 2026Keke Tang, Tianyu Hao, Weilong Peng +5Adversarial AttacksAdversarial Robustness

    Guangzhou University, Guangzhou 510006, China · University of Science and Technology of China, Hefei 230026, China · Northwestern Polytechnical University, Xi’an 710072, China

  22. A Step Towards Robust Unsupervised Domain Adaptation via Fine-Tuning and Reinforcement Learning

    Jul 3, 2026Sushant Dagaji Desale, Rahul Mishra, Ashutosh Kumar SinhaAdversarial TrainingUnsupervised Domain Adaptation

    Indian Institute of Technology Patna

  23. Rethinking Brain Decoding with CLIP: The Role of Adversarial Robustness

    Jul 3, 2026Byeongseo Bok, Futa Waseda, Jun Liu +1Neural DecodingAdversarial Robustness

    The Graduate University for Advanced Studies (SOKENDAI), Kanagawa, Japan · National Institute of Informatics, Tokyo, Japan · The University of Tokyo, Tokyo, Japan

  24. Robustness Meets Uncertainty: Evidential Adversarial Training for Robust Selective Classification

    Jul 3, 2026Nicolas Sournac, Ahmed Baha Ben Jmaa, Bertrand BraeckeveldtAdversarial TrainingEvidential Deep Learning

    Multitel Research & Innovation Center, Artificial Intelligence Department, Belgium · TRAIL – Trusted AI Labs, Belgium

  25. AGVBench: A Reliability-Oriented Benchmark of Data Augmentation for Vein Recognition

    Jul 2, 2026Haiyang Li, Yuming Fu, Qun Song +4Biometric IdentificationData Augmentation

    Chongqing Technology and Business University, Chongqing 400067, China · Guangzhou College of Applied Science and Technology, Guangzhou, Guangdong Province, China · SAMOVAR, Telecom SudParis, Institute Polytechnique de Paris, 91120 Palaiseau, France +1

  26. Comprehensive Robustness Analysis of LiDAR-based 3D Object Detection in Autonomous Driving

    Jul 2, 2026Adwait Chandorkar, Kai Krink, Yerdana Maulenbay +2Lidar-Based 3D Object DetectionAdversarial Robustness

    Institute for TMDT, University of Wuppertal, Germany · IKB Faculty of Science, University of British Columbia, Canada

  27. Beyond Gradient-Based Attacks: Adversarial Robustness and Explainability Stability in Cybersecurity Classifiers

    Jul 2, 2026Mona Rajhans, Vishal KhawareyGradient-Boosted Decision TreesSHAP Feature Attribution

    Palo Alto Networks, Santa Clara, CA, USA · Quicken Inc., Menlo Park, CA, USA

  28. Fixed-Set Robustness in Programming by Example: Example Corruption and Semantic Partition Recovery

    Jul 1, 2026Yuan Si, Jialu ZhangAdversarial RobustnessProgram Synthesis

    University of Waterloo, Waterloo, Canada

  29. Homogenization of ℓ2\ell_2-Adversarial Training in High-Dimensions: Exact Dynamics under Stochastic Gradient Descent

    Jun 30, 2026Fabrizzio SabelliAdversarial TrainingHigh-Dimensional Asymptotics

    Université de Montréal

  30. MAPE: Defending Against Transferable Adversarial Attacks Using Multi-Source Adversarial Perturbations Elimination

    Jun 30, 2026Xinlei Liu, Jichao Xie, Tao Hu +4Adversarial RobustnessAdversarial Perturbations

    Information Engineering University, Zhengzhou, 450002, China · Key Laboratory of Cyberspace Security, Ministry of Education, Zhengzhou, 450002, China