Adversarial Attacks

Ask about this topic

Overview

Adversarial attacks study how deliberately chosen inputs, training data, model parameters, or system interactions can make AI systems fail or behave as intended by an attacker. Common approaches include gradient-based perturbations, black-box query and evolutionary search, generative or semantic changes, physical patches and sensor interference, and poisoning or backdoors. Work spans image, language, audio, graph, and time-series models as well as federated learning, recommenders, robotics, and AI agents, with evaluations on benchmarks and increasingly realistic deployment settings. A central tension is that attacks must be effective and stealthy under practical constraints, while defenses and benchmarks must keep pace with adaptive threats and distinguish digital robustness from real-world resilience.

Latest papers

CardsList

451 papers54 papers in the last four weeks, up 69% on the four weeks before. 0.3% of all new papers.

  1. When Surfaces Lie: Exploiting Wrinkle-Induced Attention Shift to Attack Vision-Language Models

    Mar 29, 2026Chengyin Hu, Xuemeng Sun, Jiaju Han +5Adversarial Attacks on VLMsAdversarial Attacks

  2. Fundamental Limits of Man-in-the-Middle Attack Detection in Model-Free Reinforcement Learning

    Mar 29, 2026Rishi Rani, Massimo FranceschettiCPS SecurityAdversarial Attacks

  3. Trustworthy AI-Driven Dynamic Hybrid RIS: Joint Optimization and Reward Poisoning-Resilient Control in Cognitive MISO Networks

    Mar 27, 2026Deemah H. Tashman, Soumaya CherkaouiWireless CommunicationsReconfigurable Intelligent Surfaces

    LINCS Laboratory, Department of Computer and Software Engineering, Polytechnique Montréal, Montréal, QC, Canada, H3T 1J4

  4. PEANUT: Perturbations by Eigenvector Alignment for Attacking Graph Neural Networks Under Topology-Driven Message Passing

    Mar 27, 2026Bhavya Kohli, Biplab SikdarAdversarial AttacksGraph Neural Networks

    National University of Singapore, Singapore

  5. Mitigating Evasion Attacks in Fog Computing Resource Provisioning Through Proactive Hardening

    Mar 26, 2026Younes Salmi, Hanna BoguckaAdversarial Attacks

    Institute of Radiocommunications, Poznan University of Technology, Poznań, Poland

  6. A Unified Spatial Alignment Framework for Highly Transferable Transformation-Based Attacks on Spatially Structured Tasks

    Mar 26, 2026Jiaming Liang, Chi-Man PunAdversarial Attacks on Object DetectorsAdversarial Attacks

    University of Macau

  7. Generative Adversarial Perturbations with Cross-paradigm Transferability on Localized Crowd Counting

    Mar 25, 2026Alabi Mehzabin Anisha, Guangjing Wang, Sriram ChellappanAdversarial AttacksTransfer-Based Adversarial Attacks

    University of South Florida, Tampa, Florida, USA

  8. Uncovering Memorization in Timeseries Imputation models: LBRM Membership Inference and its link to attribute Leakage

    Mar 25, 2026Faiz Taleb, Ivan Gazeau, Maryline LaurentUser Attribute Inference AttacksMembership Inference Attacks

    EDF SAMOVAR, Télécom SudParis, Institut Polytechnique de Paris, 91120 Palaiseau, France · EDF, 91120 Palaiseau, France · SAMOVAR, Télécom SudParis, Institut Polytechnique de Paris

  9. Targeted Adversarial Traffic Generation : Black-box Approach to Evade Intrusion Detection Systems in IoT Networks

    Mar 24, 2026Islam Debicha, Tayeb Kenaza, Ishak Charfi +3Adversarial AttacksIoT Intrusion Detection

  10. PoiCGAN: A Targeted Poisoning Based on Feature-Label Joint Perturbation in Federated Learning

    Mar 24, 2026Tao Liu, Jiguang Lv, Dapeng Man +7Data Poisoning AttacksAdversarial Attacks

    College of Computer Science and Technology, Harbin Engineering University, Harbin, 150001, China

  11. OmniPatch: A Universal Adversarial Patch for ViT-CNN Cross-Architecture Transfer in Semantic Segmentation

    Mar 21, 2026Aarush Aggarwal, Akshat Tomar, Amritanshu Tiwari +1Adversarial Patch AttacksAdversarial Attacks

    Data Science Group, Indian Institute of Technology Roorkee, India

  12. Adversarial Attacks on Locally Private Graph Neural Networks

    Mar 21, 2026Matta Varun, Ajay Kumar Dhakar, Yuan Hong +1Adversarial AttacksGraph Neural Networks

    Indian Institute of Technology Kharagpur, India · University of Connecticut, USA

  13. CAMA: Exploring Collusive Adversarial Attacks in c-MARL

    Mar 20, 2026Men Niu, Xinxin Fan, Quanliang Jing +2Adversarial AttacksAdversarial MARL

    Institute of Computing Technology, CAS · UCAS · Beihang University

  14. Robustness, Cost, and Attack-Surface Concentration in Phishing Detection

    Mar 19, 2026Julian Allagan, Mohamed Elbakary, Zohreh Safari +4Phishing DetectionAdversarial Robustness

    Department of Mathematics, Computer Science, and Engineering Technology Elizabeth City State University, Elizabeth City, NC 27909, USA

  15. On Optimizing Multimodal Jailbreaks for Spoken Language Models

    Mar 19, 2026Aravind Krishnan, Karolina Stańczak, Dietrich KlakowAdversarial AttacksLLM Jailbreak Attacks

    Saarland University, Germany · DFKI GmbH, Saarbrücken, Germany · ETH AI Center, Switzerland

  16. Attack by Unlearning: Unlearning-Induced Adversarial Attacks on Graph Neural Networks

    Mar 19, 2026Jiahao Zhang, Yilong Wang, Suhang WangGraph UnlearningAdversarial Attacks

    The Pennsylvania State University University Park, PA, USA

  17. REFORGE: Multi-modal Attacks Reveal Vulnerable Concept Unlearning in Image Generation Models

    Mar 17, 2026Yong Zou, Haoran Li, Fanxiao Li +5Adversarial AttacksAdversarial Robustness

    Yunnan University · Northeastern University · National University of Singapore

  18. AI Evasion and Impersonation Attacks on Facial Re-Identification with Activation Map Explanations

    Mar 16, 2026Noe Claudel, Weisi Guo, Yang XingAdversarial AttacksAdversarial Patch Attacks

    All authors are with the Centre for Assured and Connected Autonomy, Cranfield University, Bedford, UK.

  19. Hijacking online reviews: sparse manipulation and behavioral buffering in popularity-biased rating systems

    Mar 16, 2026Itsuki Fujisaki, Kunhao YangPopularity Bias in Recommender SystemsRecommender Systems

    College of Knowledge and Library Science, School of Informatics, Tsukuba University, Ibaraki, Japan · College of Engineering, Shibaura Institute of Technology; Tokyo, Japan

  20. Architecture-Agnostic Feature Synergy for Universal Defense Against Heterogeneous Generative Threats

    Mar 16, 2026Bingxue Zhang, Yang Gao, Feida Zhu +2Adversarial AttacksAdversarial Perturbations

    University of Shanghai for Science and Technology, Shanghai, China · Singapore Management University, Singapore, Singapore · Shanghai Jiao Tong University, Shanghai, China

  21. Visual Confused Deputy: Exploiting and Defending Perception Failures in Computer-Using Agents

    Mar 16, 2026Xunzhuo Liu, Bowei He, Xue Liu +3Computer-Use Agent SafetyAI Agent Security

    vLLM Semantic Router Project · MBZUAI · McGill University +2

  22. Benchmarking the Energy Cost of Assurance in Neuromorphic Edge Robotics

    Mar 14, 2026Sylvester KaczmarekAdversarial RobustnessNeuromorphic Computing

    Department of Computing, Imperial College London, London, United Kingdom

  23. Sirens' Whisper: Inaudible Near-Ultrasonic Jailbreaks of Speech-Driven LLMs

    Mar 14, 2026Zijian Ling, Pingyi Hu, Xiuyong Gao +6Adversarial AttacksLLM Security

    School of Cyber Science and Engineering, Huazhong University of Science and Technology · State Key Laboratory of Internet Architecture, Tsinghua University · Hubei Key Laboratory of Distributed System Security, Hubei Engineering Research Center on Big Data Security, School of Cyber Science and Engineering, Huazhong University of Science and Technology +1

  24. Spectral Defense Against Resource-Targeting Attack in 3D Gaussian Splatting

    Mar 13, 2026Yang Chen, Yi Yu, Jiaming He +33D Gaussian SplattingAdversarial Robustness

    Nanyang Technological University · UESTC · Tsinghua University +2

  25. CtrlAttack: A Unified Attack on World-Model Control in Diffusion Models

    Mar 13, 2026Shuhan Xu, Siyuan Liang, Hongling Zheng +4Adversarial AttacksImage-to-Video Generation

    Wuhan University · Nanyang Technological University · Beijing Institute of Technology

  26. Delayed Backdoor Attacks: Exploring the Temporal Dimension as a New Attack Surface in Pre-Trained Models

    Mar 12, 2026Zikang Ding, Haomiao Yang, Meng Hao +6Adversarial AttacksBackdoor Attacks

    School of Computer Science and Engineering, University of Electronic Science and Technology of China, Sichuan 611731, China · Singapore Management University · School of Computer Science, Xi’an Polytechnic University, Xi’an 710048, China. +1

  27. Backdoor Directions in Vision Transformers

    Mar 11, 2026Sengim Karayalcin, Marina Krcek, Pin-Yu Chen +1Backdoor DetectionVision Transformer

    Leiden University · Radboud University · IBM Research +1

  28. Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?

    Mar 11, 2026Anna Chistyakova, Mikhail PautovAdversarial AttacksBlack-Box Adversarial Attacks

    Trusted AI Research Center, RAS · AXXX

  29. Enhancing Network Intrusion Detection Systems: A Multi-Layer Ensemble Approach to Mitigate Adversarial Attacks

    Mar 11, 2026Nasim Soltani, Shayan Nejadshamsi, Zakaria Abou El Houda +4Network Intrusion DetectionAdversarial Robustness

    Institut national de la recherche scientifique (INRS-EMT), Université du Québec, Montréal, Québec, Canada · INRS-UQO Mixed Research Unit on Cybersecurity, Gatineau, Québec, Canada · Concordia Institute for Information Systems Engineering (CIISE), Concordia University, Montréal, Québec, Canada +2

  30. NetDiffuser: Deceiving DNN-Based Network Attack Detection Systems with Diffusion-Generated Adversarial Traffic

    Mar 9, 2026Pratyay Kumar, Abu Saleh Md Tayeen, Satyajayant Misra +4Adversarial AttacksAdversarial Examples

    Department of Computer Science, New Mexico State University, Las Cruces, NM, USA · University of Hartford, CT, USA · DEVCOM Analysis Center, WSMR, NM, USA