Black-Box Adversarial Attacks

Overview

Black-box adversarial attacks ask how an attacker can cause an AI system to misclassify, produce unsafe output, or take an unwanted action without access to its internal parameters or gradients. Methods use feedback from model queries—such as labels, scores, or responses—with decision-boundary search, finite differences, bandits, evolutionary or reinforcement-learning optimization; others craft perturbations on surrogate models and rely on transfer to unseen targets. Work spans images and physical patches, text and jailbreak prompts, audio, graphs, malware detectors, and tool-using or multimodal agents, often under constraints such as limited queries, imperceptibility, and preserving input meaning or function. Key tensions include whether attacks transfer across architectures and real-world transformations, how to compare them under fair query budgets, and whether defenses can resist adaptive attacks without sacrificing clean performance or utility.

Latest papers

CardsList

189 papers15 papers in the last four weeks, down 17% on the four weeks before. 0.1% of all new papers.

  1. Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems

    Sep 9, 2025Kamel Kamel, Hridoy Sankar Dutta, Keshav Sood +1Audio Deepfake DetectionSpeaker Verification

  2. Constrained Black-Box Attacks Against Cooperative Multi-Agent Reinforcement Learning

    Aug 12, 2025Amine Andam, Jamal Bentahar, Mustapha HedabouAdversarial MARLBlack-Box Adversarial Attacks

  3. Consensus-based optimization for closed-box adversarial attacks and a connection to evolution strategies

    Jun 30, 2025Tim Roith, Leon Bungert, Philipp WackerEvolutionary OptimizationBlack-Box Adversarial Attacks

  4. HauntAttack: When Attack Follows Reasoning as a Shadow

    Jun 8, 2025Jingyuan Ma, Rui Li, Zheng Li +4Adversarial Attacks on LLMsJailbreak Attacks

  5. Adversarial Robustness of AI-Generated Image Detectors in the Real World

    Oct 2, 2024Sina Mavali, Jonas Ricker, David Pape +2Adversarial AttacksAdversarial Robustness

  6. Perturbation Effects on Robustness and Individual Fairness

    Apr 1, 2024Xuran Li, Hao Xue, Peng Wu +4Neural Network RobustnessAlgorithmic Fairness

  7. SUB-PLAY: Adversarial Policies against Partially Observed Multi-Agent Reinforcement Learning Systems

    Feb 6, 2024Oubo Ma, Yuwen Pu, Linkang Du +5Adversarial AttacksPartially Observable RL

  8. InstructTA: Instruction-Tuned Targeted Attack for Large Vision-Language Models

    Dec 4, 2023Xunguang Wang, Pingchuan Ma, Zhenlan Ji +3Adversarial Attacks on VLMsLarge Vision-Language Models