Black-Box Adversarial Attacks

Follow this topic Ask about this topic

Momentum

8 papers in the last four weeks, up 60% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 115

All topics

Breaking Adversarial Transferability in Fine-Tuned Speech Recognition
Oct 6, 2026Mojtaba Nafez, Aref Mousavi, Mohammad Ebrahim Mahdavi +3Adversarial Transferability Automatic Speech Recognition
Department of Computer Engineering Sharif University of Technology · Department of Computer Engineering University of Isfahan
ATLAS-AL: Adaptive Trust-Region for Latent Adversarial Searches via Active Learning
Oct 5, 2026Marsalis Gibson, Claire Tomlin, Shankar SastryAdversarial Robustness Active Learning
Department of Electrical Engineering and Computer Sciences University of California, Berkeley
Boosting Transferable Adversarial Attacks against Deep Reinforcement Learning
Oct 5, 2026Zexin Li, Ruili Yao, Yiming Zeng +1Adversarial Attacks Transfer-Based Adversarial Attacks
Nanyang Technological University · University of California, Riverside · University of Connecticut +1
VirusCascade: Hijacking Collaborative Reflection in LLM-Powered Recommender Agents
Sep 29, 2026Yurong Hao, Wen Zhou, Guowei Guan +3Adversarial Attacks Agent Memory Poisoning
College of Computing and Data Science, Nanyang Technological University
One Attack to Fool Them All: Highly Transferable Black-Box Adversarial Attacks on Frontier MLLMs
Sep 27, 2026Sen Nie, Jie Zhang, Zhongqi Wang +2Adversarial Attacks on VLMs Adversarial Attacks on LLMs
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, and the University of Chinese Academy of Sciences.
A2M: Trace-Optimized Agent Hijacking in the MCP Ecosystem
Sep 22, 2026Laizhen Li, Xuan Wang, Peicheng Zhao +4MCP Security AI Agent Security
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Nanyang Technological University +3
Reinforcement Learning Inspired Black-box Adversarial Attacks for Computer Vision
Sep 21, 2026Florian Krone, Elena Hoemann, Sven HallerbachAdversarial Attacks Adversarial Robustness
Institute for AI Safety and Security German Aerospace Center (DLR) Sankt Augustin, Germany
Contagion on the Trading Floor: How Adversarial Signals Spread in Multi-Agent Trading Systems
Sep 17, 2026Qi Rong Sua, Junhao Dong, Nguyen Duc Thai +3Multi-Agent LLM Systems Adversarial Robustness of Language Models
Nanyang Technological University, Singapore · Centre for Frontier AI Research, IHPC, A*STAR, Singapore · National University of Singapore, Singapore
Investigating Adversarial Robustness of Heterogeneous Cooperative Perception
Sep 15, 2026Chenyi Wang, Yutong Liu, Qingzhao Zhang +1Adversarial Attacks Adversarial Robustness
School of Electrical, Computing, and Software Engineering University of Arizona Tucson, AZ 85721 USA
What Makes Adversarial Examples Transfer Across Deepfake Detectors?
Sep 9, 2026Rafael M. Mamede, Pedro C. Neto, Ana F. SequeiraAdversarial Robustness Deepfake Detection
INESC TEC, Porto, Portugal · Faculty of Engineering, University of Porto (FEUP), Porto, Portugal · Unilabs, Porto, Portugal
A Black-Box Adversarial Attack on Human Pose Estimation and Keypoint-Based Action Recognition Models
Sep 7, 2026Kacper Mroczek, Michal KepskiHuman Pose Estimation Black-Box Adversarial Attacks
University of Rzeszów, 35-959 Rzeszów, Poland
SIR: Self-improving Red-teaming for Compute Use Agents
Aug 31, 2026Chen Xiong, Zhiyuan He, Pin-Yu Chen +2Computer-Use Agents Indirect Prompt Injection
The Chinese University of Hong Kong · IBM Research · University of Zagreb, FER & Radboud University +1
OASIS: Optimizing Attacker Sequences for Hard-Label Black-Box Text Attacks
Aug 30, 2026Qian Chen, Shiliang Xiao, Yuzhi LiangAdversarial Attacks Black-Box Adversarial Attacks
School of Information Science and Technology Guangdong University of Foreign Studies, China
Learning with Bilevel-Minimax Optimization for Efficient and Reliable Transfer Attacks
Aug 12, 2026Yaohua Liu, Yifan Guo, Jiaxin GaoBilevel Optimization Transfer-Based Adversarial Attacks
The University of Hong Kong, Hong Kong SAR, China · International School of Information Science & Engineering, Dalian University of Technology, Dalian, China · The Hong Kong Polytechnic University, Hong Kong SAR, China
SegPAR: Class-Centric Decision-Based Sparse Attack for Semantic Segmentation
Aug 11, 2026Dongsu Song, DaeYun GO, Boseung Seo +1Black-Box Adversarial Attacks Semantic Segmentation
Interdisciplinary Program in Space Systems Engineering, Korea Aerospace University, South Korea · Department of Computer Science, Korea Aerospace University, South Korea · Department of Artificial Intelligence, Korea Aerospace University, South Korea
Hidden in Plain Sight: Diffusion-Based Unrestricted Robotic Attacks on Vision-Language-Action Models
Aug 11, 2026Jiahui Han, Yuhui Yao, Xin Wang +6Adversarial Attacks Adversarial Attacks on VLA Models
1Xi’an Jiaotong University · 2Shanghai AI Laboratory · University of Science and Technology of China
Toward Metacognitive One-Shot Indirect Prompt Injection: Strategy Abstraction Via Outcome-Conditioned Reflection
Aug 9, 2026Sihan Hou, Xinmeng Hou, Zhijun Zhang +5AI Agent Security Benchmarks Indirect Prompt Injection
1Nankai University · 2Nanyang Technological University · 3Technical Lead, R&D, Tianjin 712 Mobile Communication Co., Ltd. +1
IDATA: Scalable Invertible Diffusion for Unrestricted Adversarial Transfer Attack
Aug 9, 2026Yi Pan, Jun-Jie Huang, Tianrui Liu +3Adversarial Attacks Transfer-Based Adversarial Attacks
College of Computer Science and Technology
Query-Only Backdoor Attacks on Self-Evolving Skills via Trajectory Poisoning
Aug 8, 2026Yuyang Luo, Haoran Wang, Kai ShuLLM Backdoor Attacks Adversarial Attacks
1Emory University
Adversarial Attacks on Deep OCR Systems
Aug 7, 2026Wenbo Sun, Hongzong LI, Yanyun Wang +5Adversarial Attacks on VLMs Adversarial Attacks
Nanjing University of Aeronautics and Astronautics · Northwestern Polytechnical University · The Chinese University of Hong Kong +4
Casting the Net! Revisiting MasterFace Impersonation Attacks
Aug 7, 2026Seunghun Paik, Sunpill Kim, Chanwoo Hwang +1Biometric Identification Adversarial Attacks
Hanyang University Seoul, Republic of Korea
ColorFD: A Finite-Difference Guided Black-Box Physical Adversarial Attack for Remote Sensing Object Detection
Aug 5, 2026Tiannuo Guo, Guhang Qiu, Yuzhen Xie +3Remote Sensing Image Understanding Adversarial Patch Attacks
College of Information Science and Technology, Beijing University of Chemical Technology, Beijing 100029, China
Season: Spectrum-Aware Orthogonal Gradient Refinement for Transfer-Based Adversarial Attacks
Aug 5, 2026Tianyi Wang, Zhenghao Gao, Shengjie XuAdversarial Attacks Transfer-Based Adversarial Attacks
Tongji University Shanghai, China · Huazhong University of Science and Technology · Wuhan LightRead Intelligent Technology Co., Ltd. Wuhan, China
ICO: Enhancing Semantic-Shift Jailbreaks via Iterative Context Optimization
Aug 4, 2026Hujian Zhu, Yihao Huang, Felix Juefei-Xu +5Adversarial Attacks on LLMs Jailbreak Attacks
East China Normal University, Shanghai, China · New York University, New York, USA · The Hong Kong Polytechnic University, Hong Kong, China +2
Decoy Images Amplify Caption-Mediated Defenses Against Encoded Jailbreaks
Aug 2, 2026Haoyu Zhang, Xiangchen Guan, Shibo Zheng +2VLM Robustness Adversarial Attacks on VLMs
Mind the Gap: Zero-Query Jailbreaks via Filter-Generator Discrepancy in Text-to-Image Systems
Aug 2, 2026Wanguang Li, Zhaoxin Wang, Handing WangAdversarial Prompt Generation T2I Generation
School of Artificial Intelligence, Xidian University, Shaanxi, China
Old Tricks, New Models: How Simple Image Transformations Break Modern AI-based Content Moderation
Jul 30, 2026Marco Alecci, Francesco Marchiori, Iyiola Emmanuel Olatunji +2Multimodal Robustness Adversarial Attacks
Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg, Luxembourg · Department of Mathematics, University of Padua, Padua, Italy
Attack Ensembles Expose a Safety-Utility Trade-off in Black-Box Guard Defenses Against Encoded VLM Jailbreaks
Jul 29, 2026Haoyu Zhang, Zhuoxi Wang, Shibo Zheng +7VLM Robustness Adversarial Attacks on VLMs
Northeastern University
TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors
Jul 28, 2026Xia Du, Zhuosen Bao, Zheng Lin +4Adversarial Attacks Transfer-Based Adversarial Attacks
School of Computer and Information Engineering, Xiamen University of Technology, Xiamen, 361000, China · Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg, L-1855 Luxembourg, Luxembourg · School of Computer Science, Engineering Research Center of Machine Learning and Industry Intelligence, Sichuan University, Chengdu, China, 610020, China +2
GeoThreat: Transferable Targeted Adversarial Attacks on Large Vision-Language Models for Remote Sensing Image Interpretation
Jul 23, 2026Yimin Fu, Yuefeng Bai, Baicheng Pan +2Remote Sensing Image Understanding Adversarial Attacks on VLMs
Department of Mathematics, Hong Kong Baptist University, Hong Kong, China · School of Automation, Northwestern Polytechnical University, Xi’an, 710072, China

Oct 6, 2026, cs.LGJ/K move · Enter open · S save

Breaking Adversarial Transferability in Fine-Tuned Speech Recognition

Mojtaba Nafez, Aref Mousavi, Mohammad Ebrahim Mahdavi, Mobina Poulaei+2

Department of Computer Engineering Sharif University of Technology · Department of Computer Engineering University of Isfahan

Adversarial Transferability Automatic Speech Recognition Adversarial Training Black-Box Adversarial Attacks

Open paper AskPDF arXiv

Many organizations fine-tune publicly available pretrained Automatic Speech Recognition (ASR) models and deploy them in black-box settings, assuming limited access provides protection. We show this assumption is fragile: adversarial perturbations crafted on the public base model transfer effectively to fine-tuned target models, severely degrading performance and posing concerns for safety-critical applications. We propose TransferBreaker, a unified fine-tuning framework that suppresses adversarial transfer by integrating Base Adversarial Fine-Tuning, which restricts adversarial training to base-effective perturbations; Latent Jacobian Regularization, which enforces latent-space invariance by suppressing adversarially sensitive directions; and HybridGrad-AFT, which improves robustness against adaptive attacks by interpolating transferable perturbations from base and target gradients. We theoretically justify all components and evaluate TransferBreaker across three languages and four large ASR models, reducing adversarial WER from 92.6 to 27.8. Our code is publicly available at https://github.com/rohban-lab/TransferBreaker.

Momentum

Related topics

Latest papers 115