Model Attack

Model attacks exploit vulnerabilities in machine learning models to either extract sensitive training data or manipulate model outputs, undermining their reliability and security. Current research focuses on developing increasingly sophisticated attack methods, including generative adversarial networks (GANs) and reinforcement learning, targeting various model architectures like large language models (LLMs), convolutional neural networks (CNNs), and graph neural networks. These attacks highlight critical security risks in deploying machine learning systems across diverse applications, from healthcare to security systems, necessitating the development of robust defense mechanisms.

Papers

October 21, 2024

October 19, 2024

Toward Robust RALMs: Revealing the Impact of Imperfect Retrieval on Retrieval-Augmented Language Models
Seong-Il Park, Jay-Yoon Lee
Adversarial Attack Adversarial Robustness Global Impact Retrieval Augmented Language Model Model Attack

October 4, 2024

You Know What I'm Saying -- Jailbreak Attack via Implicit Reference
Tianyu Wu, Lingrui Mei, Ruibin Yuan, Lujun Li, Wei Xue, Yike Guo
Jailbreak Attack Coreference Information Malicious User Model Attack Contextual Attack

September 6, 2024

Learning to Learn Transferable Generative Attack for Person Re-Identification
Yuan Bian, Min Liu, Xueping Wang, Yunfeng Ma, Yaonan Wang
LeArning Abstract Adversarial Example Transferable Adversarial Attack Black Box Adversarial Attack Model Attack Generative Attack

June 18, 2024

Adversarial Attacks on Large Language Models in Medicine
Yifan Yang, Qiao Jin, Furong Huang, Zhiyong Lu
Adversarial Attack Adversarial Data Model Attack Domain Task

May 23, 2024

Learning to Transform Dynamically for Better Adversarial Transferability
Rongyi Zhu, Zeliang Zhang, Susan Liang, Zhuo Liu, Chenliang Xu
LeArning Abstract Adversarial Example Adversarial Sample Adversarial Transferability Model Attack

February 6, 2024

Boosting Adversarial Transferability across Model Genus by Deformation-Constrained Warping
Qinliang Lin, Cheng Luo, Zenghao Niu, Xilin He, Weicheng Xie, Yuanbo Hou, Linlin Shen, Siyang Song
Adversarial Example Adversarial Transferability Model Attack Warping Method Feature Warping

January 16, 2024

Bag of Tricks to Boost Adversarial Transferability
Zeliang Zhang, Rongyi Zhu, Wei Yao, Xiaosen Wang, Chenliang Xu
Adversarial Attack Adversarial Example Task Transferability Bag Prototype Unconventional Rabbit Hat Trick Model Attack

January 8, 2024

Detecting Face Synthesis Using a Concealed Fusion Model
Roberto Leyva, Victor Sanchez, Gregory Epiphaniou, Carsten Maple
Synthetic Face Face Synthesis Model Attack Fake Fingerprint Fusion Model Random Cost Coefficient

December 22, 2023

Adaptive Domain Inference Attack
Yuechun Gu, Keke Chen
Model Inversion Attack Model Attack Domain Inference Attack

September 20, 2023

Compilation as a Defense: Enhancing DL Model Attack Robustness via Tensor Optimization
Stefan Trawicki, William Hackett, Lewis Birch, Neeraj Suri, Peter Garraghan
Adversarial Learning Side Channel Model Attack Planning Based Compilation Tensor Optimization Attack Robustness

July 17, 2023

A Secure Aggregation for Federated Learning on Long-Tailed Data
Yanna Jiang, Baihe Ma, Xu Wang, Guangsheng Yu, Caijun Sun, Wei Ni, Ren Ping Liu
Secure Aggregation Long Tailed Data Byzantine Attack Model Attack Global Aggregation

April 5, 2023

How to choose your best allies for a transferable attack?
Thibault Maho, Seyed-Mohsen Moosavi-Dezfooli, Teddy Furon
Adversarial Attack Adversarial Example Transferable Attack Model Attack

March 9, 2023

Generative Model-Based Attack on Learnable Image Encryption for Privacy-Preserving Deep Learning
AprilPyone MaungMaung, Hitoshi Kiya
Deep Learning Generative Question Image Encryption Model Attack Generative Attack Learnable Image Encryption

March 7, 2023

Patch of Invisibility: Naturalistic Physical Black-Box Adversarial Attacks on Object Detectors
Raz Lapid, Eylon Mizrahi, Moshe Sipper
Adversarial Attack Generative Adversarial Network Object Detector Single Simple Patch Model Attack Physical Adversarial Patch Invisible Human

December 31, 2022

A Comparative Study of Image Disguising Methods for Confidential Outsourced Learning
Sagar Sharma, Yuechun Gu, Keke Chen
Comparative Study Private Learning Image Encryption Model Attack Information Hiding

December 22, 2022

GAN-based Domain Inference Attack
Yuechun Gu, Keke Chen
Generative Adversarial Network Model Inversion Attack Model Attack Generative Adversarial Network Training Domain Inference Attack

November 26, 2022

Game Theoretic Mixed Experts for Combinational Adversarial Machine Learning
Ethan Rathbun, Kaleel Mahmood, Sohaib Ahmad, Caiwen Ding, Marten van Dijk
Adversarial Attack Adversarial Example Adversarial Learning Mixture of Expert Model Attack Ensemble Adversarial Compositional Adversarial

November 15, 2022

MORA: Improving Ensemble Robustness Evaluation with Model-Reweighing Attack
Yunrui Yu, Xitong Gao, Cheng-Zhong Xu
Adversarial Attack Model Attack Robust Ensemble Ensemble Defense