Multimodal Jailbreak Attacks

Overview

The field studies how harmful requests can evade safeguards when models interpret text together with images, audio, video, or tool outputs. Attack methods include adversarial prompt optimization, distributing instructions across multiple inputs, using visual or video context, and adapting attacks through black-box feedback. Researchers evaluate these attacks with safety benchmarks and controlled tests, while exploring defenses such as input filtering, structured safety reasoning, and risk-aware routing. A central challenge is that vulnerabilities vary across models, languages, modalities, and inference pipelines, making broad evaluation difficult while defenses must preserve useful responses.

Latest papers

CardsList

31 papers1 paper in the last four weeks, down 80% on the four weeks before. 0.0% of all new papers.

  1. Divide and Conquer: A Hybrid Strategy Defeats Multimodal Large Language Models

    Dec 21, 2024Yanxu Mao, Peipei Liu, Tiehan Cui +3Adversarial Attacks on LLMsMultimodal Large Language Models