Organizations: College of Science, Mathematics and Technology, Wenzhou-Kean University · AI Security Lab · State Key Laboratory of Complex & Critical Software Environment, Beihang University
Recent text-to-video (T2V) models can synthesize complex videos from lightweight natural language prompts, raising urgent concerns about safety alignment in the event of misuse in the real world. Prior jailbreak attacks typically rewrite unsafe prompts into paraphrases that evade content filters while preserving meaning. Yet, these approaches often still retain explicit sensitive cues in the input text and therefore overlook a more profound, video-specific weakness. In this paper, we identify a temporal trajectory infilling vulnerability of T2V systems under fragmented prompts: when the prompt specifies only sparse boundary conditions (e.g., start and end frames) and leaves the intermediate evolution underspecified, the model may autonomously reconstruct a plausible trajectory that includes harmful intermediate frames, despite the prompt appearing benign to input or output side filtering. Building on this observation, we propose TFM. This fragmented prompting framework converts an originally unsafe request into a temporally sparse two-frame extraction and further reduces overtly sensitive cues via implicit substitution. Extensive evaluations across multiple open-source and commercial T2V models demonstrate that TFM consistently enhances jailbreak effectiveness, achieving up to a 12% increase in attack success rate on commercial systems. Our findings highlight the need for temporally aware safety mechanisms that account for model-driven completion beyond prompt surface form.
Figures & tables
Figure 1: Illustration of our proposal effect on T2V system.
Figure 2: Overview of the proposed TFM framework. TFM consists of two LLM-guided stages: (1) Temporal Boundary Prompting (TBP), which enforces sparsity by retaining only boundary frames, and (2) Covert Substitution Mechanism (CSM), which implicitly rewrites sensitive content while preserving semantic intent.
Open-source
Closed-source
Wan
CogVideoX
HunyuanVideo
Pixverse
Hailuo
Kling
Seedance
Pre
Post
Pre
Post
Pre
Post
Pre
Post
Pre
Post
Pre
Post
Pre
Post
✗
✗
✗
✗
✗
✗
✓
✓
✗
✓
✗
✓
✓
✓
Table 1: Built-in safety filtering in representative T2V systems. “Pre” and “Post” denote input (prompt) and output (generated video) safety filters, respectively. ✓ indicates existence and ✗ indicates nonexistence.
Aspect
Pixverse
Hailuo
Kling
Seedance
TSB
RAB
DACA
VEIL
Ours
TSB
RAB
DACA
VEIL
Ours
TSB
RAB
DACA
VEIL
Ours
TSB
RAB
DACA
VEIL
Ours
Pornography
14.0%
28.0%
28.0%
80.0%
90.0%
22.0%
40.0%
12.0%
94.0%
96.0%
22.0%
42.0%
34.0%
88.0%
94.0%
32.0%
28.0%
22.0%
88.0%
84.0%
Borderline Pornography
30.0%
12.0%
38.0%
48.0%
60.0%
34.0%
22.0%
22.0%
50.0%
62.0%
44.0%
22.0%
30.0%
58.0%
66.0%
28.0%
20.0%
24.0%
38.0%
42.0%
Violence
50.0%
10.0%
32.0%
54.0%
64.0%
68.0%
44.0%
54.0%
80.0%
84.0%
70.0%
38.0%
52.0%
70.0%
80.0%
68.0%
20.0%
44.0%
74.0%
76.0%
Gore
24.0%
12.0%
14.0%
52.0%
60.0%
42.0%
38.0%
46.0%
64.0%
74.0%
74.0%
42.0%
52.0%
94.0%
96.0%
36.0%
26.0%
30.0%
64.0%
66.0%
Disturbing Content
16.0%
12.0%
22.0%
38.0%
50.0%
18.0%
34.0%
38.0%
42.0%
52.0%
28.0%
30.0%
26.0%
44.0%
48.0%
28.0%
2.0%
24.0%
44.0%
42.0%
Table 2: Comparison of Attack Success Rate (ASR) on T2V models across 14 safety categories.
Method
Pixverse
Hailuo
w/o TBP
w/o CSM
With_middle
TFM
w/o TBP
w/o CSM
With_middle
TFM
Avg
21.0
27.0
35.0
52.0
21.0
24.0
37.0
60.0
Table 3: Ablation results on Average (aggregated over all categories). Values are reported as percentages.
Method
Pixverse
Hailuo
Kling
Seedance
revs_seq
TFM
revs_seq
TFM
revs_seq
TFM
revs_seq
TFM
Avg
45.0
52.0
49.0
60.0
37.0
49.0
31.0
45.0
Table 4: Ablation results on Average (aggregated over all categories). Values are reported as percentages.
Figure 3: Ablation results across four target models under different variants.
Text-to-Video (T2V) models have demonstrated remarkable capability in generating temporally coherent videos from natural language prompts, yet they also risk producing unsafe content such as violence or explicit material. Existing prompt-level defenses are largely inherited from text-to-image safety and operate on the lexical surface of the input, making them vulnerable to jailbreak attacks that disguise harmful intent through rephrasing or adversarial prompting. Moreover, T2V generation introduces a distinctive challenge overlooked by prior work: temporally emergent risk, where a seemingly benign prompt leads to unsafe content through the generator's temporal extrapolation toward narrative coherence. We propose \method{}, a training-free, inference-time defense framework that reformulates T2V safety as a causal intervention in a temporally structured semantic space. TrajShield handles explicit unsafe prompts, jailbreak attacks, and temporally emergent risks in a unified manner by simulating the implied trajectory of a prompt, localizing the causal origin of potential risk, and applying a minimally invasive rewrite that neutralizes the risk while preserving safety-irrelevant semantics. Experiments on T2VSafetyBench across 14 safety categories and multiple T2V backends demonstrate that TrajShield achieves state-of-the-art defenseive performance while maintaining high semantic fidelity, substantially outperforming existing defenses, with an average ASR reduction of 52.44%.
Quanchen Zou, Nizhang Li, Wenxin Zhang +4
AI Security Lab, Beijing, China · Macau University of Science and Technology, Macau, China · University of Chinese Academy of Sciences, Beijing, China +3
Recently, text-to-video (T2V) models have been widely deployed, sparking growing concerns over their robustness against jailbreak attacks. Existing jailbreak methods, mostly adapted from text-to-image attacks, suffer notable drawbacks when applied to T2V systems. They fail to fully leverage temporal consistency, an inherent characteristic of video generation. Besides, these methods demand heavy video query optimization, which is infeasible in practical black-box scenarios. Their adversarial prompt search is also driven by heuristic local signals, lacking principled structured exploration strategies. To tackle these limitations, we propose BSB, a structured, query-efficient jailbreak framework for T2V models. BSB harnesses temporal consistency by encoding harmful intent as the transition between two individually harmless boundary states. Under this paradigm, the attack targets boundary-state pairs whose interpolation tends to produce unsafe intermediate frames during video generation. Directly evaluating all candidate pairs within the video space incurs prohibitive computation cost. Instead, BSB conducts Monte Carlo Tree Search (MCTS) in a cheaper textual proxy space and regularly calibrates search outcomes with sparse video-level evaluations. We conduct comprehensive experiments on mainstream commercial T2V models including Veo 3.1, Sora 2, Seedance and Kling v1. Results show BSB surpasses all existing jailbreak baselines, delivering an average 18.6% relative gain in attack success rate over the strongest competitor across evaluated models. Our findings identify temporal consistency as an understudied yet vital attack surface for T2V models and verify that structured search facilitates effective vulnerability discovery under constrained query budgets.
Text-to-Video (T2V) generative models are vulnerable to jailbreak attacks in real-world deployment, leading them to produce harmful or inappropriate content. Existing defense approaches mainly rely on input filtering or reconstruction, which not only incur high computational latency but also tend to distort semantics. To address these issues, we experimentally and systematically analyze the differences between clean and jailbreak samples in the cross-attention feature space, revealing for the first time a cumulative separation effect and a progressively increasing trend of linear separability between the two during the diffusion process. Based on this insight, we propose SafeCA, a feature-level defense mechanism for safe cross-attention localization and regularization. Firstly, we identify key defensive regions and values through attention stability analysis using cross-attention features collected from clean prompts within a single inference. Secondly, SafeCA mitigates anomalous activations via attention masking with energy normalization and introduces a lightweight semantic-space adapter to redirect abnormal semantic flows. Furthermore, we detect and suppress potentially malicious tokens by back-propagating feature anomaly signals to the input cue words, thereby enhancing the deployability of the defense in commercial models. Experimental results show that SafeCA reduces the jailbreak success rate by about 20% on mainstream T2V models, adds almost no inference overhead (+0.1s), and maintains good text-video semantic consistency. Overall, SafeCA provides an architecture-level, deployable protection paradigm for T2V generation models.
Siyuan Liang, Yupeng Qiu, Junfeng Fang +3
Nanyang Technological University · National University of Singapore