NEGATE: Constrained Semantic Guidance for Linguistic Negation in Text-to-Video Diffusion
Organizations: University of Maryland at College Park, United States
Abstract
Negation is a fundamental linguistic operator, yet it remains inadequately modeled in diffusion-based generative systems. In this work, we present a formal treatment of linguistic negation in diffusion-based generative models by modeling it as a structured feasibility constraint on semantic guidance within diffusion dynamics. Rather than introducing heuristics or retraining model parameters, we reinterpret classifier-free guidance as defining a semantic update direction and enforce negation by projecting the update onto a convex constraint set derived from linguistic structure. This novel formulation provides a unified framework for handling diverse negation phenomena, including object absence, graded non-inversion semantics, multi-negation composition, and scope-sensitive disambiguation. Our approach is training-free, compatible with pretrained diffusion backbones, and naturally extends from image generation to temporally evolving video trajectories. In addition, we introduce a structured negation-centric benchmark suite that isolates distinct linguistic failure modes in generative systems, to further research in this area. Experiments demonstrate that our method achieves robust negation compliance while preserving visual fidelity and structural coherence, establishing the first unified formulation of linguistic negation in diffusion-based generative models beyond representation-level evaluation.
Figures & tables
| Method | CLIPScore | CLIP-neg | BLIP | DINO-conf | NCS | NVR |
|---|---|---|---|---|---|---|
| Mochi | 0.2857 | 0.2411 | 0.8183 | 0.0175 | 3.5789 | 0.3625 |
| HunyuanVideo | 0.2743 | 0.2620 | 0.7776 | 0.0184 | 3.4584 | 0.3675 |
| CogVideoX | 0.2836 | 0.2442 | 0.7869 | 0.0181 | 3.4080 | 0.3800 |
| Ours (Full Model) | 0.2924 | 0.2336 | 0.8201 | 0.0167 | 4.0700 | 0.2300 |
| Ours w/o Repulsive Energy | 0.2924 | 0.2411 | 0.8128 | 0.0181 | 3.9548 | 0.2625 |
| Ours w/o Constraint Scheduling | 0.2800 | 0.2405 | 0.7869 | 0.0174 | 3.5789 | 0.3625 |
Appendix figures & tables32 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | CLIPScore | CLIP-neg | BLIP | DINO-conf | NCS | NVR |
|---|---|---|---|---|---|---|
| Mochi | 0.2857 0.0196 | 0.2411 0.0288 | 0.8183 0.0774 | 0.0175 0.0314 | 3.5789 1.8548 | 0.3625 0.4813 |
| HunyuanVideo | 0.2743 0.0360 | 0.2620 0.0388 | 0.7776 0.1018 | 0.0184 0.0268 | 3.4584 1.8712 | 0.3675 0.4827 |
| CogVideoX | 0.2836 0.0320 | 0.2442 0.0414 | 0.7869 0.0984 | 0.0181 0.0269 | 3.4080 1.8828 | 0.3800 0.4859 |
| Ours (Full Model) | 0.2924 0.0225 | 0.2336 0.0231 | 0.8201 0.0729 | 0.0167 0.0278 | 4.0700 1.6406 | 0.2300 0.4213 |
| Ours w/o Repulsive Energy | 0.2924 0.0221 | 0.2411 0.0281 | 0.8128 0.0756 | 0.0181 0.0301 | 3.9548 1.6724 | 0.2625 0.4405 |
| Ours w/o Constraint Scheduling | 0.2800 0.0305 | 0.2405 0.0477 | 0.7869 0.0881 | 0.0174 0.0245 | 3.5789 1.8439 | 0.3625 0.4813 |
| Category | Method | CLIPScore | NCS | NVR |
|---|---|---|---|---|
| AOC | Mochi | 0.2878 | 2.2800 | 0.6800 |
| HunyuanVideo | 0.2735 | 1.7200 | 0.8200 | |
| CogVideoX | 0.2805 | 2.3200 | 0.6800 | |
| Ours | 0.2967 | 2.4600 | 0.6400 | |
| LEN | Mochi | 0.2886 | 3.3200 | 0.5000 |
| HunyuanVideo | 0.2858 | 2.5800 | 0.6200 |
| Criterion | Ours | w/o Repulsive | w/o Scheduling |
|---|---|---|---|
| Negation Satisfaction | 5.00 0.00 | 2.90 1.94 | 2.90 1.94 |
| Constraint Meaning Accuracy | 5.00 0.00 | 2.70 1.75 | 2.40 1.58 |
| Scene & Action Alignment | 5.00 0.00 | 3.00 2.02 | 2.90 1.94 |
| Artifact Avoidance | 5.00 0.00 | 2.60 1.70 | 1.90 1.59 |
| Criterion | Model | Mean | Std | 95% CI |
|---|---|---|---|---|
| Negation Satisfaction | Ours | 4.76 | 0.88 | [4.68, 4.85] |
| Mochi | 1.96 | 1.56 | [1.81, 2.12] | |
| HunyuanVideo | 1.61 | 1.32 | [1.48, 1.74] | |
| CogVideoX | 1.34 | 0.84 | [1.26, 1.42] | |
| Constraint Meaning Accuracy | Ours | 4.75 | 0.89 | [4.66, 4.84] |
| Mochi | 1.94 | 1.52 | [1.79, 2.09] |
| Model | Step | Memory Consumption | Computation Time |
|---|---|---|---|
| Ours | Inference | 28.2580 GB / 80.0000 GB (26,949 MiB) | 235 sec |
| Ours w/o Replusive Energy | Inference | 25.2843 GB / 80.0000 GB (24,113 MiB) | 117 sec |
| Ours w/o Constraint Scheduling | Inference | 28.2496 GB / 80.0000 GB (26,941 MiB) | 168 sec |
| Mochi | Inference | 26.2406 GB / 80.0000 GB (25,025 MiB) | 114 sec |
| HunyuanVideo | Inference | 41.3589 GB / 80.0000 GB (39,443 MiB) | 396 sec |
| CogVideoX | Inference | 16.7845 GB / 80.0000 GB (16,007 MiB) | 61 sec |
Diffusion Model Guidance
Diffusion model guidance steers denoising toward desired conditions, rewards, constraints, or away from unwanted concepts.
See all 352 papers