SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video Diffusion
Organizations: Lenovo Research, Beijing, China
Abstract
Artificial Intelligence Generated Content (AIGC), particularly video generation with diffusion models, has been advanced rapidly. Invisible watermarking is a key technology for protecting AI-generated videos and tracing harmful content, and thus plays a crucial role in AI safety. Beyond post-processing watermarks which inevitably degrade video quality, recent studies have proposed distortion-free in-generation watermarking for video diffusion models. However, existing in-generation approaches are non-blind: they require maintaining all the message-key pairs and performing template-based matching during extraction, which incurs prohibitive computational costs at scale. Moreover, when applied to modern video diffusion models with causal 3D Variational Autoencoders (VAEs), their robustness against temporal disturbance becomes extremely weak. To overcome these challenges, we propose SIGMark, a Scalable In-Generation watermarking framework with blind extraction for video diffusion. To achieve blind-extraction, we propose to generate watermarked initial noise using a Global set of Frame-wise PseudoRandom Coding keys (GF-PRC), reducing the cost of storing large-scale information while preserving noise distribution and diversity for distortion-free watermarking. To enhance robustness, we further design a Segment Group-Ordering module (SGO) tailored to causal 3D VAEs, ensuring robust watermark inversion during extraction under temporal disturbance. Comprehensive experiments on modern diffusion models show that SIGMark achieves very high bit-accuracy during extraction under both temporal and spatial disturbances with minimal overhead, demonstrating its scalability and robustness. Our project is available at https://jeremyzhao1998.github.io/SIGMark-release/.
Figures & tables
| Diffusion model | HunyuanVideo T2V | HunyuanVideo I2V | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Watermarking | 512 bits | 512 16 bits | 512 bits | 512 16 bits | |||||
| Method | Category | Bit acc | V-score | Bit acc | V-score | Bit acc | V-score | Bit acc | V-score |
| No-mark | – | – | 0.490 | – | 0.490 | – | 0.463 | – | 0.463 |
| DCT | Post | 0.889 | 0.424 | 0.862 | 0.423 | 0.890 | 0.452 | 0.858 | 0.456 |
| DT-CWT | Post | 0.619 | 0.416 | 0.650 | 0.436 | 0.627 | 0.458 | 0.611 | 0.463 |
| VideoMark | None-blind | 0.873 | 0.507 | 0.758 | 0.502 | 0.846 | 0.483 | 0.707 | 0.482 |
| Method | Spatial disturbance | Temporal disturbance | ||||||
|---|---|---|---|---|---|---|---|---|
| w/o | G.noise | cmprs | blur | w/o | drop | insert | clip | |
| VideoMark | 0.85 | 0.64 ↓0.21 | 0.63 ↓0.22 | 0.64 ↓0.21 | 0.71 | 0.52 ↓0.19 | 0.51 ↓0.20 | 0.51 ↓0.20 |
| VideoShield | 1.00 | 1.00 ↓0.00 | 0.99 ↓0.01 | 1.00 ↓0.00 | 0.99 | 0.89 ↓0.10 | 0.84 ↓0.15 | 0.83 ↓0.16 |
| SIGMark(Ours) | 0.98 | 0.89 ↓0.09 | 0.84 ↓0.14 | 0.95 ↓0.03 | 0.91 | 0.81 ↓0.10 | 0.87 ↓0.04 | 0.85 ↓0.06 |
| Method | Watermark embedding | Watermark extraction | ||||
|---|---|---|---|---|---|---|
| Single PRC | GF-PRC(Ours) | w/o SGO | w/o OF-seg | w/o SW-det | SGO(Ours) | |
| Bit acc | 0.707 | 0.905 | 0.534 | 0.762 | 0.823 | 0.869 |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Dimension | Prompt Text | Image |
| Complex Plot | The race commenced with explosive energy as the first runner from Team A surged ahead, capturing the attention of all spectators. His swift pace set the tone, but during the baton exchange, a slight fumble nearly cost them. Despite the near mishap, he managed to hand off the baton to the second runner, who, with fierce determination, pursued Team B relentlessly, overtaking them on the curve. However, the earlier error meant their lead was slim. As the third runner took over, nerves were palpable, yet he maintained their position, though Team C’s strategic pacing brought them dangerously close. In the final handoff, the pressure was immense. The last runner from Team A accelerated on the penultimate turn, unleashing a powerful sprint that widened the gap. With unwavering focus, he crossed the finish line triumphantly, securing victory for Team A amidst roaring cheers. | |
| Composition | A magnificent lion, its golden mane flowing like a regal crown, possesses the expansive, powerful wings of an eagle, each feather shimmering under the sun’s radiant glow. It soars effortlessly through a vast, azure sky, the clouds parting gracefully in its wake. The lion’s eyes, sharp and focused, scan the horizon with a kingly gaze, while its muscular body glides with the grace of a seasoned aviator. Below, the earth stretches out in a patchwork of greens and browns, rivers glistening like silver ribbons. The scene captures a breathtaking blend of strength and elegance, as the majestic creature commands the heavens with unparalleled ease. | |
| Dynamic Attribute | In a serene forest, the camera captures a mesmerizing transformation as vibrant red leaves slowly transition to lush green. The scene begins with a close-up of a single leaf, its deep crimson hue glowing under the gentle sunlight. As the camera pans out, the surrounding foliage reveals a tapestry of red, orange, and yellow, creating a warm, autumnal atmosphere. Gradually, the colors shift, with hints of green emerging, symbolizing the renewal of life. The sunlight filters through the canopy, casting dappled shadows on the forest floor, while a gentle breeze rustles the leaves, enhancing the sense of change and rebirth. | |
| Dynamic Spatial Relationship | A playful dog, with its fur slightly ruffled by the breeze, stands on the left side of a wooden dining table, its ears perked up and eyes full of curiosity. The table is surrounded by cozy chairs and a vase with fresh flowers on top. As the dog gets excited, it begins to sprint energetically towards the front of the table, its paws making soft thudding sounds against the wooden floor, eager to reach the other side where a chew toy lies waiting. | |
| Instance Preservation | A vibrant orange dog, with a sleek coat and playful demeanor, sprints joyfully across a sunlit meadow, its ears flapping in the breeze. The dog’s eyes sparkle with excitement as it bounds over the lush green grass, leaving a trail of paw prints behind. In the background, wildflowers sway gently, adding bursts of color to the scene. The sun casts a warm glow, highlighting the dog’s energetic movements and the natural beauty surrounding it. As the dog runs, its tail wags enthusiastically, embodying pure joy and freedom in the open, expansive landscape. |
| Dimension | Hunyuan-I2V | Hunyuan-T2V | Wan-I2V | Wan-T2V |
| complex plot | 1.0000 | 0.9292 | 1.0000 | 1.0000 |
| composition | 1.0000 | 0.9313 | 1.0000 | 1.0000 |
| dynamic attribute | 1.0000 | 0.8878 | 1.0000 | 0.8974 |
| dynamic spatial relationship | 0.9773 | 0.9991 | 1.0000 | 0.9554 |
| instance preservation | 0.9117 | 0.9584 | 1.0000 | 0.9150 |
| motion rationality | 0.9684 | 1.0000 | 1.0000 | 0.9379 |
Diffusion Model Watermarking
Diffusion model watermarking embeds detectable signals in generated content or models to support provenance, ownership verification, and attribution.
See all 46 papers