MultiBinder: Preventing Multi-Subject Identity Leakage in Personalized Video Generation
Organizations: University of Science and Technology of China Hefei, China · HiDream.ai Inc. Beijing, China
Abstract
Personalized video generation faces a significant scalability challenge: as the number of custom subjects increases, existing methods suffer from severe identity leakage and semantic entanglement, resulting in videos with blended attributes and incoherent narratives. We identify that this stems from a lack of explicit binding between textual entity phrases and their corresponding visual patterns prior to fusion in diffusion models. To address this, we propose MultiBinder, a novel framework built on a bind-then-narrate'' paradigm. Our approach introduces a two-stage conditioning process before video diffusion. First, Cross-modal Entity Binding devises an entity-aware Q-Former to extract identity-centric features from each subject's reference image and tightly align them with its unique entity phrase, yielding disentangled identity tokens.'' Second, a Multimodal Large Language Model (MLLM) acts as a narrative director'' in the Narrative-Aware Subject Arrangement stage, capturing the action of each subject from the text prompt and synthesizes contextualized subject features that encapsulate who is doing what'' and preserve role-specific distinctions. These features are then injected into a video diffusion model via dedicated conditioning pathways, ensuring precise attribute allocation. Extensive experiments on both general and newly curated multi-subject benchmarks show that MultiBinder significantly outperforms existing methods in multi-subject identity fidelity.
Figures & tables
| Method | Aes. | M. Smo. | M. Amp. | FaceSim | Gme. | Nexus. | Natural. | Total. |
|---|---|---|---|---|---|---|---|---|
| VACE-P1.3B | 47.34% | 96.8% | 12.03% | 16.59% | 71.38% | 40.19% | 64.31% | 48.98% |
| VACE-1.3B | 48.24% | 97.2% | 18.83% | 20.57% | 71.26% | 37.91% | 65.46% | 49.89% |
| Phantom-1.3B | 46.67% | 93.3% | 14.29% | 48.56% | 69.43% | 42.48% | 62.5% | 54.89% |
| MultiBinder | 48.13% | 97.06% | 32.16% | 43.45% | 69.89% | 43.17% | 65.18% | 55.52% |
| Method | |||
|---|---|---|---|
| VACE-P1.3B | 46.37% | 61.20% | |
| VACE-1.3B | 54.64% | 63.09% | |
| Phantom-1.3B | 55.03% | 72.15% | |
| VACE-14B | 62.38% | 77.10% | |
| Phantom-14B | 65.46% | 76.44% | |
| Kling-1.6 | 69.51% | 82.89% |
| Method | TotalScore | ||
|---|---|---|---|
| Cross-Modal Entity Binding | |||
| w/o Q-Former | 49.21% | 51.63% | 63.11% |
| Vanilla Q-Former | 49.95% | 52.75% | 64.20% |
| Entity-aware Q-Former | 52.43% | 56.31% | 73.69% |
| Entity-aware Q-Former + ERA | 53.17% | 59.46% | 73.85% |
| Narrative-Aware Subject Arrangement | |||
Identity-Preserving Video Generation
Identity-preserving video generation keeps a person or character recognizable as appearance, pose, motion, and scenes change.
See all 71 papers