Visual effects (VFX) are essential for enhancing the expressiveness and creativity of video content, yet producing high-quality effects typically requires expert knowledge and costly production pipelines. Existing AIGC systems face significant challenges in VFX generation due to the scarcity of effect-specific data and the inherent difficulty of modeling supernatural or stylized effects. Moreover, these approaches often require per-effect fine-tuning, which severely limits their scalability and generalization to novel VFX. In this work, we present EffectMaker, a unified reasoning-generation framework that enables reference-based VFX customization. EffectMaker employs a multimodal large language model to interpret high-level effect semantics and reason about how they should adapt to a target subject, while a diffusion transformer leverages in-context learning to capture fine-grained visual cues from reference videos. These two components form a semantic-visual dual-path guidance mechanism that enables accurate, controllable, and effect-consistent synthesis without per-effect fine-tuning. Furthermore, we construct EffectData, the largest high-quality synthetic dataset containing 130k videos across 3k VFX categories, to improve generalization and scalability. Experiments show that EffectMaker achieves superior visual quality and effect consistency over state-of-the-art baselines, offering a scalable and flexible paradigm for customized VFX generation. Project page: https://effectmaker.github.io
Figures & tables
Dataset
# Classes
# Videos
Label
Caption
Instruction
VFX-307 [ 15 ]
–
190
✗
✗
✗
Open-VFX [ 32 ]
52
634
✓
✗
✗
Omni-VFX [ 34 ]
55
1700
✓
✗
✗
HiggisField [ 17 ]
145
1060
✓
✓
✗
VAP-Data [ 2 ]
100
90k
✓
✗
✗
EffectData (Ours)
3000
130k
✓
✓
✓
Table 1: Comparison of existing VFX datasets. Our dataset significantly expands the number of effect classes and provides detailed captions and editing instructions.
Figure 2: Overview of our model architecture. Given a reference VFX video and a target image, on the reasoning side, an MLLM extracts high-level semantic cues of the reference video, providing abstract effect descriptions that serve as semantic guidance. On the generation side, a video DiT model leverages in-context generation to capture fine-grained visual details from the reference, and generates a target video with consistent visual effect.
Figure 3: (a) Illustration of our EffectData construction pipeline. (b) Some examples from the EffectData dataset.
Figure 4: Qualitative comparison with related baselines on OpenVFX dataset.
Metrics
Methods
Cake-ify
Crumble
Decapitate
Deflate
Dissolve
Explode
Eye-pop
Harley
Inflate
Levitate
Melt
Squish
Ta-da
Venom
Avg.
VQ ↑
VFX-Creator
2.71
2.41
2.68
2.33
1.69
1.38
2.13
0.97
2.41
2.50
1.96
1.77
2.28
1.62
2.06
Omni-Effect
3.11
2.49
2.62
2.39
1.93
1.84
2.23
1.48
2.55
2.27
2.20
2.27
2.59
1.82
2.27
Wan2.2-FT
2.15
1.42
2.63
2.15
1.64
0.91
2.23
1.71
1.89
2.12
1.74
2.11
2.04
1.69
1.89
Ours
3.39
2.94
3.01
2.99
1.93
2.23
2.44
2.17
3.19
3.70
2.53
2.79
3.99
2.46
2.84
MQ ↑
VFX-Creator
-0.05
-0.15
-0.05
0.13
-0.17
-0.35
0.11
-0.26
-0.14
0.48
-0.16
-0.41
0.77
-0.21
-0.03
Omni-Effect
0.12
-0.27
-0.08
0.02
-0.09
-0.33
0.04
-0.28
-0.11
-0.04
-0.14
-0.37
-0.09
-0.34
-0.14
Table 2: Quantitative comparison with related baselines on the OpenVFX dataset. VQ=visual quality, MQ=motion quality, TA=text alignment, CAS=class alignment score. All metrics are model-based; higher values indicate better performance.
Figure 5: Qualitative comparison on unseen visual effects.
Figure 6: Reference rephrasing results. Given only a reference effect video, our model reproduces the target video with similar visual content and effect.
Conditioning
VQ ↑
MQ ↑
TA ↑
CAS ↑
RAS ↑
Semantic
2.78
0.16
1.06
4.20
3.84
Visual
2.48
0.12
-0.38
2.24
1.48
Semantic+Visual
2.92
0.21
1.24
4.40
4.16
Table 3: Ablation study on different conditioning types.
Figure 7: Ablation on different types of conditioning.
# VFX Class
VQ ↑
MQ ↑
TA ↑
CAS ↑
RAS ↑
100
2.76
0.13
0.94
3.76
3.22
1000
2.89
0.19
1.21
4.22
4.04
Table 4: Effect of scaling up training set on model performance.
Figure 8: Results of human preference percentage.
Appendix figures & tables14 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 9: Prompt template for automatic Effect Class Alignment (CAS) Scoring.
Figure 10: Screen shot of user study questionnaire.
Figure 11: Detailed human preference percentages for each VFX class and each evaluation dimension.
Figure 12: Word cloud of atmospheric VFX elements, showing the diversity of effect classes.
Figure 13: We show four groups of paired images under the same VFX. Each group contains three paired images with different subjects but the same effect.
Figure 14: Prompt template for generating VFX editing instruction.
Figure 15: Additional visual comparison with related baselines on OpenVFX dataset.
Figure 16: Additional visual results. In each grid, top row is the reference video, bottom row is our generated result.
Figure 17: Additional visual results. In each grid, top row is the reference video, bottom row is our generated result.
Figure 18: Additional visual results. In each grid, top row is the reference video, bottom row is our generated result.
Figure 19: Additional visual results. In each grid, top row is the reference video, bottom row is our generated result.
Figure 20: Additional visual results. In each grid, top row is the reference video, bottom row is our generated result.
Figure 21: Real-world VFX transfer examples.
Figure 22: Failure cases of our method. (a) Due to the limited capacity of the base model, subject fidelity may degrade under large and rapid motions (e.g., sudden upward take-off). (b) When the user provides a first-frame image that is semantically incompatible with the reference effect, the transferred effect becomes incoherent and fails to reflect the intended VFX.
Recent advancements in video generation models have significantly improved their ability to follow text prompts. However, the customization of dynamic visual effects, defined as temporally evolving and appearance-driven visual phenomena like object crushing or explosion, remains underexplored. Prior works on motion customization or control mainly focus on low-level motions of the subject or camera, which can be guided using explicit control signals such as motion trajectories. In contrast, dynamic visual effects involve higher-level semantics that are more naturally suited for control via text prompts. However, it is hard and time-consuming for humans to craft a single prompt that accurately specifies these effects, as they require complex temporal reasoning and iterative refinement over time. To address this challenge, we propose P-Flow, a novel training-free framework for customizing dynamic visual effects in video generation without modifying the underlying model. By leveraging the semantic and temporal reasoning capabilities of vision-language models, P-Flow performs test-time prompt optimization, refining prompts based on the discrepancy between the visual effects of the reference video and the generated output. Through iterative refinement, the prompts evolve to better induce the desired dynamic effect in novel scenes. Experiments demonstrate that P-Flow achieves high-fidelity and diverse visual effect customization and outperforms other models on both text-to-video and image-to-video generation tasks. Code is available at https://github.com/showlab/P-Flow.
Autoregressive video models can generate minute-long videos in real time, but they produce generic subjects from text rather than specific subjects from user-provided images. Existing customization methods either require costly per-subject optimization or use pretrained conditioning networks that jointly process all video frames with bidirectional attention. Neither approach is designed for causal streaming. We present Custom Forcing, a training-free method that stores reference-based anchor frames in the persistent KV cache of a frozen autoregressive video model. However, fixed anchors face two limitations: simple conditioning allows identity to drift, and the text prompt continues to favor a generic subject. To address these problems, drift-adaptive value amplification (DVA) scales reference influence with the degree of identity drift, while anchor contrast guidance (ACG) steers generation away from the generic class prior. Over two-minute rollouts, fixed anchors fall from 0.58 to 0.42 in DINO-I, while Custom Forcing keeps it between 0.58 and 0.62 without reducing motion. Custom Forcing also achieves higher subject similarity than bidirectional customization methods and better preserves identity over 30s than causal image-to-video and reference-to-video models, while generating each frame 9.5-28.5 times faster than these long-video baselines.
Yunseung Ok, Hyunsoo Kim, Minseo Kim +1
Kyung Hee University · The University of Texas at Austin
Generating high-fidelity visual effects (VFX) typically demands massive datasets and prohibitive computational power due to the intricate coupling of spatial textures and temporal dynamics. In this paper, we introduce EasyVFX, a resource-efficient framework that achieves realistic VFX synthesis under stringent constraints. Our core philosophy lies in frequency-domain decomposition: we observe that the complexity of VFX can be significantly mitigated by decoupling high-frequency components, which represent intricate spatial appearances, from low-frequency components that encapsulate global motion dynamics. This spectral disentanglement transforms a high-dimensional learning problem into manageable sub-tasks, thereby lowering the optimization barrier and reducing data dependency. Building upon this insight, we propose a two-stage training paradigm. First, we design a Frequency-aware Mixture-of-Experts (Freq-MoE) architecture. By utilizing a soft routing mechanism, our model assigns specialized experts to distinct spectral bands, enabling them to cultivate robust priors for appearance and motion dynamics. This specialization allows the model to acquire foundational VFX knowledge with fewer GPU resources. Second, we introduce a Test-Time Training strategy powered by a novel Frequency-constraint Loss. This allows the pre-trained model to swiftly adapt to specific, unseen effects through localized optimizations, requiring only about 100 steps on a single GPU. Experimental results demonstrate that EasyVFX produces structurally consistent and visually stunning effects, proving that frequency-aware learning is a key catalyst for democratizing professional-grade VFX.