Automatic rigging is a fundamental task for both static 3D and dynamic 4D mesh animation, yet existing methods do not provide a unified feedforward solution for these two settings. While static 3D riggers achieve strong quality, they often provide limited control over bone count and become temporally unstable when applied frame by frame to dynamic meshes. Existing 4D methods, in contrast, typically rely on expensive per-sequence optimization. We propose FlowRig, a template-free, data-efficient framework for unified 3D and 4D skeleton generation. Built on flow matching, FlowRig generates temporally aligned skeletons for an entire sequence in a single feedforward pass, while naturally handling single-mesh 3D rigging. The model further supports explicit skeleton-count control, uncertainty estimation for candidate selection, and masking-based interpolation, forecasting, and backcasting. To address limited paired 4D rigging data, we adopt a curriculum that initializes from large-scale 3D rigging data and adapts to mid-scale 4D mesh-skeleton data. Experiments show that FlowRig achieves strong static 3D rigging performance with controllable bone complexity, as well as high-quality and temporally consistent 4D reconstruction and prediction results.
Figures & tables
Figure 1: FlowRig unifies rigging for both 3D and 4D meshes. Compared with prior methods such as Puppeteer ( Song et al., 2025a ) and UniRig ( Zhang et al., 2025a ) , our model delivers accurate 3D rigging, preserves 4D temporal consistency, supports controllable bone count, achieves faster inference, and enables 4D skeleton prediction, including interpolation, forecasting, and backcasting.
Figure 2: FlowRig overview. We encode meshes into conditioning tokens, and initialize noisy skeleton slots, which are processed by a flow matching transformer to predict temporally aligned skeleton representations. The predicted features are decoded by the skeleton, graph, and uncertainty heads to recover 3D/4D rigging outputs, with uncertainty used for sample selection. n denotes the skeleton count, and ϕ denotes the unconditional token.
Figure 3: Data-efficient curriculum training. We first train on static 3D rigging, then adapt to 4D reconstruction, and finally enable prediction through masked conditioning. During the final stage, we use diverse masking patterns, including interpolation, forecasting, backcasting, and random masking, to expose the model to different temporal prediction settings. This schedule transfers large-scale 3D supervision to the data-scarce 4D setting.
Articulation-XL 2.0
ModelsResource
Diverse-Pose
Model
J2J ↓
J2B ↓
B2B ↓
J2J ↓
J2B ↓
B2B ↓
J2J ↓
J2B ↓
B2B ↓
Pinocchio
0.0832
0.0661
0.0549
0.0685
0.0482
0.0409
0.0797
0.0641
0.0515
RigNet
0.0762
0.0608
0.0528
0.0722
0.0599
0.0433
0.0775
0.0639
0.0571
MagicArt.
0.0326
0.0250
0.0212
0.0411
0.0314
0.0269
0.0438
0.0346
0.0296
Anymate
0.0409
0.0301
0.0294
0.0370
0.0261
0.0258
0.0342
0.0255
0.0272
UniRig
0.0331
0.0261
0.0218
0.0396
0.0302
0.0257
0.0325
0.0257
0.0208
Table 1: Static skeleton reconstruction comparison. Our methods achieves strong reconstruction fidelity across diverse out-of-domain static datasets. Ours* utilizes uncertainty as selection score to select the best candidate from the 5 samples and outperforms all baselines on Articulation-XL 2.0 and Diverse-Pose. On ModelsResource, its zero-shot performance approaches that of RigAnything trained directly on the same dataset. See the "Baselines" paragraph for citations of these models.
Figure 4: Static Reconstruction. Numbers from top to bottom are J2J, J2B, and B2B for each instance. Compared with baselines, our model preserves finer geometric details and achieves more accurate mesh alignment.
Figure 5: Dynamic reconstruction and prediction. Blue indicates reconstruction with mesh guidance, while yellow indicates predictions without mesh guidance. In (b), from top to bottom, it shows interpolation, forecasting, and backcasting, respectively. Refer to the demo video for a clearer comparison.
Method
N
J2J-W ↓
J2B-W ↓
B2B-W ↓
BND ↓
BDD ↓
GSD ↓
HD ↓
Puppeteer-D*
4
0.0161
0.0130
0.0118
2.8279
0.0075
0.1189
6.2173
Puppeteer-D*
8
0.0162
0.0131
0.0118
2.8753
0.0091
0.1575
8.3745
Puppeteer-D*
24
0.0163
0.0132
0.0119
3.1763
0.0150
0.2654
14.1894
Ours
4
0.0161
0.0125
0.0104
0
0.0021
0
0
Ours
8
0.0152
0.0119
0.0099
0
0.0026
0
0
Ours
24
0.0142
0.0112
0.0093
0
0.0038
0
0
Table 2: Dynamic quantitative comparisons on TexVerse dynamic dataset. N is time window length. Puppeteer-D* means we finetuned Puppeteer-diverse model ( Song et al., 2025a ) on TexVerse training dataset. Ours* utilizes uncertainty as selection score to select the best candidate from the 5 samples.
Static
Dynamic
J2J-W ↓
J2B-W ↓
B2B-W ↓
BDD ↓
GSD ↓
✗
✓
0.0213
0.0173
0.0147
0.0049
0
✓
✓
0.0142
0.0112
0.0093
0.0038
0
Table 3: Ablation studies on data sources. Metrics are evaluated on the TexVerse test set with T=24 .
Graph Head
GSD ↓
HD ↓
✗
0.0375
2.2844
✓
0
0
Table 4: Ablation studies on graph head. The metrics are evaluated on the TexVerse test set with time window T=24 .
Figure 6: Analysis of bone count control. Our model can freely control the number of bones to adjust skeletal detail, while existing baselines do not provide this level of controllable output granularity.
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
Figure S1: Bone Count Histogram of the filtered TexVerse dataset.
Method
Pinocchio
RigNet
UniRig
MagicArti.
Puppeteer
Ours
Inference time (s)
3.9
4.5
2.9
2.4
1.5
1.1
Appendix
Table S1: Comparison of inference time of skeleton generation on static mesh.
Time window size
1
2
4
8
16
24
Inference Time (s)
1.1
1.7
2.2
4.4
11.9
23.4
Appendix
Table S2: Inference time performance across different frame counts.
Category
n
Share
bipedal mammal
453
27.4%
fish
301
18.2%
bird
204
12.3%
dinosaur
193
11.7%
quadruped mammal
183
11.1%
insect
154
9.3%
Appendix
Table S3: Category composition of the new Objaverse-derived 4D evaluation set. No instance of this set is used for training; the model is trained only on the TexVerse split described in A
Category
n
Puppeteer-D*
RigGS
Ours
Ours*
amphibian
20
0.0524
0.0675
0.0389
0.0361
arachnid
20
0.0503
0.0567
0.0474
0.0468
bipedal mammal
20
0.0291
0.0536
0.0238
0.0222
bird
20
0.0759
0.0699
0.0627
0.0646
quadruped mammal
20
0.0722
0.0686
0.0564
0.0540
crustacean
20
0.0695
0.0637
0.0560
0.0558
Appendix
Table S4: Per-category J2J on the Objaverse ( Deitke et al., 2023 ) 4D evaluation set. Stratified subsample, T=8 . Bold is best in the row, underlined second best. MACRO averages the ten categories equally, MICRO weights by instance count.
Figure S2: More comparsion on static reconstruction.
Figure S3: More dynamic reconstruction results.
Method
Articulation-XL2.0
ModelsResource
Diverse-pose
Prec. ↑
Rec. ↑
L1 ↓
Prec. ↑
Rec. ↑
L1 ↓
Prec. ↑
Rec. ↑
L1 ↓
RigNet
73.7%
66.1%
0.729
65.7%
80.2%
0.707
74.7%
65.4%
0.746
MagicArti.
74.6%
71.3%
0.451
68.1%
80.7%
0.642
74.9%
68.4%
0.479
Puppeteer
87.6%
74.0 %
0.335
79.7%
81.6%
0.443
83.6%
72.2%
0.405
Puppeteer-D
87.9%
73.8%
0.333
79.8%
81.5 %
0.442
86.4%
72.8%
0.353
Ours
89.7%
75.0%
0.311
81.8%
76.2%
0.449
88.3%
73.6%
0.348
Appendix
Table S7: Quantitative comparison of skinning weight prediction. Precision (Prec.) and Recall (Rec.) quantify the accuracy and coverage of joint influence regions, respectively, where higher values ( ↑ ) denote superior performance. Numerical fidelity is assessed via the mean L1 error, where lower values ( ↓ ) indicate closer alignment with the ground truth.
Figure S4: Qualitative results of our skinning model.
Motion generation for rigged shapes is vital for scalable 4D asset production. However, template-based methods are limited by specific topologies and fail to generalize across diverse morphologies. Conversely, per-case optimization is computationally expensive, susceptible to local optima, and highly sensitive to viewpoint-induced ambiguities. In this paper, we present SkelMo, a diffusion-based framework designed for category-agnostic skeletal animation generation from 2D video guidance. To overcome the scarcity of high-quality training data, we have curated a large-scale dynamic dataset comprising approximately 20,000 diverse 3D animations, each featuring complete textures, skeletal rigging, and a wide array of comprehensive animation sequences. To bridge the kinematic gap between 2D visual motion cues and heterogeneous 3D skeletal structures, we propose a structural-semantic injection mechanism. Our model integrates texture and semantic attributes directly into skeletal joint representations. This allows it to map perceived visual dynamics to specific joint hierarchies and their functional roles. This enables SkelMo to synthesize high-fidelity animations that maintain anatomical consistency across a vast range of unseen categories, from existing biological species to fantastical beings. Extensive experiments demonstrate that our approach significantly outperforms existing methods, setting a new state-of-the-art benchmark for robust and efficient 4D asset generation. Project Page: https://research.davytao.me/skelmo/.
Ye Tao, Yuxin Yao, Kendong Liu +2
Department of Computer Science, City University of Hong Kong, Hong Kong SAR, China
4D dynamics (3D geometry evolving over time) is a fundamental representation of the physical world and plays a crucial role in world modeling (e.g., animation and games). Owing to the scarcity of large-scale, long-horizon 4D mesh data with arbitrary shapes, early text-to-4D methods rely on distillation or test-time optimization from video diffusion priors, making inference prohibitively slow. Recent feed-forward generators greatly reduce inference cost but offer limited spatiotemporal controllability, and short-horizon generation often leads to error accumulation in long-horizon sequences. We propose a novel feed-forward in-betweening framework for arbitrary 4D meshes with keyframe conditioning. Building on universal mesh-animation latents, we introduce a frame-wise mesh VAE that encodes each frame into topology-agnostic latent tokens anchored by a reference mesh for keyframe conditioning. We further introduce a keyframe-conditioned rectified flow model with an MMDiT backbone that synthesizes non-keyframe frames conditioned on sparse keyframes. Experiments show strong performance and improved controllability on both DyMesh16 and DyMesh32 benchmarks.
Hiroki Nishizawa, Hubert P. H. Shum, Yoshihiro Fukuhara +2
We study 4D generation to synthesize temporally coherent sequences of 3D geometry for animation and content creation. In contrast to existing SDS-based optimization methods and video-driven animation approaches, we adopt a skeleton-driven animation framework aligned with standard industrial pipelines, which enables explicit control and editing. To this end, we propose SkelGen4D, a weakly supervised feed-forward framework for text-driven mesh animation that generates explicit skeleton motions without requiring per-frame skeleton annotations. SkelGen4D first recovers temporally consistent pseudo-skeletons from animated meshes via differentiable fitting, and then generates text-conditioned skeleton motion sequences in a feed-forward manner, further refined with Motion-GRPO to ensure temporally coherent, physically plausible, and articulated animation. We evaluate our method on two large-scale benchmarks, Truebones Zoo and Diffusion4D. Our results show that our weakly supervised skeleton modeling matches or surpasses fully supervised baselines while scaling to diverse object categories for high-quality text-driven mesh animation. Further, our method supports flexible motion editing and is aligned with standard animation production pipelines.
Hao Feng, Zhi Zuo, Jia-Hui Pan +6
School of Data Science, Lingnan University, Hong Kong SAR, China · Department of Computer Science and Engineering, Chinese University of Hong Kong, Hong Kong SAR, China · Autodesk Research, Canada +1