LatentReRig: An SDF-Based VAE with Dual Decoders for Latent-Space Deformation Conditioning
Organizations: AnimSchool, Utah, USA · Mostly Very True SRL, Viterbo, Italy · Università degli Studi Guglielmo Marconi, Rome, Italy
Abstract
Transferring deformation between characters with different geometry and topology is challenging because conventional rigs encode behaviour through character-specific structures and correspondences. We present LatentReRig, an experimental framework that investigates whether pose-associated changes can instead be represented as reusable directions in a learned geometric latent space. An SDF-based variational autoencoder is coupled with two decoders: one reconstructs the implicit field, while the other predicts target vertex positions from source geometry and latent deformation conditioning. The source geometry may be neutral or already deformed. Experiments on a controlled humanoid dataset show that several poses induce coherent latent directions across identities, particularly for broad articulated motions. These signals can guide deformation of unseen characters, but explicit predictions remain less accurate for localized changes and corrective contributions. Diagnostic comparisons with repeated SDF sampling show that inter-identity distances exceed same-geometry resampling variability on average, while pose signals exhibit different margins above this baseline. The results support the presence of reusable pose-related structure and identify stable local conditioning and accurate mesh decoding as complementary requirements for improving transfer.
Figures & tables
| Statistic | Identity | Noise |
|---|---|---|
| 190 | 190 | |
| Mean | 27.01 | 8.30 |
| Median | 25.29 | 8.03 |
| Std. | 9.66 | 2.56 |
| Min. | 11.70 | 2.36 |
| Max. | 61.08 | 18.33 |
| Pose | ID dist. | Delta cosine |
|---|---|---|
| elbowBentLf | 29.22 | 0.952 |
| fingerKnuckleD03Lf | 31.67 | 0.921 |
| fingerKnuckleA01Lf | 30.10 | 0.791 |
| browDwLf | 29.01 | 0.800 |
Human Avatar Animation
Human avatar animation builds digital people that can be reconstructed, driven by motion or speech, and rendered consistently across poses and views.
See all 91 papers