FHAvatar: Fast and High-Fidelity Reconstruction of Face-and-Hair Composable 3D Head Avatar from Few Casual Captures
Organizations: Shanghai Jiao Tong University · Alibaba Group
Abstract
We present FHAvatar, a novel framework for reconstructing 3D Gaussian avatars with composable face and hair components from an arbitrary number of views. Unlike previous approaches that couple facial and hair representations within a unified modeling process, we explicitly decouple two components in texture space by representing the face with planar Gaussians and the hair with strand-based Gaussians. To overcome the limitations of existing methods that rely on dense multi-view captures or costly per-identity optimization, we propose an aggregated transformer backbone to learn geometry-aware cross-view priors and head-hair structural coherence from multi-view datasets, enabling effective and efficient feature extraction and fusion from few casual captures. Extensive quantitative and qualitative experiments demonstrate that FHAvatar achieves state-of-the-art reconstruction quality from only a few observations of new identities within minutes, while supporting real-time animation, convenient hairstyle transfer, and stylized editing, broadening the accessibility and applicability of digital avatar creation.
Figures & tables
| Method | PSNR | SSIM | LPIPS | AKD | CSIM | Modeling Time | FPS | |
|---|---|---|---|---|---|---|---|---|
| 1 frame | DiffusionRig [ 15 ] | 16.39 | 0.256 | 0.487 | 56.48 | 0.423 | 7 m | 0.85 |
| GAGAvatar [ 10 ] | 14.19 | 0.568 | 0.522 | 84.10 | 0.599 | 1.54 s | 44.16 | |
| LAM [ 22 ] | 16.41 | 0.662 | 0.409 | 48.64 | 0.461 | 0.31 s | 142.77 | |
| Ours (single-pass) | 22.46 | 0.803 | 0.325 | 3.96 | 0.522 | 3.13 s | 258.36 | |
| Ours (full) | 22.80 | 0.797 | 0.303 | 3.66 | 0.665 | 49.01 s | 259.56 | |
| 3 frames | DiffusionRig [ 15 ] | 16.29 | 0.271 | 0.492 | 56.59 | 0.524 | 14 m | 0.89 |
| Method | PSNR | SSIM | LPIPS |
|---|---|---|---|
| w/o Hair Branch | 23.32 | 0.782 | 0.421 |
| w/o Region Loss | 25.04 | 0.794 | 0.336 |
| w/o Finetune | 23.85 | 0.780 | 0.382 |
| Full | 25.14 | 0.796 | 0.333 |
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Overall | Face (w/o Neck) | Hair | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Method | PSNR | PSNR | SSIM | LPIPS | IoU | PSNR | SSIM | LPIPS | IoU |
| DiffusionRig [ 15 ] | 16.55 | 13.78 | 0.671 | 0.359 | 0.506 | 17.50 | 0.807 | 0.216 | 0.419 |
| FlashAvatar [ 70 ] | 16.08 | 14.64 | 0.651 | 0.336 | 0.220 | 16.91 | 0.773 | 0.210 | 0.179 |
| GaussianAvatars [ 50 ] | 23.44 | 21.48 | 0.784 | 0.200 | 0.864 | 23.54 | 0.830 | 0.163 | 0.608 |
| MeGA [ 63 ] | 17.29 | 16.92 | 0.649 | 0.302 | 0.624 | 19.60 | 0.759 | 0.193 | 0.476 |
| Ours | 23.71 | 24.60 | 0.880 | 0.102 | 0.922 | 24.46 | 0.867 | 0.157 | 0.826 |
| Case | Density Scale | Total Gaussians | ||
|---|---|---|---|---|
| (a) | 0.121 | 1.235 | 21 | 54080 |
| (b) | 0.228 | 1.000 | 42 | 84132 |
| (c) | 0.201 | 1.000 | 36 | 77455 |
3D Avatar Generation
3D avatar generation creates realistic, controllable digital humans from images, video, text, or other inputs.
See all 90 papers