HairOrbit: Multi-view Aware 3D Hair Modeling from Single Portraits
Organizations: Mohamed bin Zayed University of Artificial Intelligence · SSE, The Chinese University of Hong Kong, Shenzhen · Pinscreen
Abstract
Reconstructing strand-level 3D hair from a single-view image is highly challenging, especially when preserving consistent and realistic attributes in unseen regions. Existing methods rely on limited frontal-view cues and small-scale/style-restricted synthetic data, often failing to produce satisfactory results in invisible regions. In this work, we propose a novel framework that leverages the strong 3D priors of video generation models to transform single-view hair reconstruction into a calibrated multi-view reconstruction task. To balance reconstruction quality and efficiency for the reformulated multi-view task, we further introduce a neural orientation extractor trained on sparse real-image annotations for better full-view orientation estimation. In addition, we design a two-stage strand-growing algorithm based on a hybrid implicit field to synthesize the 3D strand curves with fine-grained details at a relatively fast speed. Extensive experiments demonstrate that our method achieves state-of-the-art performance on single-view 3D hair strand reconstruction on a diverse range of hair portraits in both visible and invisible regions.
Figures & tables
| nastya | ksyusha | jenya | shortCurly | whiteCurly | midWavy | midCurly | Overall | |
|---|---|---|---|---|---|---|---|---|
| #Views | 62 | 66 | 70 | 58 | 42 | 33 | 64 | 395 |
| Gabor | 11.88 | 16.56 | 18.88 | 18.87 | 24.56 | 11.31 | 10.79 | 16.05 |
| HairStep | 6.28 | 10.98 | 13.16 | 13.68 | 21.57 | 6.32 | 5.54 | 10.88 |
| Ours | 1.79 | 4.97 | 6.09 | 6.72 | 13.50 | 2.15 | 2.12 | 5.13 |
| Metric | HairStep | DiffLocks | Im2Haircut | Ours |
|---|---|---|---|---|
| HairSale ( ∘ ) | 17.38 | 26.50 | 16.24 | 12.83 |
| HairRida ( ) | 77.01 | 69.67 | 79.38 | 80.52 |
| IoU | 0.639 | 0.593 | 0.757 | 0.847 |
| Method | @Input View | @Synthesized 8 Views | ||
|---|---|---|---|---|
| HairSale ( ∘ ) ↓ | IoU ↑ | HairSale ( ∘ ) ↓ | IoU ↑ | |
| 16.42 (-27.98%) | 0.794 | 13.45 (-34.90%) | 0.878 | |
| 13.70 (-6.78%) | 0.828 | 10.37 (-4.01%) | 0.887 | |
| 19.10 (-48.87%) | 0.680 | 24.14 (-142.1%) | 0.658 | |
| Full | 12.83 | 0.847 | 9.97 | 0.900 |
3D Reconstruction
3D reconstruction recovers a scene’s shape, appearance, and camera motion from images, video, depth, or other sensor measurements.
See all 955 papers