CrowdGaussian: Reconstructing High-Fidelity 3D Gaussians for Human Crowd from a Single Image
Organizations: Nanjing University, China · State Key Laboratory of Novel Software Technology, China · Fudan University, China
Abstract
Single-view 3D human reconstruction has garnered significant attention in recent years. Despite numerous advancements, prior research has concentrated on reconstructing 3D models from clear, close-up images of individual subjects, often yielding subpar results in the more prevalent multi-person scenarios. Reconstructing 3D human crowd models is a highly intricate task, laden with challenges such as: 1) extensive occlusions, 2) low clarity, and 3) numerous and various appearances. To address this task, we propose CrowdGaussian, a unified framework that directly reconstructs multi-person 3D Gaussian Splatting (3DGS) representations from single-image inputs. To handle occlusions, we devise a self-supervised adaptation pipeline that enables the pretrained large human model to reconstruct complete 3D humans with plausible geometry and appearance from heavily occluded inputs. Furthermore, we introduce Self-Calibrated Learning (SCL). This training strategy enables single-step diffusion models to adaptively refine coarse renderings to optimal quality by blending identity-preserving samples with clean/corrupted image pairs. The outputs can be distilled back to enhance the quality of multi-person 3DGS representations. Extensive experiments demonstrate that CrowdGaussian generates photorealistic, geometrically coherent reconstructions of multi-person scenes.
Figures & tables
| Method | PSNR | SSIM | LPIPS |
|---|---|---|---|
| IDOL [ 58 ] | 18.063 | 0.919 | 0.994 |
| LHM [ 29 ] | 18.171 | 0.918 | 1.012 |
| LORM | 18.566 | 0.923 | 0.956 |
| LORM+CrowdRefiner | 18.619 | 0.931 | 0.914 |
| Method | Occlusion Ratio | PSNR | SSIM | LPIPS |
|---|---|---|---|---|
| 20% | 18.196 | 0.921 | 0.978 | |
| IDOL | 40% | 17.412 | 0.914 | 1.027 |
| 60% | 16.667 | 0.909 | 1.063 | |
| 20% | 17.945 | 0.919 | 1.006 | |
| LHM | 40% | 17.709 | 0.916 | 1.026 |
| 60% | 17.551 | 0.915 | 1.037 |
| SCL | Normal | PSNR | SSIM | LPIPS |
|---|---|---|---|---|
| 20.013 | 0.888 | 0.141 | ||
| ✓ | 20.130 | 0.892 | 0.138 | |
| ✓ | 20.382 | 0.896 | 0.129 | |
| ✓ | ✓ | 20.790 | 0.901 | 0.122 |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
3D Human Reconstruction
3D Human Reconstruction recovers human shape, pose, appearance, and motion from images, video, or other sensor data.
See all 103 papers