PLSR: Progressive and Localized Super-Resolution of 3D Objects via Localized Latent Voxel Diffusion
Organizations: The Chinese University of Hong Kong, Hong Kong SAR, China · Guangdong University of Technology, China · City University of Hong Kong, Hong Kong SAR, China · Monash University, Australia
Abstract
High-resolution 3D asset generation is vital in various 3D applications. Existing state-of-the-art diffusion-based models remain constrained by fixed resolutions, limiting their ability to produce details. In this paper, we tackle the challenge of generating more detailed, higher-resolution 3D objects by introducing a 3D super-resolution (SR) framework built on existing 3D generative foundation models. To this end, we design PLSR, a progressive and localized super-resolution solution to achieve this goal effectively and memory efficiently. Technically, given a coarse geometry from a pretrained 3D generator, we decompose the global SR task into localized sub-tasks via an associative input decomposition scheme, adapt a flow-based 3D generator into a localized super-resolution model through low-cost finetuning, and unify them in an iterative patch-wise denoising pipeline for seamless high-resolution output. Experiments on challenging objects show that our approach is able to generate 3D details with new strong fine-detail fidelity while significantly reducing the computational cost, offering a new and practical solution for high-resolution 3D asset generation.
Figures & tables
| Method | LPIPS ↓ | FID ↓ | HFR ↑ | CD ↓ | F1 ↑ |
| TR.2(1536) | 0.122 | 60.37 | 0.981 | 0.0247 | 0.059 |
| TR.2(2560) | 0.122 | 63.19 | 0.923 | 0.0225 | 0.036 |
| UltraShape | 0.167 | 72.03 | 0.876 | 1.3982 | 0.109 |
| DetailGen3D | 0.187 | 93.35 | 0.645 | 0.4600 | 0.083 |
| Ours(2560) | 0.109 | 55.89 | 1.088 | 0.0139 | 0.145 |
3D Asset Generation
3D asset generation creates and edits objects, characters, materials, and scenes from text, images, video, or geometric constraints.
See all 170 papers