ForgeDreamer: Industrial Text-to-3D Generation with Multi-Expert LoRA and Cross-View Hypergraph
Organizations: Shenzhen University, Shenzhen, Guangdong 518060, China · Guangzhou Maritime University, Guangzhou, Guangdong 510725, China
Abstract
Current text-to-3D generation methods excel in natural scenes but struggle with industrial applications due to two critical limitations: domain adaptation challenges where conventional LoRA fusion causes knowledge interference across categories, and geometric reasoning deficiencies where pairwise consistency constraints fail to capture higher-order structural dependencies essential for precision manufacturing. We propose a novel framework named ForgeDreamer addressing both challenges through two key innovations. First, we introduce a Multi-Expert LoRA Ensemble mechanism that consolidates multiple category-specific LoRA models into a unified representation, achieving superior cross-category generalization while eliminating knowledge interference. Second, building on enhanced semantic understanding, we develop a Cross-View Hypergraph Geometric Enhancement approach that captures structural dependencies spanning multiple viewpoints simultaneously. These components work synergistically improved semantic understanding, enables more effective geometric reasoning, while hypergraph modeling ensures manufacturing-level consistency. Extensive experiments on a custom industrial dataset demonstrate superior semantic generalization and enhanced geometric fidelity compared to state-of-the-art approaches. Code is available at https://github.com/Junhaocai27/ForgeDreamer
Figures & tables
| Method | Time † | Average ∗ |
|---|---|---|
| ProlificDreamer [ 42 ] (w/o LoRA) | 10 hours | 25.13 |
| DreamFusion [ 33 ] (w/o LoRA) | 6 hours | 41.91 |
| DreamFusion [ 33 ] (w/ LoRA) | 44.83 | |
| RichDreamer [ 34 ] (w/o LoRA) | 120 minutes | 28.27 |
| LucidDreamer [ 20 ] (w/o LoRA) | 110 minutes | 47.10 |
| LucidDreamer [ 20 ] (w/ LoRA) | 46.75 |
| Method | Two LoRAs | Four LoRAs | Six LoRAs |
|---|---|---|---|
| Addition | 0.938 | 0.814 | 0.633 |
| Distillation | 0.965 | 0.949 | 0.952 |
| Method | Two | Four | Six |
|---|---|---|---|
| (CLIP-ViT-L/14) | LoRAs | LoRAs | LoRAs |
| Individual Concepts | |||
| Emb1 (Addition) | 0.899 | 0.793 | 0.658 |
| Emb1 (Distillation) | 0.927 | 0.934 | 0.904 |
| Emb2 (Addition) | 0.886 | 0.779 | 0.653 |
| Emb2 (Distillation) | 0.915 | 0.963 | 0.963 |
| Method | G. LED | Nut | R. LED | Resistor | Screw | Bearing | Capacitor | Hex Stud | Nail | Gasket | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|
| ProlificDreamer [ 42 ] (w/o LoRA) | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 6 | 6.9 |
| RichDreamer [ 34 ] (w/o LoRA) | 6 | 6 | 6 | 6 | 6 | 4 | 6 | 6 | 4 | 3 | 5.3 |
| DreamFusion [ 33 ] (w/ LoRA) | 3 | 5 | 2 | 2 | 2 | 2 | 4 | 2 | 1 | 1 | 2.4 |
| DreamFusion [ 33 ] (w/o LoRA) | 5 | 4 | 5 | 5 | 5 | 1 | 1 | 5 | 5 | 4 | 4.0 |
| LucidDreamer [ 20 ] (w/LoRA) | 2 | 3 | 3 | 3 | 4 | 6 | 5 | 4 | 3 | 5 | 3.8 |
| LucidDreamer [ 20 ] (w/o LoRA) | 4 | 2 | 4 | 4 | 3 | 5 | 2 | 3 | 6 | 7 | 4.0 |
| Method | G. LED | Nut | R. LED | Resistor | Screw | Bearing | Capacitor | Hex Stud | Nail | Gasket | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|
| ProlificDreamer [ 42 ] (w/o LoRA) | 27.19 | 22.34 | 24.49 | 26.60 | 34.85 | 31.64 | 20.48 | 7.85 | 26.39 | 29.45 | 25.13 |
| RichDreamer [ 34 ] (w/o LoRA) | 17.21 | 42.26 | 15.58 | 42.31 | 38.33 | 21.24 | 17.83 | 24.38 | 39.90 | 23.70 | 28.27 |
| DreamFusion [ 33 ] (w/o LoRA) | 32.62 | 69.72 | 29.92 | 28.49 | 46.59 | 28.38 | 35.45 | 36.66 | 52.27 | 59.02 | 41.91 |
| DreamFusion [ 33 ] (w/ LoRA) | 48.27 | 63.31 | 31.98 | 38.40 | 56.29 | 22.76 | 21.12 | 50.61 | 62.27 | 53.27 | 44.83 |
| LucidDreamer [ 20 ] (w/o LoRA) | 44.46 | 71.37 | 31.24 | 53.23 | 53.97 | 36.86 | 45.51 | 58.93 | 39.66 | 35.72 | 47.10 |
| LucidDreamer [ 20 ] (w/ LoRA) | 48.45 | 64.62 | 53.98 | 30.16 | 57.31 | 20.60 | 22.45 | 54.23 | 57.39 | 58.30 | 46.75 |
Text-to-3D Generation
Text-to-3D generation creates 3D objects and scenes from language while balancing semantic alignment, geometry, appearance, and spatial coherence.
See all 64 papers