Cyc3D: Evaluating Cyclic Structural Stability and Asset Usability in Image-to-3D Generation
Abstract
Image-conditioned 3D generation has advanced rapidly, yet existing evaluation protocols largely judge rendered-view plausibility and semantic alignment, overlooking whether a generator forms a stable 3D interpretation and produces assets usable in graphics pipelines. We introduce Cyc3D, a multidimensional benchmark that evaluates image-to-3D generation along two complementary axes: Cross-View Object Consistency and Representation Quality. At the asset level, Cyc3D measures whether object identity remains semantically coherent across rendered viewpoints. At the model level, we propose View-Cycle Structural Consistency, a closed-loop render-regenerate-align protocol that repeatedly re-observes a generated asset from novel views and quantifies geometric, perceptual, and semantic drift across generations. To assess native asset usability beyond rendered appearance, Cyc3D further evaluates geometric structure, reference-image fidelity, mesh discretization and efficiency, and UV parameterization quality. Together, these diagnostics expose failures obscured by a single perceptual score and provide interpretable evidence of both model instability and representation defects. Experiments on five representative image-to-3D systems show that closed-source feed-forward models consistently outperform open-source optimization-based baselines in geometric fidelity, mesh quality, and cycle stability. Nevertheless, even the strongest methods achieve cycle-stability scores below 48, revealing a persistent gap between visually plausible generation and robust 3D object understanding.
Figures & tables
| Benchmark | Asset-level Evaluation | Model-level Evaluation | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Quality | Editability | Cross-view Consistency | Cyclic Consistency | ||||||
| Appearance | Texture | Ref. Adherence | Mesh | UV | Semantic | Structural | Semantic | Structural | |
| T3Bench | – | – | – | – | – | ✓ | – | – | – |
| GPT-4V(ision) / GPTEval3D | ✓ | ✓ | – | – | – | ✓ | ✓ | – | – |
| Gen3DEval | ✓ | ✓ | – | – | – | ✓ | ✓ | – | – |
| Hi3DEval | ✓ | ✓ | – | – | – | ✓ | ✓ | – | – |
| Representation Quality | Cross-View Object Consistency | |||||||
| Method | Type | Geo. Struct. | Ref-View Fid. | Mesh Qual. | Mesh Effic. | UV Param. | Object Consist. | Cycle Stab. |
| Hunyuan3D | Closed | 82.6 | 70.2 | 83.9 | 89.1 | 68.8 | 83.7 | 47.1 |
| Tripo3D v3.1 | Closed | 75.2 | 59.1 | 84.2 | 86.9 | 78.8 | 87.3 | 45.6 |
| Stable Zero123 | Open | 45.3 | 34.5 | 41.6 | 51.5 | 70.0 | 54.9 | 25.5 |
| Magic123 | Open | 51.0 | 37.4 | 59.3 | 62.1 | 70.5 | 62.6 | 27.6 |
| DreamCraft3D | Open | 63.1 | 42.4 | 33.8 | 75.2 | 69.5 | 72.1 | 27.8 |
3D Asset Generation
3D asset generation creates and edits objects, characters, materials, and scenes from text, images, video, or geometric constraints.
See all 170 papers