While single-image 3D texture generation has advanced significantly, conditioning texture synthesis on multi-view reference images remains largely under-explored, despite its necessity for resolving surface ambiguity in unobserved regions. In this paper, we propose RouTex, a novel multi-reference 3D texture generation framework based on in-context Diffusion Transformers (DiT). Our key insight is that native 3D Rotary Position Encoding (RoPE) inherently possesses spatial addressing capabilities. We introduce Positional Routing (PR) to reprogram 3D RoPE along spatial and semantic dimensions, establishing explicit reference-to-view correspondence without introducing additional parameters. To execute this routing efficiently, Dual-Granularity Attention (DGA) combines per-view local attention for fine texture fidelity with global joint attention over deduplicated references for cross-view consistency. Extensive experiments demonstrate that RouTex achieves new state-of-the-art performance in multi-reference 3D texture generation.
Figures & tables
Figure 1: Overview of RouTex. Given multi reference images from different azimuth regions and geometry conditions, Positional Routing assigns fractional semantic codes and aligns each reference to its target view coordinates. Double-stream blocks perform per-view local attention, then single-stream blocks perform global joint attention with deduplicated references.
Method
FID ↓
KID ↓
CLIP-I ↑
LPIPS ↓
TRELLIS
18.83
28.49
0.9149
0.1727
TRELLIS.2
12.93
4.53
0.9246
0.1656
Hunyuan3D-2.1
15.52
10.34
0.9242
0.1703
MV-Adapter
15.34
12.04
0.9217
0.1710
LumiTex
17.64
23.82
0.9258
0.1666
Ours
12.06
8.66
0.9423
0.1519
Table 1: Quantitative comparison with state-of-the-art methods. Red and blue highlight the best and second-best results, respectively.
Figure 2: Qualitative comparison with open-source methods. Orange and red boxes highlight zoomed-in regions for detail inspection. In the input column, red-bordered images indicate the input of single-image methods.
Figure 3: Qualitative comparison with commercial methods. Orange and red boxes highlight zoomed-in regions for detail inspection.
Method
FID ↓
KID ↓
CLIP-I ↑
LPIPS ↓
CSIC
20.08
27.49
0.9122
0.1700
w/o PR & DGA
14.61
13.13
0.9280
0.1619
w/o PR
12.49
9.63
0.9395
0.1541
w/o DGA
12.11
8.36
0.9413
0.1523
Full Model
12.06
8.66
0.9423
0.1519
Table 2: Quantitative results of ablation study. Red and blue highlight the best and second-best results, respectively.
Figure 4: Qualitative ablation results. Green and red boxes highlight successful recoveries by the Full Model and failures of the ablated variants, respectively.
High-quality texture generation is essential for creating realistic and production-ready 3D assets. Recent multi-view diffusion methods have shown promising results for image-guided 3D texturing, but they are typically constrained to low operating resolutions such as 512 or 768, making it difficult to preserve high-frequency details from high-resolution reference images. Scaling this paradigm to 2048 resolution is computationally prohibitive, as the unified multi-view sequence exceeds 212K tokens and incurs excessive memory and latency. In this paper, we present UltraTex, an efficient end-to-end framework for high-resolution multi-view diffusion-based 3D texturing. Our key observation is that object-centric multi-view renderings contain two major sources of redundancy: background-induced sequence redundancy and sparse token interactions within the foreground. To address them, we introduce Background Token Dropping, which removes background tokens before the DiT backbone, and Block-Sparse Attention, which reduces attention computation over the retained foreground sequence. To enable efficient foreground-only inference while avoiding reconstruction artifacts, we further design Foreground-Aware VAE Decoding to ensure the quality of the final high-resolution views. To satisfy the demanding data requirements of 2K-resolution multi-view diffusion training, we construct G-buffer TexVerse, a large-scale, ultra-high-resolution multi-view rendering dataset covering over 268,000 3D assets. Extensive experiments show that UltraTex generates visually faithful textures with rich fine-grained details, while substantially improving efficiency, achieving 20.6×--91.1× training speedup and 22.3×--74.6× end-to-end inference speedup over the baseline on common samples in our dataset. Code and data is at https://yiboz2001.github.io/UltraTex.
Yibo Zhang, Ze Yuan, Nan Cao +4
Jilin University, Changchun, China · Shanghai Innovation Institute, Shanghai, China · The University of Hong Kong, Hong Kong, China +3
Although recent advances have improved the quality of 3D texture generation, existing methods still struggle with incomplete texture coverage, cross-view inconsistency, and misalignment between geometry and texture. To address these limitations, we propose Hitem3D 2.0, a multi-view guided native 3D texture generation framework that enhances texture quality through the integration of 2D multi-view generation priors and native 3D texture representations. Hitem3D 2.0 comprises two key components: a multi-view synthesis framework and a native 3D texture generation model. The multi-view generation is built upon a pre-trained image editing backbone and incorporates plug-and-play modules that explicitly promote geometric alignment, cross-view consistency, and illumination uniformity, thereby enabling the synthesis of high-fidelity multi-view images. Conditioned on the generated views and 3D geometry, the native 3D texture generation model projects multi-view textures onto 3D surfaces while plausibly completing textures in unseen regions. Through the integration of multi-view consistency constraints with native 3D texture modeling, Hitem3D 2.0 significantly improves texture completeness, cross-view coherence, and geometric alignment. Experimental results demonstrate that Hitem3D 2.0 outperforms existing methods in terms of texture detail, fidelity, consistency, coherence, and alignment.
Texture map production is an important part of 3D modeling and determines the rendering quality. Recently, diffusion-based methods have opened a new way for texture generation. However, restricted control flexibility and limited prompt modalities may prevent creators from producing desired results. Furthermore, inconsistencies between generated multi-view images often lead to poor texture generation quality. To address these issues, we introduce FlexPainter, a novel texture generation pipeline that enables flexible multi-modal conditional guidance and achieves highly consistent texture generation. A shared conditional embedding space is constructed to perform flexible aggregation between different input modalities. Utilizing such embedding space, we present an image-based CFG method to decompose structural and style information, achieving reference image-based stylization. Leveraging the 3D knowledge within the image diffusion prior, we first generate multi-view images simultaneously using a grid representation to enhance global understanding. Meanwhile, we propose a view synchronization and adaptive weighting module during diffusion sampling to further ensure local consistency. Finally, a 3D-aware texture completion model combined with a texture enhancement model is used to generate seamless, high-resolution texture maps. Comprehensive experiments demonstrate that our framework significantly outperforms state-of-the-art methods in both flexibility and generation quality.