TIMI: Training-Free Image-to-3D Multi-Instance Generation with Spatial Fidelity
Authors: Xiao Cai, Pengpeng Zeng, Ji Zhang, Heng Tao Shen, Jingkuan Song, Lianli Gao
Organizations: School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China · School of Computer Science and Technology, Tongji University, Shanghai, China · School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu, China · Shanghai Innovation Institute, Shanghai, China
Precise spatial fidelity in Image-to-3D multi-instance generation is critical for downstream real-world applications. Recent work attempts to address this by fine-tuning pre-trained Image-to-3D (I23D) models on multi-instance datasets, which incurs substantial training overhead and struggles to guarantee spatial fidelity. In fact, we observe that pre-trained I23D models already possess meaningful spatial priors, which remain underutilized as evidenced by instance entanglement issues. Motivated by this, we propose TIMI, a novel Training-free framework for Image-to-3D Multi-Instance generation that achieves high spatial fidelity. Specifically, we first introduce an Instance-aware Separation Guidance (ISG) module, which facilitates instance disentanglement during the early denoising stage. Next, to stabilize the guidance introduced by ISG, we devise a Spatial-stabilized Geometry-adaptive Update (SGU) module that promotes the preservation of the geometric characteristics of instances while maintaining their relative relationships. Extensive experiments demonstrate that our method yields better performance in terms of both global layout and distinct local instances compared to existing multi-instance methods, without requiring additional training and with faster inference speed.
Figures & tables
Figure 2: Overview of the TIMI framework. Given a single image and instance masks, TIMI guides a frozen pre-trained Image-to-3D diffusion model to generate multi-instance 3D outputs without additional training. (a) Instance-aware Separation Guidance applies instance-level constraints to early cross-attention layers to promote instance separation. (b) Spatial-stabilized Geometry-adaptive Update stabilizes inference-time guidance via geometry-adaptive gradient modulation to preserve overall spatial structure.
Figure 3: Qualitative Comparisons on Synthetic Data. Existing methods often produce inaccurate global layouts or fail to separate local instances. Our method preserves both global and local spatial fidelity, yielding well-disentangled instances.
Figure 4: Qualitative comparisons on real and stylized images. TIMI preserves stronger global and local spatial fidelity across real-world and stylized inputs.
Figure 5: Qualitative ablation study on the effectiveness of proposed components in TIMI. The results demonstrate that each module progressively enhances the layout alignment and instance distinctiveness, with the full method achieving the best spatial fidelity.
Method
Global Spatial Fidelity
Local Spatial Fidelity
Inference
LCD ↓
CD-S ↓
FS-S ↑
SSR ↑
CD-O ↓
FS-O ↑
Time ↓
Hunyuan3D 2.0
0.627
0.0492
0.450
0.697
0.0986
0.339
54.2s
DPA
0.649
0.0662
0.249
0.743
0.1620
0.124
783s
MIDI
0.634
0.0409
0.396
0.737
0.0760
0.312
90.1s
Ours
0.598
0.0424
0.458
0.809
0.0855
0.353
59.2s
Table 1: Quantitative comparison on synthetic data. Our method demonstrates superior global and local spatial fidelity while maintaining high inference efficiency.
Figure 6: User study. Our method demonstrates higher subjective preference compared to other methods.
Global Spatial Fidelity
Local Spatial Fidelity
LCD ↓
CD-S ↓
FS-S ↑
SSR ↑
CD-O ↓
FS-O ↑
w/o ISG, w/o SGU
0.627
0.0492
0.450
0.697
0.0986
0.339
w/ ISG, w/o SGU
0.623
0.0462
0.448
0.674
0.0864
0.351
w/ ISG, w/ SGU
0.598
0.0424
0.458
0.809
0.0855
0.353
Table 2: Quantitative ablation study on components in TIMI, progressively incorporating ISG and SGU effectively enhances the global and local spatial fidelity.
Figure 7: Qualitative results of ablation study on l in ISG. l≤4 achieves the best instance separation, while smaller or larger l leads to insufficient disentanglement or partial instance fusion.
l
Global Spatial Fidelity
Local Spatial Fidelity
LCD ↓
CD-S ↓
FS-S ↑
SSR ↑
CD-O ↓
FS-O ↑
1
0.600
0.0437
0.454
0.772
0.0896
0.372
2
0.615
0.0443
0.453
0.785
0.0874
0.352
3
0.554
0.0449
0.439
0.797
0.1007
0.360
4
0.598
0.0424
0.457
0.809
0.0855
0.353
5
0.594
0.0434
0.452
0.786
0.0938
0.359
Table 3: Quantitative results of ablation study on l in ISG.
Figure 8: Qualitative ablation study on t in ISG. t≤15 yields the best trade-off, while shorter or longer schedules cause insufficient disentanglement or geometric distortion.
t
Global Spatial Fidelity
Local Spatial Fidelity
LCD ↓
CD-S ↓
FS-S ↑
SSR ↑
CD-O ↓
FS-O ↑
5
0.554
0.0448
0.446
0.753
0.1041
0.353
10
0.563
0.0435
0.453
0.739
0.0859
0.383
15
0.598
0.0424
0.458
0.809
0.0855
0.353
20
0.603
0.0443
0.437
0.790
0.0991
0.335
25
0.552
0.0433
0.442
0.771
0.0976
0.342
Table 4: Quantitative results of ablation study on t in ISG.
Global Spatial Fidelity
Local Spatial Fidelity
LCD ↓
CD-S ↓
FS-S ↑
SSR ↑
CD-O ↓
FS-O ↑
w/o GM, w/o SR
0.623
0.0462
0.448
0.674
0.0864
0.351
w/ GM, w/o SR
0.597
0.0455
0.444
0.764
0.0882
0.368
w/ GM, w/ SR
0.598
0.0424
0.458
0.809
0.0855
0.353
Table 5: Quantitative ablation study on components in SGU, showing that GM and SR jointly enhance global and local spatial fidelity.
Figure 9: Qualitative results of ablation study on α in SGU. A moderate guidance strength ( α=0.1 ) yields the most balanced global layout consistency and instance-level geometric fidelity.
α
Global Spatial Fidelity
Local Spatial Fidelity
LCD ↓
CD-S ↓
FS-S ↑
SSR ↑
CD-O ↓
FS-O ↑
0.1
0.598
0.0424
0.458
0.809
0.0855
0.353
0.2
0.523
0.0439
0.446
0.780
0.1001
0.359
0.3
0.562
0.0449
0.441
0.796
0.0897
0.326
0.4
0.611
0.0428
0.436
0.766
0.0862
0.315
0.5
0.570
0.0414
0.429
0.750
0.0755
0.314
Table 6: Quantitative results of ablation study on α in SGU.
Figure 10: Qualitative results of ablation study on σ in SGU. σ=1.5 achieves the best balance between instance separation and geometric preservation, while smaller or larger σ leads to insufficient disentanglement or structural distortion.
σ
Global Spatial Fidelity
Local Spatial Fidelity
LCD ↓
CD-S ↓
FS-S ↑
SSR ↑
CD-O ↓
FS-O ↑
0.5
0.556
0.0439
0.444
0.782
0.1057
0.352
1.0
0.622
0.0442
0.448
0.768
0.0837
0.379
1.5
0.598
0.0424
0.458
0.809
0.0855
0.353
2.0
0.570
0.0428
0.444
0.784
0.0942
0.340
2.5
0.638
0.0436
0.440
0.782
0.1032
0.332
Table 7: Quantitative results of ablation study on σ in SGU.