CORAL: Correspondence Alignment for Improved Virtual Try-On
Organizations: KAIST AI · NC AI Co., Ltd.
Abstract
Existing methods for Virtual Try-On (VTON) often struggle to preserve fine garment details, especially in unpaired settings where accurate person-garment correspondence is required. These methods do not explicitly enforce person-garment alignment and fail to explain how correspondence emerges within Diffusion Transformers (DiTs). In this paper, we first analyze full 3D attention in DiT-based architecture and reveal that the person-garment correspondence critically depends on precise person-garment query-key matching within the full 3D attention. Building on this insight, we then introduce CORrespondence ALignment (CORAL), a DiT-based framework that explicitly aligns query-key matching with robust external correspondences. CORAL integrates two complementary components: a correspondence distillation loss that aligns reliable matches with person-garment attention, and an entropy minimization loss that sharpens the attention distribution. We further propose a VLM-based evaluation protocol to better reflect human preference. CORAL consistently improves over the baseline, enhancing both global shape transfer and local detail preservation. Extensive ablations validate our design choices.
Figures & tables
| Methods | Paired | Unpaired | ||||
|---|---|---|---|---|---|---|
| SSIM | LPIPS | FID | KID | FID | KID | |
| GPVTON ( Xie et al., 2023 ) | 0.878 | 0.067 | 8.938 | 4.257 | 11.993 | 4.570 |
| StableVTION ( Kim et al., 2023 ) | 0.888 | 0.073 | 8.233 | 0.490 | 9.026 | 3.029 |
| OOTDiffusion ( Kim et al., 2023 ) | 0.842 | 0.087 | 6.619 | 0.845 | 9.938 | 1.302 |
| IDM-VTON ( Choi et al., 2024 ) | 0.866 | 0.062 | 6.009 | 0.838 | 9.198 | 1.203 |
| CatVTON ( Chong et al., 2025 ) | 0.874 | 0.058 | 5.458 | 0.439 | 9.076 | 1.184 |
| Methods | Paired | Unpaired | ||||
|---|---|---|---|---|---|---|
| SSIM | LPIPS | FID | KID | FID | KID | |
| GPVTON ( Xie et al., 2023 ) | 0.918 | 0.068 | 8.423 | 2.439 | 9.144 | 3.936 |
| OOTDiffusion ( Xu et al., 2024 ) | 0.886 | 0.069 | 5.082 | 1.377 | 9.276 | 4.009 |
| IDM-VTON ( Choi et al., 2024 ) | 0.904 | 0.052 | 3.472 | 0.882 | 5.343 | 1.321 |
| CatVTON ( Chong et al., 2025 ) | 0.875 | 0.075 | 5.384 | 1.903 | 7.998 | 3.242 |
| Any2AnyTryOn ∗ ( Guo et al., 2025 ) | - | - | - | - | 5.573 | 1.458 |
| Methods | Paired | Unpaired | ||||
|---|---|---|---|---|---|---|
| SSIM | LPIPS | FID | KID | FID | KID | |
| OOTDiffusion ( Kim et al., 2023 ) | 0.804 | 0.130 | 99.492 | 15.592 | 87.818 | 15.467 |
| IDM-VTON ( Choi et al., 2024 ) | 0.844 | 0.111 | 64.250 | 1.911 | 63.638 | 3.600 |
| CatVTON ( Chong et al., 2025 ) | 0.743 | 0.147 | 81.722 | 10.979 | 76.417 | 11.207 |
| Any2AnyTryOn ∗ ( Guo et al., 2025 ) | - | - | - | - | 49.728 | 0.421 |
| CORAL (w/o ) | 0.877 | 0.078 | 44.117 | 0.015 | 56.644 | 1.202 |
| Train/Test | VITON-HD/VITON-HD | DressCode/DressCode | DressCode/PPR10K | ||||||
|---|---|---|---|---|---|---|---|---|---|
| GTC | TAC | FPC | GTC | TAC | FPC | GTC | TAC | FPC | |
| GPVTON ∗ ( Xie et al., 2023 ) | 3.93 | 4.28 | 4.17 | 3.19 | 3.31 | 3.14 | - | - | - |
| OOTDiffusion ( Xu et al., 2024 ) | 3.97 | 4.34 | 4.12 | 3.25 | 3.24 | 3.45 | 1.04 | 2.06 | 1.57 |
| IDM-VTON ( Choi et al., 2024 ) | 3.96 | 4.40 | 4.25 | 3.25 | 3.28 | 3.61 | 1.72 | 2.21 | 2.37 |
| CatVTON ( Chong et al., 2025 ) | 3.82 | 4.20 | 4.06 | 3.07 | 3.22 | 3.53 | 1.05 | 2.00 | 2.01 |
| Any2AnyTryOn ( Guo et al., 2025 ) | 3.81 | 4.27 | 4.19 | 2.99 | 3.28 | 3.36 | 1.92 | 2.45 | 2.48 |
| Paired | Unpaired | |||||||
|---|---|---|---|---|---|---|---|---|
| SSIM | LPIPS | FID | KID | FID | KID | |||
| (I) | ✗ | ✗ | 0.889 | 0.055 | 5.543 | 0.870 | 9.641 | 1.423 |
| (II) | ✗ | ✓ | 0.905 | 0.052 | 5.482 | 0.986 | 9.012 | 1.011 |
| (III) | ✓ | ✗ | 0.906 | 0.051 | 5.451 | 1.028 | 8.979 | 1.250 |
| (IV) | ✓ | ✓ | 0.907 | 0.048 | 4.962 | 0.565 | 8.763 | 0.880 |
Appendix figures & tables23 assets
Supplementary material from the paper’s appendix.
Appendix
| Methods | Paired | Unpaired | |||||
|---|---|---|---|---|---|---|---|
| SSIM | LPIPS | FID | KID | FID | KID | ||
| Pose Token Concat | ✗ | 0.889 | 0.055 | 5.543 | 0.870 | 9.641 | 1.323 |
| ✓ | 0.907 ( +2.02% ) | 0.048 ( +12.73% ) | 4.962 ( +10.48% ) | 0.565 ( +35.06% ) | 8.763 ( +9.11% ) | 0.880 ( +33.48% ) | |
| Pose Channel Concat | ✗ | 0.886 | 0.060 | 5.554 | 0.540 | 9.841 | 1.221 |
| ✓ | 0.888 ( +0.23% ) | 0.059 ( +1.67% ) | 5.372 ( +3.28% ) | 0.744 | 9.323 ( +5.26% ) | 1.077 ( +11.79% ) | |
| VITON-HD | DressCode | |||||||||||
| Paired | Unpaired | Paired | Unpaired | |||||||||
| SSIM | LPIPS | FID | KID | FID | KID | SSIM | LPIPS | FID | KID | FID | KID | |
| ✗ | 0.864 | 0.084 | 9.521 | 1.353 | 11.251 | 0.456 | 0.905 | 0.065 | 5.752 | 0.473 | 8.723 | 0.736 |
| ✓ | 0.871 ( +0.81% ) | 0.084 | 6.271 ( +34.1% ) | 0.563 ( +58.5% ) | 10.285 ( +8.62% ) | 0.315 ( +30.9% ) | 0.905 | 0.061 ( +6.15% ) | 5.221 ( +9.22% ) | 0.581 | 8.70 ( +0.23% ) | 0.193 ( +73.78% ) |
| Setting | GPU | GPU# (T/I) | Batch (T/I) | Speed (T/I) | VRAM (T/I) | |
|---|---|---|---|---|---|---|
| Token-concat | ✓ | B200 | 8 / 1 | 16 / 1 | 2.61 / 0.091 | 148 / 40 |
| Token-concat | ✗ | B200 | 8 / 1 | 16 / 1 | 3.01 / 0.105 | 148 / 40 |
| Channel-concat | ✓ | B200 | 8 / 1 | 16 / 1 | 3.41 / 0.119 | 148 / 40 |
| Channel-concat | ✗ | B200 | 8 / 1 | 16 / 1 | 3.92 / 0.137 | 148 / 40 |
| Efficient | ✓ | A100 | 1 / 1 | 1 / 1 | 0.16 / 0.025 | 48 / 33 |
| Efficient | ✗ | A100 | 1 / 1 | 1 / 1 | 0.18 / 0.025 | 48 / 33 |
| Methods | Paired | Unpaired | |||||
|---|---|---|---|---|---|---|---|
| SSIM | LPIPS | FID | KID | FID | KID | ||
| (I) | Baseline | 0.889 | 0.055 | 5.543 | 0.870 | 9.641 | 1.323 |
| (II) | (I) + Feature Alignment (REPA) ( Yu et al., 2025 ) | 0.885 ( ) | 0.087 ( ) | 13.718 ( ) | 2.103 ( ) | 15.621 ( ) | 3.684 ( ) |
| (III) | (I) + Query-Key Correspondence Alignment (Ours) | 0.907 ( +2.02% ) | 0.048 ( +12.73% ) | 4.962 ( +10.48% ) | 0.565 ( +35.06% ) | 8.763 ( +9.11% ) | 0.880 ( +33.48% ) |
| Methods | Paired | Unpaired | ||||
|---|---|---|---|---|---|---|
| SSIM | LPIPS | FID | KID | FID | KID | |
| CORAL (w/o ) | 0.877 | 0.078 | 44.117 | 0.015 | 56.644 | 1.202 |
| CORAL (w | 0.915 | 0.060 | 43.648 | 0.011 | 53.164 | 1.101 |
| CORAL-P2P (w | 0.923 | 0.050 | 38.590 | 0.008 | 52.047 | 1.1088 |
Virtual Try-On
Virtual try-on generates images or videos showing people wearing selected garments while preserving appearance, fit, pose, and identity.
See all 55 papers