Mobile-VTON: High-Fidelity On-Device Virtual Try-On
Organizations: University of Sydney · MBZUAI · University of Melbourne · Google
Abstract
Virtual try-on (VTON) has recently achieved impressive visual fidelity, but most existing systems require uploading personal photos to cloud-based GPUs, raising privacy concerns and limiting on-device deployment. To address this, we present Mobile-VTON, a high-quality, privacy-preserving framework that enables fully offline virtual try-on on commodity mobile devices using only a single user image and a garment image. Mobile-VTON introduces a modular TeacherNet-GarmentNet-TryonNet (TGT) architecture that integrates knowledge distillation, garment-conditioned generation, and garment alignment into a unified pipeline optimized for on-device efficiency. Within this framework, we propose a Feature-Guided Adversarial (FGA) Distillation strategy that combines teacher supervision with adversarial learning to better match real-world image distributions. GarmentNet is trained with a trajectory-consistency loss to preserve garment semantics across diffusion steps, while TryonNet uses latent concatenation and lightweight cross-modal conditioning to enable robust garment-to-person alignment without large-scale pretraining. By combining these components, Mobile-VTON achieves high-fidelity generation with low computational overhead. Experiments on VITON-HD and DressCode at 1024 x 768 show that it matches or outperforms strong server-based baselines while running entirely offline. These results demonstrate that high-quality VTON is not only feasible but also practical on-device, offering a secure solution for real-world applications. Code and project page are available at https://zhenchenwan.github.io/Mobile-VTON/.
Figures & tables
| Dataset | VITON-HD | DressCode Upper-body | Memory | On | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Method | LPIPS↓ | SSIM↑ | CLIP-I↑ | FID↓ UN | KID↓ UN | LPIPS↓ | SSIM↑ | CLIP-I↑ | FID↓ UN | KID↓ UN | Usage(G) | Mobile | ||
| Server-side Mask-based methods | ||||||||||||||
| SD-VITON [ 41 ] | 0.104 | 0.890 | 0.831 | 9.857 | 1.450 | 0.201 | 0.858 | 0.555 | 50.755 | 38.331 | - | ✗ | ||
| LaDI-VTON [ 35 ] | 0.166 | 0.873 | 0.819 | 9.386 | 1.590 | 0.157 | 0.905 | 0.773 | 22.689 | 2.580 | 7.63 | ✗ | ||
| StableVITON [ 23 ] | 0.142 | 0.875 | 0.838 | 9.371 | 1.990 | 0.113 | 0.910 | 0.844 | 19.712 | 2.149 | 13.84 | ✗ | ||
| IDM–VTON [ 4 ] | 0.102 | 0.868 | 0.875 | 9.156 | 1.242 | 0.065 | 0.920 | 0.870 | 11.852 | 1.181 | 18.47 | ✗ | ||
| Dataset | VITON-HD In-the-wild | ||||
|---|---|---|---|---|---|
| Method | LPIPS↓ | SSIM↑ | CLIP-I↑ | FID↓ UN | KID↓ UN |
| Server-side Mask-based method | |||||
| SD-VITON | 0.174 | 0.857 | 0.804 | 17.151 | 5.326 |
| StableVITON | 0.201 | 0.863 | 0.848 | 12.983 | 2.804 |
| IDM–VTON | 0.137 | 0.832 | 0.931 | 11.373 | 1.133 |
| Server-side Mask-free method | |||||
| TCG | LC | LPIPS↓ | SSIM↑ | CLIP-I↑ | FID↓ UN | KID↓ UN |
|---|---|---|---|---|---|---|
| ✗ | ✗ | 0.119 | 0.874 | 0.798 | 11.231 | 3.136 |
| ✓ | ✗ | 0.111 | 0.879 | 0.805 | 10.814 | 2.744 |
| ✓ | ✓ | 0.088 | 0.893 | 0.833 | 10.211 | 2.023 |
| Method | LPIPS↓ | SSIM↑ | CLIP-I↑ | FID↓ (UN) | KID↓ (UN) |
|---|---|---|---|---|---|
| Ours | 0.088 | 0.893 | 0.833 | 10.211 | 2.023 |
| w/o TCG | 0.108 | 0.881 | 0.804 | 10.914 | 2.939 |
| w/o LA | 0.168 | 0.827 | 0.704 | 13.652 | 5.091 |
| w/o Distill | 0.354 | 0.788 | 0.438 | 113.59 | 106.66 |
| Dataset | LPIPS↓ | SSIM↑ | CLIP-I↑ | FID↓ UN | KID↓ UN |
|---|---|---|---|---|---|
| VITON-HD | |||||
| VITON-HD | 0.102 | 0.877 | 0.818 | 10.558 | 2.685 |
| DressCode | 0.088 | 0.893 | 0.833 | 10.211 | 2.023 |
| DressCode Upper-body | |||||
| VITON-HD | 0.058 | 0.932 | 0.832 | 13.527 | 2.473 |
| DressCode | 0.053 | 0.935 | 0.845 | 12.775 | 1.917 |
Virtual Try-On
Virtual try-on generates images or videos showing people wearing selected garments while preserving appearance, fit, pose, and identity.
See all 55 papers