FlexTry-On: A Time-Efficient Framework for Multi-Scenario Virtual Try-on

Phuong Dam; Quyen Nguyen Duc; Son Hoang Minh; Daeyoung Kim

cs.CVOct 29, 2026

FlexTry-On: A Time-Efficient Framework for Multi-Scenario Virtual Try-on

Authors: Phuong Dam, Quyen Nguyen Duc, Son Hoang Minh, Daeyoung Kim

Organizations: Korea Advanced Institute of Science and Technology (KAIST)

Abstract

Virtual try-on has achieved remarkable progress in recent years, yet most existing methods are designed for a specific scenario, such as cloth-to-person or person-to-person try-on, and often require separate conditioning strategies and processing pipelines for different settings. We present FlexTry-On, a unified and time-efficient diffusion-based framework for diverse virtual try-on scenarios, including cloth-to-person, person-to-person, cross-domain, and in-the-wild settings. FlexTry-On adopts a common conditioning formulation, where a text-aware condition extraction strategy converts heterogeneous garment sources into a unified representation, and a dual-conditioning diffusion transformer jointly models garment appearance and person identity. Extensive experiments demonstrate competitive performance on both cloth-to-person and person-to-person benchmarks while maintaining fast inference. Moreover, the same framework can be directly applied to unseen cross-domain scenarios without requiring separate architectures or scenario-specific processing pipelines. These results highlight the potential of unified and efficient virtual try-on frameworks as a practical step toward more flexible and widely applicable virtual try-on systems.

Figures & tables

Figure 2: Comparison of FlexTry-On with other diffusion-based methods using the VITON-HD dataset (C2P). Lower values indicate better performance for both FID and inference speed. FlexTry-On supports all evaluated virtual try-on scenarios within a unified framework, as summarized in Tab. 1 .

Figure 3: Overview of the FlexTry-On framework for IVTON. Multiple reference inputs, including pose keypoints $J_{p}$ and DensePose maps $I_{dp}$ , are encoded into latent representations and concatenated as inputs to the diffusion process. The TASM module receives a latent image with text conditions embedded via the CLIP-Text Encoder [ 39 ] from SD 2.0. The TASM outputs both the latent representations of the target RGB regions and their corresponding masks. In TASM, we illustrate the latent representation of the RGB input cloth $P_{ic}$ and its associated mask $M_{ic}$ . The garment-agnostic mask $M_{ga}$ is obtained by merging masks under different text conditions according to Eq. 2

Figure 4: Overview of the Dual-DiT Tryon Module (DDTM). The DDTM follows a DiT-based architecture [ 35 ] with cross-attention to integrate person and garment information. During training, different conditioning strategies are adopted for C2P and P2P settings. For clarity, patchification and positional embeddings are omitted.

	Inf. Time	VITON-HD			Dress Code - Upper			Support IVTON Tasks
Method	(s) $\downarrow$	FID (pair/unp.) $\downarrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FID (pair/unp.) $\downarrow$	SSIM $\uparrow$	LPIPS $\downarrow$	C2P	P2P	Cross C2P	Cross P2P
MDNM $\dagger$ [IJCAI 2025] [ 9 ]	-	-/9.38	0.872	0.086	-	-	-	✓	✗	✗	✗
APM $\dagger$ [ICCV 2025] [ 10 ]	-	-/9.38	0.901	0.079	-	-	-	✓	✗	✗	✗
M&MVTO [CVPR 2024] [ 48 ]	-	-	-	-	-	-	-	✓	✓	✗	✗
OmniVTON $\dagger$ [ICCV 2025] [ 44 ]	140	7.76/9.62	0.858	0.098	-	-	-	✓	✓	✗	✗
LaDI-VTON [ACM 2023] [ 32 ]	2.1	9.63/12.31	0.858	0.098	10.45/14.05	0.927	0.062	✓	✗	✗	✗

Table 1: Quantitative comparison on VITON-HD and DressCode Upper in C2P. Inf. Time denotes method-specific inference time; shared pose/DensePose preprocessing is excluded, with exceptions detailed in Appendix E . FlexTry-On is trained only on VITON-HD and DressCode, whereas FlexTry-On* uses the full uncurated C2P–P2P corpus. Best/second-best results are bold / underlined . Cross C2P/P2P denote cross-domain variants. DressCode Lower/Dresses results are in Appendix B .

\dagger

: paper-reported.

Figure 5: An example of mislabeled pairs in the IMAGDress dataset [ 40 ] . The black arrow indicates the correct pairing, whereas the dataset incorrectly associates each person’s image with all garment images, as shown by red dashed arrows.

Figure 6: Cross-domain IVTON results on DressCode [ 33 ] . Existing methods [ 4 , 3 , 19 , 16 , 8 , 22 , 23 , 32 ] typically rely on category-specific human parsing [ 28 ] or human-centric segmentation models such as Sapiens [ 21 ] (e.g., Voost [ 26 ] ), which become ambiguous when defining editable regions in cross-domain scenarios. In contrast, our framework employs TASM for text-conditioned segmentation, enabling task-aware mask generation across different garment categories and supporting cross-domain IVTON. The TASM module operates in latent space conditioned on text; masks are interpolated for visualization purposes.

Figure 7: Qualitative comparison with state-of-the-art methods on VITON-HD [ 2 ] . All methods are evaluated on the same test inputs using their publicly released checkpoints when available. Conventional human parsing [ 28 ] may introduce inaccurate garment boundaries and incomplete editable regions, which can affect downstream virtual try-on performance. In contrast, TASM generates task-aware masks specifically designed for virtual try-on conditioning, resulting in improved garment preservation and reduced visual artifacts. Note that the TASM module operates in latent space conditioned on text; masks are interpolated for visualization purposes.

Figure 8: Qualitative results in C2P and P2P IVTON setting. The person and clothes images are collected from the Internet. FlexTry-On* is our proposed method trained on merged uncurated datasets. ITA-MDT* denotes the fine-tuned ITA-MDT with segmented clothing, trained on our dataset (the full, uncurated dataset).

	Seg Param	Time / try-on		VITON-HD			DressCode - Upper
Method	(M Param) $\downarrow$	Seg. (s) $\downarrow$	Denoising (s) $\downarrow$	FID (pair/unp.) $\downarrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FID (pair/unp.) $\downarrow$	SSIM $\uparrow$	LPIPS $\downarrow$
DDTM (Baseline)	65	0.1	1.1	6.21/9.64	0.857	0.091	8.89/12.84	0.911	0.061
Baseline + TASM	130	0.1	1.1	5.83 / 9.02	0.861	0.085	7.12 / 11.11	0.925	0.042
Baseline + TASM + $\mathcal{L}_{style}$	130	0.1	1.1	5.51 / 8.97	0.861	0.086	7.15 / 11.07	0.927	0.042
Baseline + G-SAM	136	19.0	1.1	7.15/10.27	0.841	0.107	-	-	-
DDTM* + TASM	130	0.1	1.1	6.80/9.42	0.857	0.093	8.22/11.92	0.923	0.048

Table 2: Ablation study quantitative results on VITON-HD [ 2 ] and DressCode [ 33 ] Upper in C2P. DDTM denotes the DDTM trained only on VITON-HD and DressCode in C2P, whereas DDTM* denotes training on the full uncurated combined corpus. Best/second-best results are bold / underlined . Times are measured for one batch-size-1 try-on. For that image, each segmenter evaluates all 10 segmentation-class conditions listed in Appendix D . TASM batches them in 0.1 s, whereas G-SAM runs GroundingDINO followed by SAM sequentially for each condition (1.9 s per class; 19.0 s total). Denoising takes 1.1 s per try-on.

Figure 9: Qualitative StreetTryOn results [ 6 ] . * marks our unsuccessful reproduction.

	Shop2Street	Model2Model	Model2Street	Street2Street
Method	FID↓	FID↓	FID↓	FID↓
CAT-DM $\dagger$ [CVPR 2024] [ 45 ]	37.48	-	-	-
IDM-VTON $\dagger$ [ECCV 2024] [ 3 ]	42.28	-	-	-
OmniVTON $\dagger$ [ICCV 2025] [ 44 ]	33.92	8.98	33.45	23.47
FlexTry-On (Ours)	32.51	10.06	33.07	32.6

Table 3: Results on Street Try-On.

\dagger

: OmniVTON [ 44 ] reported the result

Figure 10: Qualitative ablation on VITON-HD [ 2 ] under curated and full noisy-data training. DDTM and DDTM* denote the two settings, respectively; “Use G-SAM” replaces TASM with Grounded-SAM under matched-text conditions.

Figure 11: Qualitative result on VITON-HD, P2P setting. Model*: retrained model.

	Inf. Time	VITON-HD P2P			VITON-HD C2P
Method	(s) $\downarrow$	FID (pair/unp.) $\downarrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FID (pair/unp.) $\downarrow$	SSIM $\uparrow$	LPIPS $\downarrow$
Stable VITON* [CVPR 2024] [ 22 ]	6.8	7.01 / 10.35	0.876	0.098	6.93 / 9.53	0.856	0.091
CAT-DM* [CVPR 2024] [ 45 ]	3.5	10.71/12.44	0.832	0.153	8.72/11.32	0.843	0.124
ITA-MDT* [CVPR 2025] [ 19 ]	3.2	8.02/11.91	0.881	0.078	7.99/11.34	0.876	0.094
FlexTry-On* (Ours)	1.2	4.01 / 10.06	0.905	0.044	6.34 / 9.22	0.859	0.093

Table 4: P2P and C2P results on VITON-HD. ∗ denotes retraining on our full C2P–P2P corpus. Best and second-best results are bold and underlined .

	VITON-HD			Dress Code - Upper
Method	FID (pair/unp.) ↓	SSIM ↑	LPIPS ↓	FID (pair/unp.)↓	SSIM ↑	LPIPS ↓
DDTM + TASM-MaskOnly + $\mathcal{L}_{style}$	5.98/9.08	0.860	0.086	7.20/11.08	0.924	0.043
DDTM + TASM + $\mathcal{L}_{style}$	5.51 / 8.97	0.861	0.086	7.15 / 11.07	0.927	0.042

Table A : Quantitative results of diffusion-based virtual try-on methods on VITON-HD and DressCode upper-body test sets. We report both paired and unpaired FID. TASM-MaskOnly denotes the TASM with output that is the mask only. DDTM refers to the training of the Dual-DiT Tryon Module with only VITON-HD [ 2 ] and Dresscode [ 33 ] in the C2P tasks. The better performance for each metric is bold .

Appendix figures & tables12 assets

Supplementary material from the paper’s appendix.

Appendix

Figure A : Overview of the Text-aware segmentation Module for FlexTry-On Framework and its variant. The TASM module receives a latent image with text conditions embedded via the CLIP-Text Encoder from Stable Diffusion 2.0 [ 39 ] . The module outputs both the latent representations of the target RGB regions and their corresponding masks. In TASM, we illustrate the latent representation of the RGB input cloth $P_{ic}$ and its associated mask $M_{ic}$ . While in TASM-MaskOnly, the output is only the mask $M_{ic}$ .

Figure B : Ablation study results on VITON-HD [ 2 ] to evaluate the effectiveness of the TASM module architecture design in the clean datasets. The DDTM denotes the Dual-DiT Tryon Module, which is trained only on the clean dataset (VITON-HD [ 2 ] and DressCode [ 33 ] ).

Dataset	Resolutions	C2P	P2P	# of images
VITON-HD [ 2 ]	1024 x 768	✓	✗	11 647
DressCode [ 33 ]	1024 x 768	✓	✗	53 792
DeepFashion [ 31 ]	Varies	✗	✓	52 712
IMAGDress [ 40 ]	Varies	✓	✓	324 857
LRVS-Fashion [ 27 ]	Varies	✓	✓	500 000

Appendix

Table C : IVTON Data Statistic

Figure C : Representative Street2Street failure cases on Street Try-On [ 6 ] . FlexTry-On may preserve the garment’s appearance while failing to fully reproduce its fine-grained structure.

Figure D : Additional qualitative results on heterogeneous subjects with varied appearances, body shapes, poses, framing, and backgrounds. All outputs are generated using the same FlexTry-On* checkpoint without additional adaptation.

Figure E : Qualitative results on DressCode [ 33 ] Lower. Our model (Ours) here is trained only with VITON-HD [ 2 ] and DressCode [ 33 ] .

Figure F : Qualitative results on DressCode [ 33 ] Dresses. Our model (Ours) here is trained only with VITON-HD [ 2 ] and DressCode [ 33 ] .

Figure G : Qualitative results on Cross Domain (Upper-Lower to Dress) with C2P and P2P Setting. The dresses are taken from DressCode [ 33 ] , and the person’s images are taken from the Internet. FlexTry-On* refers to our training on the combined uncurated datasets. ITA-MDT* [ 19 ] denotes the fine-tuned ITA-MDT with segmented clothing, trained on our dataset.

Figure H : Qualitative results on Cross Domain (Dress to Upper) with C2P Setting. The Upper Garment and person’s image are taken from DressCode [ 33 ] . ITA-MDT* [ 19 ] denotes the fine-tuned ITA-MDT with segmented clothing, trained on our dataset. FlexTry-On* refers to training on the combined uncurated datasets. Existing methods [ 4 , 3 , 19 , 16 , 8 , 22 , 23 , 32 ] based on conventional human parsing [ 28 ] are limited in supporting flexible masking for cross-domain try-on. In this experiment, we either masked all clothing or used full-body clothing masks for ITA-MDT and CatVTON.

Figure I : Qualitative results on Cross Domain (Dress to Upper) with P2P Setting. The Upper Garment and person’s image are taken from DressCode [ 33 ] . ITA-MDT* [ 19 ] denotes the fine-tuned ITA-MDT with segmented clothing, trained on our dataset. FlexTry-On* refers to training on the combined uncurated datasets. Existing methods [ 4 , 3 , 19 , 16 , 8 , 22 , 23 , 32 ] typically rely on category-specific masks derived from conventional human parsing pipelines [ 28 ] . In cross-domain scenarios, however, the editable regions cannot be uniquely determined from predefined garment categories. For ITA-MDT and CatVTON, we therefore evaluate two representative masking strategies: masking all clothing regions and using full-body clothing masks. In contrast, TASM generates task-aware masks conditioned on the target garment description.

Figure J : Qualitative results on Cross Domain (Dress to Lower) with C2P Setting. The Lower Garment and person’s image are taken from DressCode [ 33 ] . ITA-MDT* [ 19 ] denotes the fine-tuned ITA-MDT with segmented clothing, trained on our dataset. FlexTry-On* refers to training on the combined uncurated datasets. Existing methods [ 4 , 3 , 19 , 16 , 8 , 22 , 23 , 32 ] typically rely on category-specific masks derived from conventional human parsing pipelines [ 28 ] . In cross-domain scenarios, however, the editable regions cannot be uniquely determined from predefined garment categories. For ITA-MDT and CatVTON, we therefore evaluate two representative masking strategies: masking all clothing regions and using full-body clothing masks. In contrast, TASM generates task-aware masks conditioned on the target garment description.

Figure K : Qualitative results on Cross Domain (Dress to Lower) with P2P Setting. The Lower Garment and person’s image are taken from DressCode [ 33 ] . ITA-MDT* [ 19 ] denotes the fine-tuned ITA-MDT with segmented clothing, trained on our dataset. FlexTry-On* refers to training on the combined uncurated datasets. Existing methods [ 4 , 3 , 19 , 16 , 8 , 22 , 23 , 32 ] typically rely on category-specific masks derived from conventional human parsing pipelines [ 28 ] . In cross-domain scenarios, however, the editable regions cannot be uniquely determined from predefined garment categories. For ITA-MDT and CatVTON, we therefore evaluate two representative masking strategies: masking all clothing regions and using full-body clothing masks. In contrast, TASM generates task-aware masks conditioned on the target garment description.

Virtual Try-On

Virtual try-on generates images or videos showing people wearing selected garments while preserving appearance, fit, pose, and identity.

See all 56 papers

OmniVTON++: Training-Free Universal Virtual Try-On with Principal Pose Guidance
Feb 16, 2026Zhaotong Yang, Yong Du, Shengfeng He +5Virtual Try-On
School of Computer Science and Technology, Ocean University of China, Qingdao, China · School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China · Sanya Oceanographic Institution, Ocean University of China, Sanya, China +2
OmniTryOn: Video Try-On Anything at Once!
Jun 7, 2026Changliang Xia, Chengyou Jia, Minnan Luo +3Virtual Try-On Temporal Consistency in Video Generation
Xi’an Jiaotong University Xi’an, China
Oxygen-TryOn: Fashion-Native Foundation Model for Any-item Virtual Try-On
Jul 23, 2026Yong Liu, Xiaolong Fu, Zihang Xu +10Virtual Try-On Conditional Image Generation
Oxygen AIGC Group & Joy Future Academy, JD

Feb 16, 2026J/K move · Enter open · S save

OmniVTON++: Training-Free Universal Virtual Try-On with Principal Pose Guidance

Zhaotong Yang, Yong Du, Shengfeng He, Yuhui Li+4

School of Computer Science and Technology, Ocean University of China, Qingdao, China · School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China · Sanya Oceanographic Institution, Ocean University of China, Sanya, China+2

Virtual Try-On

Open paper AskPDF arXiv

Image-based Virtual Try-On (VTON) concerns the synthesis of realistic person imagery through garment re-rendering under human pose and body constraints. In practice, however, existing approaches are typically optimized for specific data conditions, making their deployment reliant on retraining and limiting their generalization as a unified solution. We present OmniVTON++, a training-free VTON framework designed for universal applicability. It addresses the intertwined challenges of garment alignment, human structural coherence, and boundary continuity by coordinating Structured Garment Morphing for correspondence-driven garment adaptation, Principal Pose Guidance for step-wise structural regulation during diffusion sampling, and Continuous Boundary Stitching for boundary-aware refinement, forming a cohesive pipeline without task-specific retraining. Experimental results demonstrate that OmniVTON++ achieves state-of-the-art performance across diverse generalization settings, including cross-dataset and cross-garment-type evaluations, while reliably operating across scenarios and diffusion backbones within a single formulation. In addition to single-garment, single-human cases, the framework supports multi-garment, multi-human, and anime character virtual try-on, expanding the scope of virtual try-on applications. The code is available at https://github.com/Jerome-Young/OmniVTON-PlusPlus.

Abstract

Virtual Try-On

Explore similar work

OmniVTON++: Training-Free Universal Virtual Try-On with Principal Pose Guidance

OmniTryOn: Video Try-On Anything at Once!

Oxygen-TryOn: Fashion-Native Foundation Model for Any-item Virtual Try-On