cs.SENov 1, 2026

Phase-wise MLLM Tuning for Multi-framework WebUI Code Generation

Authors: Haoran Ma, Linxiao Li, Chenyue Wang, Haochen Sui, Jiechao Gao

Organizations: Harvard University · The University of Sydney · University of Michigan · Stanford University

Abstract

Multimodal large language models (MLLMs) achieve strong performance in translating WebUI screenshots into HTML/CSS. However, when they faced multiple frameworks (React/Vue/Angular), they often suffer from negative transfer that leads to compilation failures. These failures commonly stem from mixing framework specific syntax and violating framework constraints. This paper studies supervised fine-tuning for multi-framework WebUI code generation and proposes a phase-wise MLLM tuning method driven by compatibility and heterogeneity signals across frameworks. We first apply a normalization mapping that preserves each framework's native syntax while suppressing noise from variable naming and literal content. We then estimate cross framework heterogeneity and compatibility offline, and automatically derive training groups and their ordering by maximizing a phased objective. Finally, we perform phase-wise adapter tuning to reduce cross framework interference. Experiments on multiple benchmarks show that our proposed method improves both generation quality and compilation success rate compared with baselines.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. MulFCoder: Framework-conditioned Multi-agent for MLLM-based Multi-framework Front-end Code Generation

    Oct 25, 2026Jie Wu, Haoran Ma, Shisong Tang +3Code GenerationImage-to-Code Generation

  2. Toward Executable Multi-framework Front-end Code Generation with Self-Correction

    Nov 1, 2026Linxiao Li, Haoran Ma, Chenyue Wang +3Code GenerationImage-to-Code Generation