cs.CVMar 12, 2026

WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-centric Image Editing

Authors: Hui Zhang, Juntao Liu, Zongkai Liu, Liqiang Niu, Fandong Meng, Zuxuan Wu, Yu-Gang Jiang

Organizations: Institute of Trustworthy Embodied AI, Fudan University · Shanghai Key Laboratory of Multimodal Embodied AI · Weixin AI, Tencent

Abstract

Instruction-based image editing aims to modify specific content within existing images according to user-provided instructions while preserving non-target regions. Beyond traditional object- and style-centric manipulation, text-centric image editing focuses on modifying, translating, or rearranging textual elements embedded within images. However, existing leading models often struggle to execute complex text editing precisely, frequently producing blurry or hallucinated characters. We attribute these failures primarily to the lack of specialized training paradigms tailored for text-centric editing, as well as the absence of large-scale datasets and standardized benchmarks necessary for a closed-loop training and evaluation system. To address these limitations, we present WeEdit, a systematic solution encompassing a scalable data construction pipeline, two benchmarks, and a tailored two-stage training strategy. Specifically, we propose a novel HTML-based automatic editing pipeline, which generates 330K training pairs covering diverse editing operations and 15 languages, accompanied by standardized bilingual and multilingual benchmarks for comprehensive evaluation. On the algorithmic side, we employ glyph-guided supervised fine-tuning to inject explicit spatial and content priors, followed by a multi-objective reinforcement learning stage to align generation with instruction adherence, text clarity, and background preservation. Extensive experiments demonstrate that WeEdit outperforms previous open-source models by a clear margin across diverse editing operations.

Figures & tables

Explore similar work

CardsList
  1. TextSculptor: Training and Benchmarking Scene Text Editing

    May 20, 2026Yiheng Lin, Siyu Jiao, Xiaohan Lan +12Synthetic Data AugmentationText-Guided Image Editing

  2. VibeEdit: Image Editing with Canvas Instructions

    Oct 8, 2026Jinjing Zhao, Fangyun Wei, Yitong Wang +9Image EditingText-Guided Image Editing

  3. Text-Vision Co-Instructed Image Editing

    Jun 15, 2026Chenxi Xie, Yuhui Wu, Qiaosi Yi +1Text-Guided Image EditingImage Editing