Image Text Translation

Latest papers

8 papers0 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

TransAnyText: Translating Arbitrary Text in E-commerce Images via Structured Visual Generation
Aug 17, 2026Xiaoan Liu, Lichen Ma, Zipeng Guo +13Image Text Translation Image-to-Image Translation
Wuhan University · State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · The Hong Kong University of Science and Technology (Guangzhou)
UniTranslator: A Unified Multi-modal Framework for End-to-end In-Image Machine Translation
Jun 23, 2026Jiahao Lyu, Pei Fu, Zhenhang Li +6Image Text Translation Unified Multimodal Models
Institute of Information Engineering, Chinese Academy of Science, China · MiLM Plus, Xiaomi Inc, China · School of Cyber Security, University of Chinese Academy of Science, China +2
VaaWIT: Visual-Aware Adaptation of Large Language Models for Multilingual Web Image Translation
May 23, 2026Bo Li, Ronghao Chen, Ningyuan Deng +3Image Text Translation VLM Adaptation
Tsinghua University Baidu Inc. Beijing, China · QuantaAlpha Beijing, China · The Hong Kong University of Science and the Technology Hong Kong, China +1
MNAFT: modality neuron-aware fine-tuning of multimodal large language models for image translation
Apr 18, 2026Bo Li, Ningyuan Deng, Tianyu Dong +3Image Text Translation Fine-Tuning
School of Software, Tsinghua University, Beijing, China · Baidu Inc., Beijing, China · School of Information Resource Management, Renmin University of China,Beijing, China +2
MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translation
Mar 25, 2026Gengluo Li, Chengquan Zhang, Yupu Liang +9Image Text Translation Machine Translation
Institute of Information Engineering, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Tencent +3
IMTBench: A Multi-Scenario Cross-Modal Collaborative Evaluation Benchmark for In-Image Machine Translation
Mar 11, 2026Jiahao Lyu, Pei Fu, Zhenhang Li +7Image Text Translation Multimodal MT
Institute of Information Engineering, Chinese Academy of Science, China · MiLM Plus, Xiaomi Inc, China · School of Cyber Security, University of Chinese Academy of Science, China +3
ICDAR 2025 Competition on End-to-End Document Image Machine Translation Towards Complex Layouts
Mar 10, 2026Yaping Zhang, Yupu Liang, Zhiyang Zhang +5Image Text Translation Machine Translation
Institute of Automation, Chinese Academy of Sciences · University of Chinese Academy of Sciences, Beijing, China · Fanyu AI Laboratory, Zhongke Fanyu Technology Company Ltd., Beijing, China.
Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translation
Feb 25, 2026Junxin Lu, Tengfei Song, Zhanglin Wu +9Image Text Translation Machine Translation
School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China · Huawei Translation Services Center, China · School of Computer Science and Technology, East China Normal University, Shanghai 200062, China +1

Aug 17, 2026J/K move · Enter open · S save

TransAnyText: Translating Arbitrary Text in E-commerce Images via Structured Visual Generation

Xiaoan Liu, Lichen Ma, Zipeng Guo, Yu He+12

Wuhan University · State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · The Hong Kong University of Science and Technology (Guangzhou)

Image Text Translation Image-to-Image Translation

Open paper AskPDF arXiv

Cross-border e-commerce image translation is essential for global retail, where product images, banners, and detail pages need to be produced in different languages. Existing methods struggle to achieve accurate translation, faithful visual identity preservation, and easy-to-edit outputs, simultaneously. To address these challenges, we introduce TransAnyText, a structured visual code framework that reformulates image text translation as generating renderable HTML patches from source images and target languages. Our framework decouples semantic generation from pixel rendering: a vision-language model (VLM) handles visual understanding, cross-lingual translation, and structured visual generation, while a diffusion model performs background inpainting and pixel-level refinement, followed by deterministic rendering to synthesize the final image. Based on this formulation, we develop a three-stage post-training framework, where supervised fine-tuning (SFT) establishes the image-to-code mapping, privilege-gap weighted self-distillation (PWSD) improves the learning of style and layout tokens, and reinforcement learning with verifiable rewards (RLVR) further optimizes task-level performance. We further introduce TransAnyDataset and TransAnyBench, a multilingual dataset and benchmark for e-commerce image translation. Extensive experiments demonstrate competitive performance against cascaded pipelines, open-source end-to-end models, and closed-source image editing systems, providing an effective, controllable, and editable solution for cross-border e-commerce image translation.