Image Text Translation

Follow this topic Ask about this topic

Latest papers

10 papers1 paper in the last four weeks, with none the four weeks before. 0.0% of all new papers.

FlowTranslator: Training-Free In-Image Machine Translation with Flow-Based Editing
Nov 3, 2026Zhixian Li, Xingsong Ye, Yongkun Du +6Image Text Translation Image Editing
Institute of Trustworthy Embodied AI, Fudan University · Shanghai Key Laboratory of Multimodal Embodied AI
ImgMT: Wikipedia-based Dataset For Evaluating Text-in-Image Translation
Oct 26, 2026Šárka Uramová, Petar Kirilov Petrov, Josef Jon +2Image Text Translation Multimodal Dataset
Charles University, Faculty of Mathematics and Physics, Prague, Czech Republic
TransAnyText: Translating Arbitrary Text in E-commerce Images via Structured Visual Generation
Aug 17, 2026Xiaoan Liu, Lichen Ma, Zipeng Guo +13Image Text Translation Image-to-Image Translation
Wuhan University · State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · The Hong Kong University of Science and Technology (Guangzhou)
UniTranslator: A Unified Multi-modal Framework for End-to-end In-Image Machine Translation
Jun 23, 2026Jiahao Lyu, Pei Fu, Zhenhang Li +6Image Text Translation Unified Multimodal Models
Institute of Information Engineering, Chinese Academy of Science, China · MiLM Plus, Xiaomi Inc, China · School of Cyber Security, University of Chinese Academy of Science, China +2
VaaWIT: Visual-Aware Adaptation of Large Language Models for Multilingual Web Image Translation
May 23, 2026Bo Li, Ronghao Chen, Ningyuan Deng +3Image Text Translation VLM Adaptation
Tsinghua University Baidu Inc. Beijing, China · QuantaAlpha Beijing, China · The Hong Kong University of Science and the Technology Hong Kong, China +1
MNAFT: modality neuron-aware fine-tuning of multimodal large language models for image translation
Apr 18, 2026Bo Li, Ningyuan Deng, Tianyu Dong +3Image Text Translation Fine-Tuning
School of Software, Tsinghua University, Beijing, China · Baidu Inc., Beijing, China · School of Information Resource Management, Renmin University of China,Beijing, China +2
MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translation
Mar 25, 2026Gengluo Li, Chengquan Zhang, Yupu Liang +9Image Text Translation Machine Translation
Institute of Information Engineering, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Tencent +3
IMTBench: A Multi-Scenario Cross-Modal Collaborative Evaluation Benchmark for In-Image Machine Translation
Mar 11, 2026Jiahao Lyu, Pei Fu, Zhenhang Li +7Image Text Translation Multimodal MT
Institute of Information Engineering, Chinese Academy of Science, China · MiLM Plus, Xiaomi Inc, China · School of Cyber Security, University of Chinese Academy of Science, China +3
ICDAR 2025 Competition on End-to-End Document Image Machine Translation Towards Complex Layouts
Mar 10, 2026Yaping Zhang, Yupu Liang, Zhiyang Zhang +5Image Text Translation Machine Translation
Institute of Automation, Chinese Academy of Sciences · University of Chinese Academy of Sciences, Beijing, China · Fanyu AI Laboratory, Zhongke Fanyu Technology Company Ltd., Beijing, China.
Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translation
Feb 25, 2026Junxin Lu, Tengfei Song, Zhanglin Wu +9Image Text Translation Machine Translation
School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China · Huawei Translation Services Center, China · School of Computer Science and Technology, East China Normal University, Shanghai 200062, China +1

Nov 3, 2026J/K move · Enter open · S save

FlowTranslator: Training-Free In-Image Machine Translation with Flow-Based Editing

Zhixian Li, Xingsong Ye, Yongkun Du, Yunyan Xiao+5

Institute of Trustworthy Embodied AI, Fudan University · Shanghai Key Laboratory of Multimodal Embodied AI

Image Text Translation Image Editing

Open paper AskPDF arXiv

In-image machine translation (IIMT) replaces text in an image with its translation while preserving the surrounding visual context. Existing task-specific models achieve convincing performance but require massive paired training images before and after translation. As advanced text-to-image (T2I) models have reached a practically usable level of multilingual text generation, we argue that this capability can be transferred to IIMT and present FlowTranslator. It is a training-free IIMT framework that first employs an OCR model and an LLM to generate the translation prompt, which is injected into the T2I-based diffusion model. To optimize the accurate and natural generation of translated text, we introduce two trajectory controls: Region Coupling Release (RCR) partially decorrelates target-branch noise inside the text region early in the trajectory, while Coupling Expansion (CE) amplifies the emerging edit displacement mid-trajectory. Under the EasyOCR read-back protocol, FlowTranslator achieves average PRIM BLEU and COMET scores of 20.6 and 57.2, respectively, substantially outperforming the strong training-based baseline UniTranslator. On the more challenging and realistic whole-image ScenePair photographs translated into Chinese, it reaches 40.1% exact-match accuracy and surpasses existing editing systems, some of which only address the text-rendering stage rather than the complete IIMT task. These results establish flow-based editing as a strong, fully training-free baseline for IIMT.