cs.CVApr 8, 2026

Zero-Shot Synthetic-to-Real Handwritten Text Recognition via Task Analogies

Authors: Carlos Garrido-Munoz, Aniello Panariello, Silvia Cascianelli, Angelo Porrello, Simone Calderara, Jorge Calvo-Zaragoza, Rita Cucchiara

Organizations: University of Alicante, Spain · University of Modena and Reggio Emilia, Italy

Abstract

Handwritten Text Recognition (HTR) models trained on synthetic handwriting often struggle to generalize to real text, and existing adaptation methods still require real samples from the target domain. In this work, we tackle the fully zero-shot synthetic-to-real generalization setting, where no real data from the target language is available. Our approach learns how model parameters change when moving from synthetic to real handwriting in one or more source languages and transfers this learned correction to new target languages. When using multiple sources, we rely on linguistic similarity to weigh their contrubition when combining them. Experiments across five languages and six architectures show consistent improvements over synthetic-only baselines and reveal that the transferred corrections benefit even languages unrelated to the sources.

Figures & tables

Appendix figures & tables11 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Few-shot Writer Adaptation via Multimodal In-Context Learning

    Mar 31, 2026Tom Simon, Stephane Nicolas, Pierrick Tranouez +2Optical Character RecognitionFew-Shot Learning

  2. Diffusion-Based Ukrainian Handwritten Text Generation with Cross-Domain Style Transfer

    May 26, 2026Andrii Ahitoliev, Pavlo BerezinLatent Diffusion ModelsImage Style Transfer