cs.CVNov 16, 2026

Dataset Distillation for Handwritten Text Recognition: An Empirical Study

Authors: Félix Fuentes-Hurtado, Aric Ayllón, Juan C. Alfaro

Organizations: University of Alicante, Spain · University of Castilla-La Mancha, Spain

Abstract

Dataset distillation (DD) replaces large training datasets with smaller synthetic ones to reduce computational costs. While traditionally used for classification, we present, to our knowledge, the first DD study for line-level handwritten text recognition (HTR). Unlike classification tasks, which use discrete labels, HTR employs unaligned sequences from a virtually infinite output space as labels. To adapt classification-based DD methods to this scenario, we define text pseudo-classes by clustering transcriptions based on character n-grams. We adapt gradient matching (GM), distribution matching (DM) and trajectory matching (MTT) to a Convolutional Recurrent Neural Network (CRNN) trained with Connectionist Temporal Classification (CTC). In this process, synthetic line images are generated by optimising only the pixels of real starting lines (either randomly chosen or selected as text medoids), while keeping their original transcriptions fixed. Across four datasets (IAM, George Washington, READ,2016, LAM) and three budgets (1--10,% of the training lines), no distilled set outperforms its real initialisation lines. Random lines prove better than medoids, and further optimisation only degrades recognition. Methodologically, DM lowers its objective without benefit, while GM and MTT barely move theirs. We turn these findings into guidelines for evaluating data compression in HTR.

Figures & tables

Explore similar work

CardsList
  1. Zero-Shot Synthetic-to-Real Handwritten Text Recognition via Task Analogies

    Apr 8, 2026Carlos Garrido-Munoz, Aniello Panariello, Silvia Cascianelli +4Synthetic-to-Real Domain AdaptationTransfer Learning

  2. Spike-HTR: Spiking Neural Transformer for Handwritten Text Recognition

    Aug 3, 2026Xiubo Liang, Jinxing Han, Yuke Li +3Efficient Neural Network InferenceSpiking Transformers

  3. TrOCR for Medieval HTR: A Systematic Ablation Study with Cross-Dataset Validation

    Jun 23, 2026Sachin Sharma, Michele Flammini, Federico SimonettaFine-TuningVLM Adaptation