Ancient Chinese character recognition is a core capability for cultural heritage digitization, yet real-world workflows are inherently non-stationary: newly excavated materials are continuously onboarded, bringing new classes in different scripts, and expanding the class space over time. We formalize this process as Continual Chinese Character Recognition (Continual CCR), a script-staged, class-incremental setting that couples two challenges: (i) scalable learning under continual class growth with subtle inter-class differences and scarce incremental data, and (ii) pronounced intra-class diversity caused by writing-style variations across writers and carrier conditions. To overcome the limitations of conventional closed-set classification, we propose AMR-CCR, an anchored modular retrieval framework that performs recognition via embedding-based dictionary matching in a shared multimodal space, allowing new classes to be added by simply extending the dictionary. AMR-CCR further introduces a lightweight script-conditioned injection module (SIA+SAR) to calibrate newly onboarded scripts while preserving cross-stage embedding compatibility, and an image-derived multi-prototype dictionary that clusters within-class embeddings to better cover diverse style modes. To support systematic evaluation, we build EvoCON, a six-stage benchmark for continual script onboarding, covering six scripts (OBC, BI, SS, SAC, WSC, CS), augmented with meaning/shape descriptions and an explicit zero-shot split for unseen characters without image exemplars.
Figures & tables
Figure 1: Embedding distribution and glyph examples for a modern character.
Train
Test
Zero-shot
Script
Img
Cls
MCL
SCL
Img
Cls
MCL
SCL
Img
Cls
MCL
SCL
OBC
67755
1632
284.0
47.2
7139
1555
298.4
46.8
413
104
314.8
-
BI
40448
2427
289.0
46.9
1886
883
319.6
45.7
379
134
271.7
-
SS
3881
3250
260.1
45.8
1561
1561
287.1
48.1
405
280
289.5
-
SAC
6961
1358
303.3
47.5
909
738
292.9
47.1
135
75
281.0
-
WSC
65136
3378
302.2
48.7
1239
937
287.1
48.1
442
180
324.3
-
Table 1: Statistics of splits across scripts. Img: number of images; Cls: number of classes; MCL: mean length of meaning captions; SCL: mean length of shape captions.
Figure 2: An EvoCON example with image, scr (script label), char (modern character label), and paired captions (meaning and shape descriptions).
Figure 3: Overview of AMR-CCR.
Method
AA1 ↑
AA2 ↑
AA3 ↑
AA4 ↑
AA5 ↑
AA6 ↑
FGT ↓
Resnet-50 [ 9 ] Based
Seq FT
0.00/3.34
8.64/20.37
1.98/57.57
0.73/1.40
12.17/13.04
14.69/16.34
16.81/27.89
Joint FT
–
–
–
–
–
42.38/62.67
–
Qwen3-VL-Embedding-8B [ 14 ] Based
Frozen
–
–
–
–
–
36.68/55.83
–
Joint FT
–
–
–
–
–
41.14/66.93
–
Table 2: Results under the continual onboarding protocol. Seq FT and Joint FT denote fine-tuning performed sequentially over six tasks and jointly on data from all six tasks, respectively. Pretraining and joint training yield a single model weight set, hence only AA6 performance is shown.
Variant
AA1 ↑
AA2 ↑
AA3 ↑
AA4 ↑
AA5 ↑
AA6 ↑
FGT ↓
ZS ↑
MS
2B
57.9/85.0
39.5/66.0
37.6/63.6
46.1/70.6
46.9/70.4
50.4/72.9
1.2/1.7
20.9/38.6
Modules
w/o SIA & SAR
67.2/87.6
24.1/43.7
21.6/48.3
22.9/49.1
16.5/38.1
28.7/55.3
9.5/9.7
–/–
w/o SAR (Gold)
68.9/90.3
56.2/85.7
52.4/83.4
57.5/85.8
59.3/85.3
61.2/86.8
0.9/1.7
15.9/48.8
BufS
5k
68.2/80.8
55.1/84.2
49.2/79.9
54.3/81.5
55.1/82.8
57.2/80.8
2.8/3.6
14.3/43.9
15k
68.4/90.1
55.7/84.9
50.7/80.4
56.3/83.9
57.9/82.2
59.1/83.8
1.7/2.4
15.2/47.0
PC
Mean
67.6/87.9
41.0/58.1
40.9/61.9
48.8/69.0
47.1/68.1
48.5/70.2
1.6/2.2
–/–
Table 3: Ablation results under the continual protocol and the zero-shot (ZS) task. All values are percentages ( ×100 ) with one decimal. Gold denotes using ground-truth routing, RS denotes random sampling.
Zero-shot Chinese character recognition (ZS-CCR) aims to recognize characters whose categories are never observed during training, and typically relies on the compositional structure shared between seen and unseen characters. Recent CLIP-style methods represent this structure with the Ideographic Description Sequence (IDS) and align it with glyph images in a shared embedding space. However, they rely on a single global image--IDS similarity that discards the spatial layout of radicals and, being learned only implicitly from seen classes, generalizes poorly to unseen ones; moreover, global matching often retrieves the correct character within the top candidates yet fails to rank it first when characters differ only in subtle local radicals. To address these issues, we propose a global-to-local two-stage framework. In the first stage, STG-CLIP augments the IDS with explicit tree-position and radical-level geometric priors, yielding a spatial-aware prototype that provides a consistent spatial description across seen and unseen categories for high-recall global retrieval. In the second stage, the Radical Verification Module (RVM) uses the radical instances of each retrieved candidate as queries to verify whether the corresponding radicals can be matched to spatially compatible regions in the input glyph. A margin-based gating rule activates the RVM only when the leading global candidates receive similar similarity scores. Experiments on the ICDAR2013 benchmark demonstrate that our method achieves state-of-the-art performance under the character-level zero-shot setting, obtaining 83.06% top-1 accuracy with 2,755 seen classes. Ablation studies further show that the explicit geometric priors and radical-level verification provide complementary improvements.
Yu-Heng Shih, Bing-Chen Wu, Tsz-To Wong +6
National Yang Ming Chiao Tung University, Taiwan · E.SUN Financial Holding Co., Ltd., Taiwan · National Kaohsiung Normal University, Taiwan
Ancient Chinese artifact text recognition is fundamental to heritage digitization, and benchmarks for ancient texts are essential for evaluating current model capabilities. However, existing benchmarks suffer from ''fragmentation'', manifested in limited temporal coverage, limited medium diversity, and incomplete script types. Therefore, we present Ancient-Bench, a comprehensive benchmark of 2,700 images for ancient Chinese artifact text recognition, featuring three dimensions: Multi-millennial (spanning 3,000 years of character evolution), Multi-medium (covering nine artifact categories), and Multi-script (encompassing seven historical script forms). To enable consistent and fair evaluation across heterogeneous media, we further define three annotation standards tailored to the medium-specific characteristics of ancient texts: symbol standardization, character standardization, and parsing standardization. Extensive experiments on Ancient-Bench covering general Vision-Language Models (VLMs) and OCR-specialist models reveal that ancient Chinese artifact text recognition remains fundamentally unsolved, with persistent challenges in variant characters, specialized symbols, and hallucination. The dataset is available at https://github.com/SCUT-DLVCLab/Ancient_Bench.
Hiuyi Cheng, Nuo Xu, Yuyi Zhang +9
South China University of Technology · Huawei Technologies Co., Ltd.
Vision Large Language Models (VLLMs) have achieved remarkable success in modern text-rich visual understanding. However, their perceptual robustness in the face of the continuous morphological evolution of historical writing systems remains largely unexplored. Existing ancient text datasets typically focus on isolated historical periods, failing to capture the systematic visual distribution shifts spanning thousands of years. To bridge this gap and empower Digital Humanities, we introduce Chronicles-OCR, the first comprehensive benchmark specifically designed to evaluate the cross-temporal visual perception capabilities of VLLMs across the complete evolutionary trajectory of Chinese characters, known as the Seven Chinese Scripts. Curated in collaboration with top-tier institutional domain experts, the dataset comprises 2,800 strictly balanced images encompassing highly diverse physical media, ranging from tortoise shells to paper-based calligraphy. To accommodate the drastic morphological and topological variations across different historical stages, we propose a novel Stage-Adaptive Annotation Paradigm. Based on this, Chronicles-OCR formulates four rigorous quantitative tasks: cross-period character spotting, fine-grained archaic character recognition via visual referring, ancient text parsing, and script classification. By isolating visual perception from semantic reasoning, Chronicles-OCR provides an authoritative platform to expose the limitations of current VLLMs, paving the way for robust, evolution-aware historical text perception. Chronicles-OCR is publicly available at https://github.com/VirtualLUOUCAS/Chronicles-OCR.
Gengluo Li, Shangpin Peng, Xingyu Wan +16
Institute of Information Engineering, Chinese Academy of Sciences · Tencent · Anyang Normal University +2