Scribe Verification in Chinese manuscripts using Siamese, Triplet, and Vision Transformer Neural Networks
Organizations: Department of Informatics, Aristotle University of Thessaloniki, Thessaloniki 54124, Greece · School of Computer and Information Engineering, Henan University, Kaifeng, China
Abstract
The paper examines deep learning models for scribe verification in Chinese manuscripts. That is, to automatically determine whether two manuscript fragments were written by the same scribe using deep metric learning methods. Two datasets were used: the Tsinghua Bamboo Slips Dataset and a selected subset of the Multi-Attribute Chinese Calligraphy Dataset, focusing on the calligraphers with a large number of samples. Siamese and Triplet neural network architectures are implemented, including convolutional and Transformer-based models. The experimental results show that the MobileNetV3+ Custom Siamese model trained with contrastive loss achieves either the best or the second-best overall accuracy and area under the Receiver Operating Characteristic Curve on both datasets.
Figures & tables
| Scribe Class | Training Images | Test Images |
| Bao Xun | 164 | 40 |
| Bie Gua | 32 | 8 |
| Cheng Wu | 214 | 53 |
| Chu Ju | 445 | 111 |
| Feng Xu Zhi Ming | 161 | 40 |
| Guan Zhong | 1508 | 377 |
| Scribe Class | Training Images | Test Images |
| He Shaoji | 1048 | 448 |
| Shan Xiaotian | 1114 | 447 |
| Wu Rui | 991 | 424 |
| Wu Dacheng | 1242 | 532 |
| Mi Fu | 1526 | 654 |
| Deng Shiru | 923 | 395 |
| Model | Dataset | AUC | ACC (%) | FAR (%) | FRR (%) |
| MobileNetV3 (Siamese) | Tsinghua | 0.897 | 82.27 | 13.28 | 22.19 |
| MobileNetV3+ Custom (Siamese) | Tsinghua | 0.958 | 89.19 | 5.63 | 15.99 |
| ResNet18 (Siamese) | Tsinghua | 0.921 | 84.65 | 16.56 | 14.15 |
| ResNet34 (Siamese) | Tsinghua | 0.912 | 82.56 | 19.5 | 15.37 |
| ResNet50 (Siamese) | Tsinghua | 0.884 | 80.4 | 21.5 | 17.69 |
| VGG19 (Siamese) | Tsinghua | 0.857 | 82.07 | 14.95 | 20.91 |
Historical Document Analysis
Historical document analysis uses AI to transcribe, interpret, organize, and retrieve information from archival texts and images.
See all 51 papers