Aesthetic Assessment of Chinese Handwritings Based on Vision Language Models
Organizations: The Open University of China, Beijing, China · Engineering Research Center of Integration and Application of Digital Learning Technology, Ministry of Education, Beijing, China · OUC-online, Beijing, China
Abstract
The handwriting of Chinese characters is a fundamental aspect of learning the Chinese language. Previous automated assessment methods often framed scoring as a regression problem. However, this score-only feedback lacks actionable guidance, which limits its effectiveness in helping learners improve their handwriting skills. In this paper, we leverage vision-language models (VLMs) to analyze the quality of handwritten Chinese characters and generate multi-level feedback. Specifically, we investigate two feedback generation tasks: simple grade feedback (Task 1) and enriched, descriptive feedback (Task 2). We explore both low-rank adaptation (LoRA)-based fine-tuning strategies and in-context learning methods to integrate aesthetic assessment knowledge into VLMs. Experimental results show that our approach achieves state-of-the-art performances across multiple evaluation tracks in the CCL 2025 workshop on evaluation of handwritten Chinese character quality.
Figures & tables
| Model | Precision | Recall | F1 |
|---|---|---|---|
| QwenVL LoRA | 0.76 | 0.76 | 0.76 |
| QwenVL LoRA w/ CHAED | 0.61 | 0.61 | 0.61 |
| In-Context Learning | 0.69 | 0.69 | 0.69 |
| Model | ROUGE-1 | ROUGE-2 | ROUGE-L | FinalScore |
|---|---|---|---|---|
| QwenVL LoRA | 0.43 | 0.24 | 0.41 | 0.36 |
| QwenVL LoRA w/ grade | 0.46 | 0.26 | 0.43 | 0.39 |
| QVQ LoRA | 0.47 | 0.26 | 0.44 | 0.39 |
| In-Context Learning | 0.63 | 0.34 | 0.56 | 0.52 |