Transcription and Recognition of Italian Parliamentary Speeches Using Vision-Language Models
Authors: Luigi Curini, Alfio Ferrara, Giovanni Pagano, Sergio Picascia
Organizations: Università degli Studi di Milano, Department of Social and Political Sciences, Via Conservatorio, 7 - 20122 Milano (Italy) · Università degli Studi di Milano, Department of Literary Studies, Philology and Linguistics, Via Festa del Perdono, 7 - 20122 Milano (Italy) · Università degli Studi di Milano, Department of Computer Science, Via Celoria, 18 - 20133 Milano (Italy)
Parliamentary proceedings represent a rich yet challenging resource for computational analysis, particularly when preserved only as scanned historical documents. Existing efforts to transcribe Italian parliamentary speeches have relied on traditional Optical Character Recognition pipelines, resulting in transcription errors and limited semantic annotation. In this paper, we propose a pipeline based on Vision-Language Models for the automatic transcription, semantic segmentation, and entity linking of Italian parliamentary speeches. The pipeline employs a specialised OCR model to extract text while preserving reading order, followed by a large-scale Vision-Language Model that performs transcription refinement, element classification, and speaker identification by jointly reasoning over visual layout and textual content. Extracted speakers are then linked to the Chamber of Deputies knowledge base through SPARQL queries and a multi-strategy fuzzy matching procedure. Evaluation against an established benchmark demonstrates substantial improvements both in transcription quality and speaker tagging.
Figures & tables
Figure 1: Pipeline diagram showing the six stages with data flow between components.
Figure 2: Excerpt from the stenographic report of the session held on November 27th 1874, Legislature 12 of the Kingdom of Italy. This page excerpt serves as the running example throughout this section.
Figure 3: Effect of post-processing on a cross-page speech fragment. Highlighted regions show speaker inference ( unknown → resolved ); underlined text shows hyphenation resolution.
Method
CER
WER
Tesseract (IPSA)
0.030
0.071
dots.ocr
0.031
0.050
dots.ocr + Qwen-VL
0.009
0.024
Table 1: OCR evaluation results on the 60-page benchmark. Lower values indicate better performance.