From Volpiano to Pixels: 30,000 Lines of OMR Ground Truth for Medieval Chant
Organizations: Austrian Academy of Sciences (ACDH), Vienna
Abstract
Optical music recognition (OMR) for medieval chant lacks training data linking manuscript images to musical symbols across notational families. Using existing Volpiano transcriptions from the Cantus Database, we created 30,567 image-target pairs from ten sources in eleven exports, including 339 verse fragments. Their target sequences contain 1,952,143 tokens. The pipeline locates staff systems, infers clefs and maps known pitches to staff positions. Six detector families handle the different layouts and notations. Where heuristics failed, two small U-Nets learned staff lines and clef letters from manual annotations. Reviews of sampled export lines found zero to four pitch or clef errors, but used different error definitions and do not provide a uniform audit of the corpus. A CRNN trained from scratch achieved a symbol error rate of 9.6 % on 3,086 test lines. The earlier model, trained mainly on Austrian sources of the 15th and 16th centuries, scored 45.3 %. In three separate training runs, each excluding one manuscript, error rates on the excluded manuscript were 21.5-31.0 %. Model-assisted alignment recovered a further 2,686 lines.
Figures & tables
| Event | Cost |
|---|---|
| Note outside z 1…z4 on a four-line staff, or z 1…z5 on a five-line staff | 0.1 per half-line step beyond the range |
| Clef change within a neume | Forbidden |
| Clef change at a neume separator | 2.0 |
| Clef change at a syllable or word separator | 1.5 |
| Clef change at a new-chant marker | 0.3 |
| Clef at a forced system boundary | No transition penalty |
| Source | Provenance | Notational family | Lines | Errors/verdicts (Wilson UB) | Harvested (model) |
|---|---|---|---|---|---|
| A-KN 1010 (12th c.) | Augustinian canonesses, Klosterneuburg | Klosterneuburg notation | 339 | 101 verse verdicts, 16 misassigned | |
| A-KN 1012 (12th c.) | Augustinian canonesses, Klosterneuburg | Klosterneuburg notation | 1,175 | 4/206 (4.9 %) | 706 |
| A-KN 1018 (14th c.) | Augustinian canonesses, Klosterneuburg | Klosterneuburg notation | 2,558 | 1/202 (2.8 %) | |
| A-Wn 1799** (early 13th c.) | Cistercian abbey of Rein | Cistercian notation | 3,137 | 0/34 definite errors; 1 unclear (conservative 1/35: 14.5 %) | |
| CH-E 611 (14th c.) | Benedictine abbey of Einsiedeln | square notation | 7,413 | 2/99 (7.1 %) | |
| CH-Fco 2 (late 13th c.) | unknown Franciscan house | square notation | 6,000 | 0/65 (5.6 %) |
Optical Music Recognition
Optical Music Recognition converts images of printed or handwritten scores into structured musical notation for search, analysis, and playback.
See all 17 papers