cs.AINov 13, 2026

OmniScore-Bench: Evaluating Vision-Language Models on Musical Score Reading

Authors: Congren Dai, Zhancheng Guo, Danni Zhao, Wenchu Wang, Xiaobing Li, Maosong Sun

Organizations: Central Conservatory of Music · Tsinghua University

Abstract

Vision-language models (VLMs) can answer questions about musical scores, but their ability to recognise notation, recover its structure and interpret its musical meaning requires separate evaluation. Existing optical music recognition (OMR) resources establish detection and transcription measurements; a transcription score alone leaves the strengths and bottlenecks of a VLM score reader unresolved. We introduce OmniScore-Bench, an evaluation of OMR capabilities in VLMs through 3,000 questions spanning six aspects and 24 task subtypes. Each question specifies a visible scope, reference annotations and an answer schema, enabling automatic evaluation from symbol localisation to musical consistency and evidence-linked question answering. Our assessment of twelve VLMs reveals operation-specific capability profiles and different transcription leaders across excerpt, single-page and multipage tasks. Controlled analyses examine the roles of score images, auxiliary givens and additional page context. On the tested subset, image removal exposes visual dependence in pitch and repeat interpretation while measuring how much performance remains with public context alone. Separate format and content analyses distinguish answer-format violations from musical errors. OmniScore-Bench supports diagnosing which score-reading operations VLMs perform reliably and which require improvement.

Figures & tables

Explore similar work

CardsList
  1. LEGATO: Large-scale End-to-end Generalizable Approach to Typeset OMR

    Jun 23, 2025Guang Yang, Victoria Ebert, Nazif Can Tamer +3Optical Music RecognitionDocument Image Understanding

  2. LEGATO 2: Toward Multimodal Sheet Music Recognition and Understanding

    Jul 7, 2026Guang Yang, Brian Siyuan Zheng, Victoria Ebert +1Optical Music RecognitionAutomatic Music Transcription

  3. A Dataset and Benchmark for Optical Music Recognition of String Quartet Scores

    Aug 11, 2026Dongmin Kim, Brian Liu, Jose J. Valero-Mas +1Optical Music RecognitionAutomatic Music Transcription