Gangqinpu: A Multi-Genre, Multi-Task Piano Dataset with Aligned Audio, MIDI, and Musical Scores
Organizations: Integrative Sciences and Engineering Programme, NUS Graduate School · School of Computing, National University of Singapore · Singapore American School
Abstract
Aligned audio, performance MIDI, and musical scores provide valuable supervision for music analysis and performance modeling, yet datasets that jointly align all three modalities remain scarce and limited in scale and genre diversity. We introduce Gangqinpu, a multi-genre piano dataset containing 18,786 score-performance pairs and 1,007.1 hours of source audio, with automatic note-level alignments and derived beat/downbeat annotations. It spans diverse genres, including pop, classical, jazz, folk/traditional, rock, and blues. Our automated pipeline transcribes piano audio, aligns the resulting MIDI with musical scores, assigns genre labels, and filters out non-expressive performances with a score-informed binary classifier. We further construct joint splits with ASAP using conservative score-similarity grouping to reduce data leakage. We evaluate Gangqinpu on performance MIDI-to-score transcription, expressive performance rendering, and beat tracking. Downstream experiments demonstrate the value of Gangqinpu as complementary training data, with cross-dataset gains in beat tracking and primarily in-domain benefits for transcription and expressive performance rendering. The code and dataset are publicly available at https://github.com/wei-zeng98/gangqinpu.
Figures & tables
| Size | Modalities | Origin | Annotations | |||||||
| Dataset | Genre | Pieces / Scores | Perf. | Hours | Audio | MIDI | Score | Audio / MIDI Source | Align. | Beats |
| MAESTRO v3 [ 31 ] | Mostly classical | – | 1,276 | 198.7 | – | Real / Captured | – | – | ||
| ASAP/(n)ASAP [ 29 , 34 ] | Classical | 235 | 1,067 | 94.5 | External △ | Real / Captured | Beat / Note † | |||
| ATEPP v1.2 [ 32 ] | Classical | 1,595 | 11,674 | 1,000 | External | Real (web) / AMT | – | – | ||
| ACPAS [ 35 ] | Classical | 497 | 2,189 | 179.8 | Ext./Synth. | Real+Synth. / Mixed | Beat § | |||
| PianoCoRe-A [ 36 ] | Primarily classical | 1,591 | 157,207 | 12,509 | – | None / Mixed | Note | – | ||
| Feature | Definition |
| Timing variability | Standard deviation of local onset residuals. |
| Timing correlation | Lag-one autocorrelation of onset residuals. |
| Timing entropy | Shannon entropy of onset residuals discretized into 10 ms bins. |
| Chord asynchrony | Median onset range within groups of simultaneously notated notes. |
| Velocity variability | Standard deviation of note velocities. |
| Velocity diversity | Number of distinct note velocities. |
| Statistic | Value |
| Performances | 18,786 |
| Score groups | 15,645 |
| Groups with multiple performances | 2,445 |
| Total audio duration (hours) | 1,007.1 |
| Mean audio duration (min) | 3.22 |
| Median audio duration (min) | 3.04 |
| Subset | Ours | SyMuPe | NOMML | |
| ASAP (human) | 246 | 100.0% | 99.6% | 100.0% |
| expressive | 195 | 99.0% | 86.7% | 100.0% |
| non-expressive | 93 | 97.8% | 18.3% | 0.0% |
| hard_neg (synthetic) | 120 | 100.0% | 100.0% | 0.0% |
| noise 46 ms (synthetic) | 120 | 98.3% | 100.0% | 0.0% |
| noise 60 ms (synthetic) | 120 | 83.3% | 100.0% | 0.0% |
| Target | Training data | F1 | CMLt | AMLt |
| ASAP test | ||||
| Beat | ASAP | 57.69 | 21.66 | 26.63 |
| ASAP + Gangqinpu | 61.98 | 28.57 | 30.64 | |
| Downbeat | ASAP | 43.23 | 10.90 | 21.30 |
| ASAP + Gangqinpu | 47.55 | 13.41 | 22.79 | |
| Gangqinpu test | ||||
| ASAP test | Gangqinpu test | ||||
| Prediction target | Metric | ASAP | ASAP + G | ASAP | ASAP + G |
| Beat label | F1 | 62.97 | 64.89 | 69.28 | 83.30 |
| Downbeat label | F1 | 43.36 | 48.68 | 42.02 | 62.97 |
| Hand assignment | Macro-F1 | 86.65 | 84.81 | 86.99 | 93.99 |
| Key signature | Macro-F1 | 36.26 | 30.87 | 78.39 | 79.33 |
| Time signature | Macro-F1 | 45.40 | 43.96 | 51.00 | 45.43 |
| Training data | Velocity | IOI (ms) | Duration (ms) |
| ASAP test | |||
| ASAP | 16.40 | 66.40 | 999.66 |
| ASAP + Gangqinpu | 16.62 | 68.96 | 1,058.28 |
| Gangqinpu test | |||
| ASAP | 17.50 | 78.51 | 309.47 |
| ASAP + Gangqinpu | 13.05 | 54.66 | 269.04 |