Pitch Smoothing Using Relative Interval Networks
Organizations: Centre for Digital Music, Queen Mary University of London, UK · Department of Information Management, National Taiwan University, Taiwan · Institute of Information Science, Academia Sinica, Taiwan
Abstract
Pitch tracking systems typically couple a per-frame fundamental frequency () estimator with a temporal smoothing stage to obtain continuous trajectories. Conventional Viterbi smoothers enforce first-order continuity but lack long-term temporal awareness and could lock into octave errors across corrupted frames. We propose Relative Interval Networks (RIN), a trajectory smoothing framework that reconciles per-frame pitch estimates with data-driven multi-hop pitch differences. We extract robust relative pitch intervals across arbitrary frame offsets using Variable-Q Transform cross-correlation. We formulate pitch smoothing as an -norm optimization problem and prove its equivalence to a minimum cost circulation problem, solved efficiently via linear programming. Evaluations across speech, singing, and instrumental datasets show that RIN substantially improves weak estimators, matches or outperforms Viterbi decoding at a comparable computational cost, and provides superior robustness under certain acoustic degradation.
Figures & tables
| PTDB-TUG | MIR-1K | URMP | Runtime | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Estimator | Smoothing | RPA | RCA | MAE | OA | RPA | RCA | MAE | OA | RPA | RCA | MAE | OA | ms/s |
| YIN | – | 62.36 | 67.72 | 11.34 | 89.19 | 94.90 | 95.95 | 7.01 | 90.25 | 87.56 | 91.14 | 2.33 | 90.45 | 2.1 |
| Viterbi (pYIN) | 83.31 | 85.48 | 13.09 | 89.76 | 98.64 | 99.06 | 7.40 | 90.72 | 95.15 | 97.85 | 3.89 | 90.58 | 13.3 | |
| RIN | 82.96 | 84.87 | 12.91 | 90.23 | 97.11 | 97.81 | 7.67 | 91.15 | 93.93 | 97.35 | 2.98 | 90.93 | 5.2 | |
| RIN | 84.20 | 86.07 | 13.09 | 90.24 | 97.42 | 97.76 | 8.46 | 91.33 | 94.43 | 97.64 | 3.38 | 91.22 | 5.5 | |
| SWIPE | – | 85.46 | 86.92 | 12.90 | 92.79 | 96.39 | 96.92 | 9.37 | 90.46 | 94.34 | 95.38 | 5.88 | 92.15 | 49.2 |