This paper develops an output-driven resampling formulation for fine pitch adjustment of recorded signals. A fractional input-position increment combines the desired frequency ratio with independently specified input and output sample rates. Each output sample is evaluated from neighboring input samples, and gradual rate changes preserve the current input position. Musical interval mapping and direct sine synthesis are treated as distinct layers. The formulation separates tuning resolution, numerical accuracy, interpolation quality, and streaming correctness. Optional rational-factor representations use freely chosen approximation parameters; numerical illustrations do not define constants required by the algorithm. Linear interpolation provides a low-cost evaluation kernel but does not establish a universal signal-quality or frequency-accuracy guarantee.
Figures & tables
Fig. 1: Spectral analysis of the on-demand linear resampler output during a continuous +50 cent pitch transformation, showcasing absolute fundamental tracking alongside the characteristic −26 dB imaging baseline footprint.
Pitch tracking systems typically couple a per-frame fundamental frequency (F0) estimator with a temporal smoothing stage to obtain continuous trajectories. Conventional Viterbi smoothers enforce first-order continuity but lack long-term temporal awareness and could lock into octave errors across corrupted frames. We propose Relative Interval Networks (RIN), a trajectory smoothing framework that reconciles per-frame pitch estimates with data-driven multi-hop pitch differences. We extract robust relative pitch intervals across arbitrary frame offsets using Variable-Q Transform cross-correlation. We formulate pitch smoothing as an L1-norm optimization problem and prove its equivalence to a minimum cost circulation problem, solved efficiently via linear programming. Evaluations across speech, singing, and instrumental datasets show that RIN substantially improves weak estimators, matches or outperforms Viterbi decoding at a comparable computational cost, and provides superior robustness under certain acoustic degradation.
Chin-Yun Yu, Chi-Jen Peng, Li Su +1
Centre for Digital Music, Queen Mary University of London, UK · Department of Information Management, National Taiwan University, Taiwan · Institute of Information Science, Academia Sinica, Taiwan
Musicians and mixing engineers often can decipher the signal processing chain they hear on a reference recording, then adapt it to new material. We present TAPE (Transformations of Audio Parameter Embeddings), which estimates this processing from the processed reference audio alone. An encoder trained to identify processors in eight major effect families maps the reference to an embedding. A differentiable digital signal processing (DSP) chain decodes the embedding into editable parameters in one forward pass and applies them to a different unprocessed recording. Its modules are equalization, compression, waveshaping, a small residual network, and reverberation. TAPE achieves lower spectral error than DeepAFx-ST, the previous state of the art for single-step regression, and lower spectral error than per-example search over a chain approximating ST-ITO's, while running 275× faster than that search. Because the decoder outputs DSP parameters, its chain can also run causally: a C++ implementation with the trained weights processed 128-sample buffers 1.8× faster than real time, with no missed deadlines.
Quadratic difference tones (QDTs) are a species of auditory distortion product in which a "phantom" pure tone, absent from the acoustic signal, is clearly audible to listeners. Exploiting this phenomenon, one can synthesize harmonically rich tones for musical purposes, a technique called Quadratic Difference Tone Spectrum (QDTS) synthesis. Previous works have introduced numerical methods to synthesize QDTS based on the distortion function, which links a target QDTS and an overtone-structured carrier signal. While accurate, these methods were stochastic and discontinuous, making them difficult to control for musical purposes and effectively limiting them to stationary signals. This paper proposes a neural network-based approach that learns an approximate inverse of the distortion mapping in an autoencoder-like configuration, producing a continuous approximation that addresses prior limitations. Experimental results show that, although slightly less numerically precise, the method is sufficient for perceptual and musical applications. We also implement a real-time version in Max and evaluate its performance. Various sound examples demonstrate its expressive and musical potential. The source code, audio examples, tutorials, and software accompanying this work are available at https://cordutie.github.io/projects/qdts.html
Esteban Gutiérrez, Behzad Haki, Christopher Haworth +2
Department of Information and Communications Technologies Universitat Pompeu Fabra · Independent Researcher Barcelona, Spain · Department of Music University of Birmingham +1