cs.SDSep 22, 2026

A Stem-Agnostic Approach to Hybrid AI Music Detection

Authors: Richa NamballaFrançois RigaudRomain Hennequin

Abstract

The inclusion of generative audio in the music production process has led to an increase in hybrid music tracks that blend authentic human performances with AI-generated stems, challenging traditional AI music detectors which operate in a binary setting. In this work, we propose a stem-agnostic framework for identifying synthetic audio sources within hybrid musical mixtures. We introduce the inspectrogram, a novel time-frequency representation that maps localized probabilities of synthetic content across the audio spectrum. By combining the inspectrogram with a Wiener filter estimating target stem energy dominance, a single CNN model evaluates whether the specific stem is generated. Trained on rendered hybrid mixtures and evaluated across various stem classes, our model achieves strong performance on high-frequency sources such as vocals, drums, and guitar, but struggles on the low-frequency, narrow-band bass. We conclude that the quality of separation impacts the detection accuracy and identify source separation as a primary bottleneck and a crucial direction for future research.

Explore similar work

CardsList
  1. Detection of AI-generated stems within hybrid human-AI music

    Jul 29, 2026François Rigaud, Gabriel Meseguer-Brocal, Benjamin Martin +1Music GenerationSpeech Separation