Audio Representation Learning

Ask about this topic

Momentum

20 papers in the last four weeks, up 233% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 140

All topics
CardsList

  1. Feature Encoding in VAE-based Audio Decoders: Effects of Input, Depth and Distribution

    Oct 6, 2026Louis McCallum, Mick GriersonVariational AutoencodersAudio Representation Learning

    Creative Computing Institute, University of the Arts London, London, UK

  2. Neural Representations, Natural Connections: What Transfers From Human Speech Foundation Models to Animal Vocalizations?

    Oct 5, 2026Tomás Arias-Vergara, Christopher Hauer, Héloïse Brotier +3Audio Representation LearningSpeech Foundation Models

    Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany · Faculty of Electrical Engineering, Media and Computer Science, OTH Amberg-Weiden, Germany · Faculty of Life Science, The Gonda Multidisciplinary Brain Research Center, Bar Ilan University, Israel

  3. Do Speech Representations Preserve Regional Accent Across Read and Spontaneous Speech?

    Oct 5, 2026Paula A. Perez-Toro, Tomas Arias-Vergara, Annette Schwarz +4Audio Representation LearningSelf-Supervised Speech Representation Learning

    Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany. · Leibniz Institute for Educational Trajectories (LIfBi), Bamberg, Germany. · Otto-Friedrich-Universität Bamberg, Bamberg, Germany.

  4. Character Identity is not Speaker Identity: KyaraBench and KyaraEmbed for Character Verification

    Oct 5, 2026Joonyong Park, Jerry LiAudio Representation LearningRepresentation Learning

    Spellbrush, CA, USA

  5. Beyond Decodability: Do Acoustic Factors Drive Predictions in Speech-Based Alzheimer's Assessment?

    Oct 1, 2026Serli Kopar, Alkis Koudounas, Roshan P. Rane +3Audio Representation LearningSpeech-Based Dementia Detection

    Hertie Institute for AI in Brain Health, Germany · Tübingen AI Center, Germany · Sony Group Corporation, Japan +1

  6. UniAE-MoE: A Unified Audio Encoder via Mixture of Experts

    Sep 30, 2026Shengbo Cai, Zhisheng Zhang, Zichao Nie +3Audio Representation LearningMixture of Experts

    Tsinghua University, China

  7. VOSSA: Voiceprint Optimization for Streaming Speech Architectures

    Sep 30, 2026Mu-Ruei Tseng, Waris Quamer, Ghady Nasrallah +1Audio Representation LearningSpeech Processing

    Department of Computer Science & Engineering, Texas A&M University, College Station, US

  8. RAST: Resolution-Aware Privileged Structure Transfer for Low-Resolution Audio Activity Recognition

    Sep 30, 2026Ji Hwan Park, Gautham Krishna Gudur, Yufei Shen +2Audio Representation LearningHuman Activity Recognition

    The University of Texas at Austin Austin, Texas, USA

  9. Multi-Rate Bandwidth Extension by Token Completion in Neural Audio Codecs

    Sep 29, 2026Benoît Ginies, Olivier Fercoq, Gaël RichardAudio Representation LearningNeural Audio Codecs

    LTCI, Télécom Paris, Institut Polytechnique de Paris, Palaiseau, France

  10. Retrieving Individual Stems from Music Mixtures with Slot Embeddings

    Sep 28, 2026David Braun, Junyi Fan, Pranay Manocha +2Audio Representation LearningMulti-Vector Retrieval

    Princeton University · The Ohio State University · Symbal AI

  11. Rethinking Automated Voice Similarity by Shifting from EER to Embedding Geometry

    Sep 27, 2026Szu-Chi Chen, Jia-Kai Dong, Yi-Cheng Lin +2Audio Representation LearningSpeaker Verification

    National Taiwan University, Taipei, Taiwan · NVIDIA, Taiwan · Artificial Intelligence Center of Research Excellence (NTU AI-CoRE), NTU, Taiwan

  12. YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality

    Sep 27, 2026Ruibin Yuan, Jiahao Pan, Junyan Jiang +32Audio Representation LearningControllable Music Generation

    HKUST HKGAI M-A-P Tokenwave.AI New York University Stanford University MBZUAI ACE Studio

  13. What Survives the Codec Shift: Pooled No-Vocals Residuals for Speech Deepfake Detection

    Sep 27, 2026Jiajun Xu, Menglu Li, Xiao-Ping ZhangAudio Representation LearningAudio Deepfake Detection

    Department of Engineering Physics Tsinghua University Beijing, China · Tsinghua Shenzhen International Graduate School Tsinghua University Shenzhen, China

  14. Joint Analysis of Latent Dimensionality and Frame Rate in Continuous Audio Encoders

    Sep 24, 2026Kyudan Jung, Sehyun Lee, Son-ha Jo +2Audio Token CompressionAudio Representation Learning

    KAIST AI · Seoul National University · NAVER Cloud

  15. UNITE-AUDIO: Joint Learning of Continuous Tokenization and Latent Flow Matching for Text-to-Audio Generation

    Sep 23, 2026Runwu Shi, Kai Li, Yujin Wang +8Text-to-Audio GenerationAudio Representation Learning

    Institute of Science Tokyo · Tsinghua University · Wuhan University +2

  16. When Entanglement Lower-Bounds Disparity: Auditing and Repairing Demographic Fairness in Audio Understanding Models

    Sep 23, 2026Kian Shamsaie, Iman ModarressiDisentangled Representation LearningAudio Representation Learning

    People Make Things

  17. Do Audio Representations Compose Additively?

    Sep 23, 2026Chenhao Xue, Zhijin Guo, Joyraj Chakraborty +2Audio Representation LearningCompositional Representation Learning

    Department of Engineering Science, University of Oxford, Oxford, UK · University of Essex, Colchester, UK

  18. Discrete vs. Continuous: A Comprehensive Study of Unified Audio Understanding in LALMs

    Sep 19, 2026Jing Peng, Zichao Nie, Zhisheng Zhang +2Audio-Language Model EvaluationAudio Representation Learning

    Shenzhen International Graduate School, Tsinghua University, Shenzhen, China

  19. Training Music Sample Identification Models on Real Sample Pairs

    Sep 18, 2026R. Oguz Araz, Joan Serrà, Xavier Lizarraga-Seijas +3Audio Representation LearningMusic Information Retrieval

    Music Technology Group, Universitat Pompeu Fabra, Spain · Sony Europe · Sony CTC America

  20. Multi-Teacher Distillation for Cross-Domain Streaming Electrolaryngeal Speech Encoding

    Sep 16, 2026Benedikt Mayrhofer, Enrique Orozco Olivares, Franz Pernkopf +2Audio Representation LearningStreaming ASR

    Signal Processing and Speech Communication Laboratory, Graz University of Technology · Comprehensive Center for AI in Medicine, Medical University of Vienna · Dept. of Otolaryngology, Head & Neck Surgery, Div. of Phoniatrics-Logopedics, Speech & Hearing Sci. Lab, Med. Univ. of Vienna

  21. Sample-Conditioned Representation Selection for Audio Few-Shot Learning

    Sep 15, 2026Fengrui Liu, Ningxin Shen, Yi Li +3Few-Shot Audio ClassificationAudio Representation Learning

    National Key Laboratory of Space Integrated Information System, Institute of Software, Chinese Academy of Sciences · School of Computer Science, Nanjing University · School of Computer Science and Technology, East China Normal University +1

  22. Task-Directed Residual AddUNet:Perfect-Reconstruction Routing for Full-Rate Representations

    Sep 14, 2026Vikram R. LakkavalliAudio Representation LearningRepresentation Learning

    International Institute of Information Technology Bangalore, India

  23. Rethinking Procedural Audio Pre-training: Source Scaling and Objective Adaptation

    Sep 14, 2026Jiajun Peng, Fengrui Liu, Xinyu Liu +1Synthetic Data PretrainingAudio Representation Learning

    School of Data Science, University of Science and Technology of China, Hefei 230026, China · School of Computer Science and Technology, East China Normal University, Shanghai 200062, China · School of Psychology, Shanghai Jiao Tong University, Shanghai 200030, China

  24. Semantic Refinement of Universal Audio Representations through Audio-Description Alignment

    Sep 8, 2026Lejun Min, Junyu Dai, Ruichen Zheng +7Audio Representation LearningAudio Classification

    1Alibaba Token Foundry

  25. Compressing Streaming Neural Audio Encoders via Latent-Space Distillation

    Sep 3, 2026Prasanth Yadla, Mohammad Samragh, Dongseong Hwang +7Audio Token CompressionAudio Representation Learning

    Apple

  26. CoJEPA: Combining Contrastive Learning and JEPA for Global-Local Music Representations

    Aug 31, 2026Gabriel Meseguer-Brocal, Yuexuan Kong, Romain HennequinContrastive LearningAudio Representation Learning

    Deezer Research, Paris, France

  27. Pitch Contour Tokenization using VQ-VAE and Its Application on Korean Traditional Music Analysis

    Aug 11, 2026Seonguk Ju, Seola Cho, Sooin Chung +2Audio Representation LearningVector-Quantized Variational Autoencoder

    Music & Arts Learning (MALer) Lab, Sogang University, South Korea · Graduate School of Culture Technology, KAIST, South Korea

  28. DINO-A: Adapting Self-Distillation Vision Transformers to General Audio Representation Learning

    Aug 11, 2026Tomasz Radzikowski, Mateusz Modrzejewski, Przemysław RokitaAudio Representation LearningSelf-Supervised Pre-Training

    Warsaw University of Technology, Warsaw, Poland

  29. Beyond Dry References: Learning Relative Audio Effects Representations via Contrastive Distance Learning

    Aug 11, 2026Xinlu Liu, Huibin Lin, Weixing Wei +1Contrastive LearningAudio Representation Learning

    Galaxy Audio Effect Team, Tencent Music Entertainment · Independent Researcher

  30. How Far Do Foundation Models Transfer to Infant Signals? A Cross-Dataset Transfer Audit with a Unified Need Ontology

    Aug 10, 2026Wu HangyuAudio Representation LearningDomain-Adaptive Pretraining

    Shenzhen Coddie Technology Co., Ltd.

  31. Beyond Residual Connections: Manifold-Constrained Hyper-Connections for Robust Speaker Representation Learning

    Aug 6, 2026Zezhong Jin, Xiaoyu Wang, Zhe Li +4Audio Representation LearningResidual Learning

    Dept. of EEE, The Hong Kong Polytechnic University · Baidu Inc. · Speech, Language, and Cognition Laboratory, The University of Hong Kong, Hong Kong SAR

  32. MeloCodec: Harnessing Melodic Priors for High-Fidelity Singing Voice Representation

    Aug 4, 2026Yizhong Geng, Wenxin Fu, Kecan Mao +7Audio Representation LearningNeural Audio Codecs

    Beijing University of Posts and Telecommunications, Beijing, China · Li Auto, Beijing, China

  33. Discriminative Axis, Not Data Volume: What a Contrastive Corpus Teaches an Audio Embedding

    Aug 3, 2026Abdul Basit TonmoyContrastive LearningAudio Representation Learning

    Eximius Labs · Wabash College

  34. Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokens

    Jul 31, 2026Yi Luo, Rongzhi Gu, Jixun YaoFlow MatchingAudio Representation Learning

    ByteDance Seed · Work done during an internship at ByteDance Seed.

  35. Do Music Foundation Models Embed Pitch in Helical Structure?

    Jul 31, 2026Hayato Yagi, Shinnosuke Takamichi, Rin Sato +2Audio Representation LearningNeural Representation Geometry

    Keio University, Japan · The University of Tokyo, Japan · Waseda University, Japan

  36. Dissecting Sensitivity to Training Language in Self-Supervised Speech Learning Using Neural Audio Codec Tokens

    Jul 28, 2026Daigo Takizawa, Tomohiko Nakamura, Samuele Cornell +3Audio Representation LearningNeural Audio Codecs

    National Institute of Advanced Industrial Science and Technology (AIST), Japan · Carnegie Mellon University, USA

  37. Mind the Microphone Gap: Benchmarking Array Upsampling Strategies for Latent Acoustic Mapping

    Jul 27, 2026Philipp Schmidt, Huw Cheston, Juan Azcarreta +3Audio Representation LearningSelf-Supervised Learning

    Queen Mary University of London · Meta Reality Labs Research

  38. Phylogenetic signal in marine mammal and bird vocalizations captured by audio foundation models: the limited benefit of domain-specific pretraining

    Jul 24, 2026Víctor Rincón YepesAudio Representation LearningBioacoustics

    Independent Researcher

  39. Reflector: Arrangement-Aware Harmonic Retrieval for Sample-Based Composition

    Jul 24, 2026Austin RockmanAudio Representation LearningMusic Information Retrieval

    Independent Researcher

  40. Music-JEPA: Learning a World Model of Sound from Action

    Jul 24, 2026Ziyu Wang, Kun Fang, Yann LeCunAudio Representation LearningWorld Model Learning

    Courant Institute, New York University · Schulich School of Music, McGill University · Centre for Interdisciplinary Research in Music Media and Technology (CIRMMT) +2

  41. HARP: Harmonic-Aware Residual Partitioning for Neural Audio Codecs

    Jul 18, 2026Qiaoyu Yang, Lixing He, Binyue Deng +1Audio Representation LearningNeural Audio Codecs

    Georgia Institute of Technology, Atlanta, United States · The Chinese University of Hong Kong, Hong Kong, China · Tencent Music Entertainment, Shenzhen, China

  42. StemFX: Learning Mixing Style Representations via Autoregressive FX Chain Prediction on Source-Separated Stems

    Jul 17, 2026Yuan-Chiao Cheng, Jui-Te Wu, Brian Chen +3Audio Representation Learning

    Independent Researcher · National Taiwan University, Taiwan · AI-CoRE, National Taiwan University, Taiwan

  43. Can Tokens Compete? Token Representations against Supervised CNN Backbones for BirdCLEF+ 2026

    Jul 16, 2026Anthony Miyaguchi, Murilo Gustineli, Adrian CheungAudio Representation LearningNeural Audio Codecs

    Georgia Institute of Technology, 225 North Ave NW, Atlanta, GA 30332 · 1Georgia Institute of Technology, 225 North Ave NW, Atlanta, GA 30332

  44. ReGen: Hierarchical Multi-Prompt Representation Generation for Efficient Waveform Diffusion Models

    Jul 10, 2026Sang-Hoon Lee, Ha-Yeong ChoiAudio Representation LearningLatent Diffusion Models

    Department of Artificial Intelligence, Ajou University, Suwon, Korea · KT Corp., Seoul, Korea

  45. Structural Bottlenecks on Frequency Representation in End-to-End Audio Models

    Jul 9, 2026Nicole Cosme-CliffordAudio Representation LearningNeural Audio Codecs

    Yale University New Haven, CT

  46. Escaping the Procrustean Bed: Groupwise Orthogonal Connectors for Audio-Language Models

    Jul 7, 2026Ho-Lam Chung, Ke-Han Lu, Yi-Cheng Lin +3Audio Representation LearningRepresentation Learning

    Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan · ASUS AICS, Taipei, Taiwan

  47. A Self-Supervised Approach for Minimal-Annotation Hydroacoustic Data Exploration

    Jul 7, 2026Pierre-Yves Raumer, Axel Marmoret, Dorian Cazau +6Audio Representation LearningSelf-Supervised Learning

    Laboratoire de G´eologie, Ecole Normale Sup´erieure/CNRS UMR 8538, PSL Research University, Paris 75005, France · Universit´e de Brest, CNRS, Ifremer, UMR6538 Geo-Ocean, 29280 Plouzan´e, France · Lab-STICC – UMR 6285 CNRS, ENSTA IP Paris, Brest, France +5

  48. Streaming Neural Speech Codecs through Time-Invariant Representations

    Jul 6, 2026Kélian Estève, Salima Mhdaffar, Mickael Rouvier +2Audio Representation LearningNeural Audio Codecs

    LIA, Avignon Universit´e, France · LS2N, Nantes Universit´e, France

  49. CARD: Cross-component Audio Representation Distillation for Encoder-Free Audio Captioning

    Jul 6, 2026Ganesh Pavan Kartikeya Bharadwaj Kolluri, Yuchen Zhang, Michael Kampouridis +1Audio Representation LearningAudio-Language Models

    School of Computer Science and Electronic Engineering, University of Essex · Institute for Analytics and Data Science, University of Essex

  50. Doppelganger: Sound Effects and Their Synthetic Twins

    Jul 5, 2026Elliott AshAudio Representation LearningAudio Deepfake Detection

    ETH Zürich

  51. Probing Low-Level Acoustic Attribute Encoding in CLAP Audio Embeddings

    Jul 4, 2026Héctor Martel, Joe Hennessy-Priest, Taemin ChoRepresentation GeometryAudio Representation Learning

    BandLab Technologies, Singapore

  52. Taste-aware music retrieval from audio embeddings

    Jul 3, 2026Matteo Spanio, Antonio RodàAudio Representation LearningCross-Modal Retrieval

    University of Padua, Padua, Italy

  53. Quantifying the Uncertainty of Blindly Estimated Room Embeddings Using a Dispersion-Calibrated Score

    Jul 1, 2026Yang Xiang, Philipp Götz, Emanuël A. P. Habets +3Audio Representation LearningRepresentation Learning

    Centre for Vision Speech and Signal Processing, University of Surrey, United Kingdom · International Audio Laboratories Erlangen∗, Erlangen, Germany · Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany

  54. Evaluating Pretrained Music Embeddings for Cross-Performance Jazz Standard Recognition

    Jul 1, 2026Çağrı EserAudio Representation LearningMusic Information Retrieval

    Department of Computer Engineering, Middle East Technical University, Ankara, Turkey.

  55. BEST-RQ-2: Contextualize-Then-Predict, a Two-Step Approach for Self-Supervised Audio Representations

    Jun 29, 2026Ludovic K. Tuncay, Etienne Labbé, Thomas PellegriniAudio Representation LearningSelf-Supervised Pre-Training

    IRIT-SAMoVA · IRIT, Université de Toulouse, CNRS, Toulouse INP, Toulouse, France

  56. ALM2Vec: Learning Audio Embeddings for Universal Audio Retrieval with Large Audio-Language Models

    Jun 27, 2026Fengjie Lu, Chenang Jiang, Jiarui Hai +2Audio Representation LearningAudio-Language Models

    Zhejiang University · Johns Hopkins University

  57. From General-Purpose Audio Tagging to Spatially Grounded Sound Event Localization and Detection

    Jun 26, 2026Stefano Giacomelli, Stefano Damiano, Claudia Rinaldi +2Audio Representation LearningDirection-of-Arrival Estimation

    DISIM Department, University of L’Aquila, Italy · ESAT Department, KU Leuven, Belgium · CNIT, Research Unit of L’Aquila, Italy +1

  58. wav2tok 2.0: Scalable Audio Tokenization Maintaining Explicit Pairwise Token Alignment for Efficient Audio Retrieval

    Jun 25, 2026Adhiraj Banerjee, Vipul AroraAudio Representation LearningSpeech Processing

    Department of Electrical Engineering, Indian Institute of Technology Kanpur, India · Department of Electrical Engineering, KU Leuven, Belgium

  59. WQ-Fusion: Dynamic Gated Attention for Cross-Domain Audio Representation

    Jun 25, 2026Mingda Lin, Lei Ding, Xinyue Zhou +6Audio Representation LearningGated Attention

    School of Electronic Information, Wuhan University, Wuhan, Hubei, China · Tencent AI Lab Seattle, Seattle, USA · CIAIC, Northwestern Polytechnical University, Xi’an, Shaanxi, China +1

  60. Frequency-Aware Self-Supervised Music Representation Learning

    Jun 24, 2026Yicheng Gu, Junan Zhang, Jerry Li +2Audio Representation LearningFrequency-Domain Feature Learning

    Spellbrush, Akihabara, Tokyo 101-0021, Japan · Acoustic Lab, Department of Information and Communications Engineering (DICE), Aalto University, Espoo 02150, Finland · School of Data Science, The Chinese University of Hong Kong, Shenzhen, Guangdong 518172, China