Audio Tokenizers

Ask about this topic

Momentum

6 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 36

All topics
CardsList

  1. Q-SPT: Learnable Query-Based Compression for Low-Frame-Rate Speech Tokenization

    Oct 1, 2026Jeeyoung Yun, Seohwan Yun, Sungwoong KimNeural Speech CodecsAudio Tokenizers

    Korea University, Seoul, Republic of Korea

  2. Multi-Rate Bandwidth Extension by Token Completion in Neural Audio Codecs

    Sep 29, 2026Benoît Ginies, Olivier Fercoq, Gaël RichardNeural Audio CodecsAudio Tokenizers

    LTCI, Télécom Paris, Institut Polytechnique de Paris, Palaiseau, France

  3. UNITE-AUDIO: Joint Learning of Continuous Tokenization and Latent Flow Matching for Text-to-Audio Generation

    Sep 23, 2026Runwu Shi, Kai Li, Yujin Wang +8Modern Generative Audio ModelsAudio Tokenizers

    Institute of Science Tokyo · Tsinghua University · Wuhan University +2

  4. Listen, Critique, and Refine: RL-Based Self-Refinement for Instruction-Following Speech Synthesis

    Sep 21, 2026Chee-En Yu, Yi-Cheng Lin, Sung-Feng Huang +4Speech SynthesisLarge Audio Language Models

    Graduate Institute of Electrical Engineering, National Taiwan University, Taiwan · Graduate Institute of Communication Engineering, National Taiwan University, Taiwan · NVIDIA Research 4 Artificial Intelligence Center of Research Excellence, National Taiwan University, Taiwan

  5. TokenMapper: A Step Toward Interoperable Speech Token Translation

    Sep 14, 2026Tal Kozakov, Tal Rosenwein, Eliya NachmaniAudio TokenizersSpeech Translation

    Department of Electrical and Computer Engineering, Ben-Gurion University of the Negev

  6. StepAudio 3 Gen Technical Report

    Sep 14, 2026Bin Lin, Bo Zhao, Boyang Wang +68Modern Generative Audio ModelsAcoustic Latent Space

  7. Stride-k Subsampling: Train-Free Audio Token Reduction for Whisper

    Aug 31, 2026Chanhee Cho, Junhyuk Choi, Bugeun KimAudio TokenizersSubsampling

    Department of Artificial Intelligence Chung-Ang University, Seoul, Republic of Korea

  8. Phoenix TTS: High-Fidelity Synthesis and Voice Conversion via Flow-Matching-Driven Speech Tokenization

    Aug 12, 2026Peijie Chen, Zhuanling Zha, Zhipeng Nie +8Flow-Matching Text-To-SpeechAudio Tokenizers

    Didichuxing Co. Ltd

  9. Pitch Contour Tokenization using VQ-VAE and Its Application on Korean Traditional Music Analysis

    Aug 11, 2026Seonguk Ju, Seola Cho, Sooin Chung +2Audio TokenizersVector-Quantized Variational Autoencoder

    Music & Arts Learning (MALer) Lab, Sogang University, South Korea · Graduate School of Culture Technology, KAIST, South Korea

  10. VoxZip: Semantic-Anchored Temporal KV Cache Compression for Long-Context Audio Inference

    Aug 9, 2026Wenxu Jia, Dongjie Fu, Xize Cheng +6Key-Value Cache CompressionAudio Tokenizers

    1Zhejiang University · 2Meituan

  11. Agogic: Performance-Timed Music Tokens for LLM-Native Text-to-Symbolic-Music Generation

    Aug 4, 2026Junhao Chen, Mingjin Chen, Jingjia Mao +12Text-To-MusicAudio Tokenizers

    Tsinghua University · The Hong Kong Polytechnic University · Beijing Technology and Business University +7

  12. Allocation Before Ranking: Decoupled Token Compression for OmniLLMs

    Aug 3, 2026Zhenghui Guo, Yilin Yang, Yuanbin Man +5Token CompressionData Compression Methods

    Department of Computer Science, University of Houston · Department of Computer Science and Engineering, The University of Texas at Arlington

  13. OmniDelta: Skill-Driven Budget Allocation for Token Compression in OmniLLMs

    Jul 28, 2026Haoyang Huang, Wenjie Huang, Tianqi Xu +14Token CompressionAudio Tokenizers

    Zhejiang University · Qwen Application, Alibaba · Carnegie Mellon University +2

  14. From Semantics to Readout: Mechanistic Understanding of Audio Tokens after Fine-Tuning for Temporal Audio Grounding

    Jul 28, 2026Yujian Ma, Jinqiu Sang, Ruizhe Li +2Large Audio Language ModelsAudio Tokenizers

    1Shanghai Institute of Artificial Intelligence for Education, East China Normal University, China · School of Computer Science and Technology, East China Normal University, China · School of Computer Science, University of Birmingham, UK +1

  15. Content is What Remains: Invariant Speech Tokenization from Parallel Utterances

    Jul 21, 2026Laurin Wagner, Bernhard Thallinger, Miroslav Stankovic +1Audio TokenizersSpeaker

    nyra labs · nyra labs, Austria

  16. Qwen-Music Technical Report

    Jul 13, 2026Jin Xu, Kangdi Wang, Ruibin Yuan +24Dance-To-Music GenerationAudio Tokenizers

    Qwen Team

  17. GigaChat Audio: Time-aware Large Audio Language Model

    Jul 11, 2026Aleksandr Kutsakov, Mariia Sadovina, Georgii Gospodinov +4Large Audio Language ModelsText-To-Audio

    SaluteDevices, Russia

  18. Event-Based Token Sequences for Audio-Conditioned Music-Game Level Modeling

    Jul 10, 2026Ke Zhang, Chu-Hsuan Hsueh, Kokolo IkedaSymbolic Music GenerationAudio Tokenizers

    Japan Advanced Institute of Science and Technology

  19. TokAN: Accent Normalization Using Self-Supervised Speech Tokens

    Jul 4, 2026Qibing Bai, Shuai Wang, Yuhan Du +3Audio TokenizersSelf-Supervised Speech Models

    School of Data Science (SDS), The Chinese University of Hong Kong, Shenzhen (CUHKSZ), China · Tencent Ethereal Audio Lab, Tencent, Shenzhen, China · School of Intelligence Science and Technology, Nanjing University, Suzhou, China +4

  20. AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation

    Jun 29, 2026Kien T. Pham, I Chieh Chen, Qifeng Chen +1Audio-Video GenerationAudio Tokenizers

    The Hong Kong University of Science and Technology

  21. wav2tok 2.0: Scalable Audio Tokenization Maintaining Explicit Pairwise Token Alignment for Efficient Audio Retrieval

    Jun 25, 2026Adhiraj Banerjee, Vipul AroraAudio TokenizersDiscrete Speech Representations

    Department of Electrical Engineering, Indian Institute of Technology Kanpur, India · Department of Electrical Engineering, KU Leuven, Belgium

  22. Self-Guidance: Enhancing Neural Codecs via Decoder Manifold Alignment

    Jun 11, 2026Xiang Li, Yixuan Zhou, Jingran Xie +2Neural Speech CodecsNeural Codecs

    Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Pengcheng Laboratory, Shenzhen, China

  23. Acoustic Cue Alignment in Audio Language Models for Speech Emotion Recognition

    Jun 5, 2026Iosif Tsangko, Andreas Triantafyllopoulos, Björn W. SchullerAudio TokenizersEmotion Recognition

    CHI – Chair of Health Informatics, TUM University Hospital, Munich, Germany · MCML – Munich Center for Machine Learning, Munich, Germany · MDSI – Munich Data Science Institute, Munich, Germany +1

  24. F3-Tokenizer: Taming Audio Autoencoder Latents for Understanding and Generation

    Jun 4, 2026Dinghao Zhou, Xingchen Song, Di Wu +3Audio TokenizersNeural Audio

    2WeNet Open Source Community · ∗Equal contribution · 1Nanjing University, China

  25. CleanCodec: Efficient and Robust Speech Tokenization via Perceptually Guided Encoding

    Jun 3, 2026Eugene Kwek, Feng Liu, Rui Zhang +1Audio TokenizersInformation Bottleneck

    Pennsylvania State University · Drexel University

  26. EntangleCodec: A Unified Discrete Audio Tokenizer via Semantic-Acoustic Entanglement

    Jun 1, 2026Hui Li, Yangfan Gao, Junlin Shang +4Audio TokenizersAcoustic Latent Space

    Fudan University

  27. Wavelet as Tokenizer: Preliminary Results on a Shared Wavelet Token Schema for Natural Signals

    May 30, 2026Shenghao DingAudio TokenizersWavelets

    Yet Another AI

  28. UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception

    May 29, 2026Yuhan Song, Linhao Zhang, Aiwei Liu +6Audio TokenizersAcoustic Latent Space

    State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University · Basic Model Technology Center, WeChat AI, Tencent Inc.

  29. HoliTok:A Coutinuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding

    May 28, 2026Bohan Li, Shi Lian, Hankun Wang +6Audio TokenizersTokenizer

    X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University, China · hi lab, Xiaohongshu Inc, China

  30. LoSATok: Low-dimensional Semantic-Acoustic Tokenizer for Cross-Domain Audio Understanding and Generation

    May 27, 2026Zhisheng Zhang, Xiang Li, Yixuan Zhou +3Audio TokenizersAudio Understanding

    1Shenzhen International Graduate School, Tsinghua University, China · *Work conducted while interning at ModelBest. · 2ModelBest Inc., China

  31. Modeling Music as a Time-Frequency Image: A 2D Tokenizer for Music Generation

    May 15, 2026Yuqing Cheng, Xingyu Ma, Guochen Yu +1Audio Tokenizers

    Department of Music AI and Information Technology, Central Conservatory of Music, Beijing, China · Zhipu AI, Beijing, China

  32. Exploring Token-Space Manipulation in Latent Audio Tokenizers

    May 11, 2026Francesco Paissan, Luca Della Libera, Mirco Ravanelli +1Audio TokenizersNeural Audio Codecs

    1Mila – Québec AI Institute · 2Université Laval · 3Concordia University

  33. PairAlign: A Framework for Sequence Tokenization via Self-Alignment with Applications to Audio Tokenization

    May 7, 2026Adhiraj Banerjee, Vipul AroraAudio TokenizersAutoregressive Token Prediction

    Department of Electrical Engineering Indian Institute of Technology, Kanpur

  34. BEAT: Tokenizing and Generating Symbolic Music by Uniform Temporal Steps

    Apr 21, 2026Lekai Qian, Haoyu Gu, Jingwei Zhao +1Symbolic Music GenerationAudio Tokenizers

    South China University of Technology · National University of Singapore · Mohamed bin Zayed University of Artificial Intelligence +1

  35. Speech Codec Probing from Semantic and Phonetic Perspectives

    Mar 11, 2026Xuan Shi, Chang Zeng, Tiantian Feng +3Audio TokenizersNeural Speech Codecs

    University of Southern California, USA · Dolby Laboratories, USA

  36. Harmonic-Percussive Disentangled Neural Audio Codec for Bandwidth Extension

    Nov 26, 2025Benoît Giniès, Xiaoyu Bie, Olivier Fercoq +1Neural Audio CodecsAudio Tokenizers

    LTCI, Télécom Paris, Institut Polytechnique de Paris Palaiseau, France