Audio-Text Alignment

Ask about this topic

Latest papers

CardsList

22 papers6 papers in the last four weeks, up 50% on the four weeks before. 0.0% of all new papers.

  1. Text-to-music Generation via Structured Captions AND Interpretable Evaluation

    Oct 31, 2026Junkai Wu, Zhepei Wang, Ge Zhu +3Text-to-Music GenerationAudio-Text Alignment

    University of Washington · Adobe Research

  2. MQAScore: Fine-Grained Text-Music Alignment Evaluation via Large Audio Language Model

    Oct 22, 2026Wei-Jaw Lee, Chun-Ping Wang, Xuanjun Chen +1Audio-Text AlignmentAutomated Evaluation

    GICE, National Taiwan University · AI-CoRE, National Taiwan University · Taiwan AILabs

  3. AT-Differ: Dataset for Audio-Text Difference Captioning

    Oct 21, 2026Akihiro Fujii, Yuki Okamoto, Yuki Saito +1Audio-Text AlignmentAudio-Language Model Evaluation

    The University of Tokyo, Japan · National Institute of Advanced Industrial Science and Technology (AIST), Japan

  4. KunSet: A Corpus and Benchmark for Lyrics Alignment and Rhyme Retrieval in Kunqu Opera

    Oct 21, 2026Lejun Min, Siqi Chen, Delong Wang +10Music Information RetrievalAudio-Text Alignment

    Stanford University · Peking University · University of California San Diego +3

  5. Uncovering Audio-Text Alignment in Large Audio-Language Models through Cross-Modal Concept Neurons

    Oct 20, 2026Tzu-Quan Lin, Chih-Kai Yang, Yi-Cheng Lin +2Audio-Text AlignmentAudio-Language Models

    Centre for Speech Technology Research, University of Edinburgh, United Kingdom · Graduate Institute of Communication Engineering, National Taiwan University, Taiwan · NTU Artificial Intelligence Center of Research Excellence (NTU AI-CoRE), Taiwan

  6. Where Words Begin and End

    Oct 13, 2026Husein ZolkepliForced AlignmentAudio-Text Alignment

    Scicom (MSC) Berhad, Malaysia

  7. FuseAlign: Forced Alignment in the Wild

    Sep 27, 2026Mithilesh Vaidya, Stephen Bailey, Sumukh Badam +2Forced AlignmentAudio-Text Alignment

    Descript, Inc.

  8. Do Audio Language Models Hear and Read Distinctive Features Alike?

    Sep 24, 2026Yuanhao Chen, Peter ChinAudio-Text AlignmentAudio-Language Models

    Thayer School of Engineering, Dartmouth College, Hanover, NH, USA

  9. Scaling Forced Alignment to End-User Devices

    Sep 17, 2026Lawry Sorenson, Michael Crandall, Eric K. Ringger +1Forced AlignmentAudio-Text Alignment

    Brigham Young University Computer Science Department Provo, UT, United States

  10. Semantic Refinement of Universal Audio Representations through Audio-Description Alignment

    Sep 8, 2026Lejun Min, Junyu Dai, Ruichen Zheng +7Audio-Text AlignmentAudio Representation Learning

    1Alibaba Token Foundry

  11. Alignment Drift in Single-Model Speculative Decoding for ASR: Mechanism, Correction, and Cost

    Aug 13, 2026Xinyu Wang, Huapeng Zhou, Ziyu Zhao +5Audio-Text AlignmentSpeculative Decoding

    1Boson AI · 2McGill University

  12. Fusion Embedding: A Unified Embedding Space for Text, Image, Video, and Audio

    Jul 21, 2026Abdul Basit Tonmoy, Kazi Fardinul Hoque, Md. Shahrier Islam Arham +1Audio-Text AlignmentVLM Adaptation

    1Eximius Labs · 2Wabash College · 3Skop Intelligence Co.

  13. Gradient-Based Speech-to-Text Alignment for Any ASR Model: From CTC to Speech LLMs

    Jul 7, 2026Albert Zeyer, Ralf Schlüter, Hermann NeyGradient-Based AttributionSpeech Processing

    Machine Learning and Human Language Technology Group, RWTH Aachen University, Aachen, Germany · AppTek GmbH, Aachen, Germany

  14. Progressive Alignment Objectives for Aligner-Encoder based ASR

    Jun 23, 2026Jaeyoung Lee, Masato Mimura, Takafumi MoriyaAutomatic Speech RecognitionSequence Alignment

    NTT, Inc., Japan

  15. MixProLAP: Mixture-Induced Uncertainty Modeling for Probabilistic Language-Audio Pretraining

    Jun 18, 2026Yu Nakagome, Jaesong Lee, Soo-Whan ChungAudio-Text AlignmentMultimodal Pretraining

    LINE WORKS Corporation, Japan · NAVER Cloud Corporation, South Korea

  16. ELSA: Acoustic Event-Level Semantic Alignment for Fine-Grained Reference-Free Text-to-Audio Evaluation

    Jun 16, 2026Shuntaro Suzuki, Kento Tokura, Daichi Yashima +3Text-to-Audio GenerationAutomated Evaluation

    Keio University, Japan

  17. Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generation

    Jun 5, 2026Yun-Chen Cheng, Tzu-Hung Huang, Chih-Pin TanText-to-Music GenerationAudio-Text Alignment

    Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan

  18. Bridging Traditional Explainability Methods and Multimodal Multilingual Models: An XAI-Based Analysis

    Apr 21, 2026Paweł Pozorski, Jakub Muszyński, Maria GanzhaAudio-Text AlignmentMultimodal Large Language Models

    student record book number 327304 · student record book number 327246 · thesis supervisor

  19. TASU2: Controllable CTC Simulation for Alignment and Low-Resource Adaptation of Speech LLMs

    Apr 9, 2026Jing Peng, Chenghao Wang, Yi Yang +5Connectionist Temporal ClassificationSpeech Language Models

    Jiangsu Key Lab of Language Computing · AISpeech Ltd, Suzhou, China · Nanjing University, China

  20. Woosh: A Sound Effects Foundation Model

    Apr 2, 2026Gaëtan Hadjeres, Marc Ferras, Khaled Koutini +7Audio-Text AlignmentSound Effects Generation

    Sony AI · Sony Group Corporation

  21. Patient-Level Multimodal Question Answering from Multi-Site Auscultation Recordings

    Mar 9, 2026Fan Wu, Tsai-Ning Wang, Nicolas Zumarraga +8Audio-Text AlignmentClinical QA

    Agentic Systems Lab, ETH Zurich Switzerland · Eindhoven University of Technology Netherlands · Centre for Digital Health Interventions, ETH Zurich +2

  22. Adaptive Duration Model for Text Speech Alignment

    Jul 30, 2025Junjie CaoAudio-Text AlignmentTTS Synthesis

    Tsinghua Shenzhen International Graduate School, Tsinghua University