Speech Encoder

Ask about this topic

Recent momentum

-70%

3 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Speech Large Language Models

Neighbouring directions

Automatic Speech Recognition SystemsSpeech Large Language ModelsMultilingual Automatic Speech RecognitionLibrispeechSpeech-LlmsLlm-Based Automatic Speech Recognition

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

3 new papers

A weekly snapshot of new work published in Speech Encoder.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Speech Encoder.

Period ending 2026-09-07

1 new paper

A weekly snapshot of new work published in Speech Encoder.

45 papers

Latest in Speech Encoder

Browse all topics →
CardsList

  1. A Probe Shift Is Not a Fairness Fix: The Limits of Representation Steering in Speech Models

    Sep 16, 2026Nicolas Bourrel, Abderrahmane Issam, Gerasimos SpanakisSpeaker AttributesSpeech Encoder

  2. Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMs

    Sep 16, 2026Mohan Shi, Zilai Wang, Natarajan Balaji Shankar +3Speech EncoderLibrispeech

  3. Kraken: LLM-based Speech-to-Speech Translation via Low-bitrate VQ and Dual-path Source Conditioning

    Sep 14, 2026Hayato Futami, Hassan Shahmohammadi, Tushar Dhyani +5Speech TranslationSpeech Encoder

  4. CASA: Content-Acoustic Speaking Assessment with Speech Encoder and Large Language Model

    Aug 13, 2026Nhan Phan, Ilona Lähteenmäki, Anna von Zansen +4Speech EncoderHouseholds

  5. Confucius4-TTS: Transcript-Free Cross-Lingual Zero-Shot TTS with a Learnable Speaker Encoder

    Aug 12, 2026Huaxuan Wang, Huimin Wang, Ruiyu Zhang +2Cross-Lingual Voice CloningZero-Shot Text-To-Speech

  6. Robust Multi-Tier Infant-Centered Audio Understanding with Whisper via Structured Speaker Conditioning

    Aug 12, 2026Xulin Fan, Jialu Li, Mohammad Nur Hossain Khan +4Audio RepresentationSpeech Encoder

  7. Qwen-MusicAVQA-7B: A Multimodal Model for Music Audio-Visual QA

    Aug 11, 2026Maryam DehdashtiAudio-Visual ReasoningAudio Representation

  8. Multi Codec Discrete Diffusion Model for Text Guided Speech Inpainting and Editing

    Aug 5, 2026Iftach Shoham, Tali Dror, Oren Gal +3Speech Encoder

  9. Breaking the Curse of Multilinguality in Many-to-Many Speech-to-Text Translation via a Resource-Aware Mixture of Speech Encoders

    Aug 5, 2026Yexing Du, Kaiyuan Liu, Youcheng Pan +4Simultaneous Speech TranslationSpeech Translation

  10. MERaLiON-GR: Speech Gender Recognition Model for English and SEA Languages

    Aug 5, 2026Qiongqiong Wang, Ai Ti Aw, Nancy F. Chen +18Speech EncoderText Corpora

  11. Analyzing Speech Condition Effects in Dysarthric ASR: A Layer-wise Probing Study

    Aug 3, 2026Darwin Jelestin Muthu, Navya Gupta, Wei Lin Tay +3Dysarthric SpeechSpeech Encoder

  12. Teffic-Audio: Tell Fact from Fiction

    Jul 30, 2026Wan Lin, Li Wang, Jindong Wang +2Audio Deepfake DetectionExplainable Deepfake Detection

  13. SpeechLLM Meets Federated Learning for End-to-End ASR: English and Italian Case Studies

    Jul 28, 2026Mohamed Nabih Ali, Daniele Falavigna, Alessio BruttiSpeech Large Language ModelsSpeech Encoder

  14. MEUSLI: a Multilingual Projector for LLM-based ASR and Beyond

    Jul 24, 2026Lorenzo Concina, Seraphina Fong, Marco Matassoni +1Multilingual Automatic Speech RecognitionLlm-Based Automatic Speech Recognition

  15. Do Speech Tokens Leak Voiceprints? Speaker Inversion Attacks Against End-to-End Speech Language Models

    Jul 18, 2026Ye Lu, Yihan Yan, Zhaoyang Zhang +4Speech EncoderFingerprint

  16. A Geometry-Limited Identification Floor and Its Consequences for Voice-Clone Attribution in Professional Voice Actors

    Jul 17, 2026Shuhei KatoCross-Lingual Voice CloningSpeaker Verification Performance

  17. Audio-Native Speech Recognition with a Frozen Discrete-Diffusion Language Model

    Jul 14, 2026Harsha Vardhan Khurdula, Abhinav Kumar Singh, Yoeven D Khemlani +1Speech EncoderLibrispeech

  18. Flow Matching-Based Speech Source Separation with Best-of-N Biometric Sampling

    Jul 7, 2026Anastasia Zorkina, Alexandr Anikin, Nikita Khmelev +5Speech SeparationSpeech Encoder

  19. Escaping the Procrustean Bed: Groupwise Orthogonal Connectors for Audio-Language Models

    Jul 7, 2026Ho-Lam Chung, Ke-Han Lu, Yi-Cheng Lin +3Speech EncoderOrthogonality

  20. NAVER LABS System Re-implementation for the IWSLT 2026 Instruction-Following Task

    Jul 6, 2026Anand Kamble, Aniket TatheSpeech EncoderInstruction

  21. H-SAGE: Holistic Speaker-Aware Guided Experts for MoE-based Multi-Talker ASR

    Jul 2, 2026Yujie Guo, Jiaming Zhou, Yuhang Jia +2Automatic Speech Recognition SystemsSpeech Encoder

  22. LOPA: Enhancing Spoken Language Assessment via Latent Ordinal Prototype Alignment

    Jun 30, 2026Hong-Yun Lin, Fu-An Chao, Bi-Cheng Yan +1Speech EncoderLatent Representation Alignment

  23. Does Translation-Enhanced Speech Encoder Pre-training Affect Speech LLMs?

    Jun 24, 2026Tomoya Mizumoto, Yusuke FujitaSpeech EncoderSpeech Translation

  24. Data Scale, Not Latency, Shapes Cross-Lingual Encoder Transfer in Streaming ASR

    Jun 23, 2026Nenad BanficSpeech EncoderEncoders

  25. Adaptive Speech-to-Spike Encoding for Spiking Neural Networks

    Jun 17, 2026Taharim Rahman Anon, Jakaria Islam EmonSpiking Neural NetworksSpeech Encoder

  26. CraBERT: Efficient Phoneme Encoder Pre-Training via Cascade Fusion of Subword Representations for Text-to-Speech

    Jun 15, 2026Dong Yang, Yuki Saito, Wataru Nakata +1Speech EncoderSubword Tokenization

  27. SARA: A Dual-Stream VAE for High-Fidelity Speech Generation via Integrating Semantic and Acoustic Representations

    Jun 10, 2026Peijie Chen, Wenhao Guan, Weijie Wu +7Zero-Shot Text-To-SpeechSpeech Encoder

  28. Gumbel-BEARD: Automatic Layer Selection for Self-Supervised Adaptation of Whisper in Low-Resource Domains

    Jun 9, 2026Zilai Wang, Natarajan Balaji Shankar, Mohan Shi +2Speech EncoderDomain Adaptation

  29. AuRA: Internalizing Audio Understanding into LLMs as LoRA

    Jun 9, 2026Bo Cheng, Lei Shi, Zhanyu Ma +5Speech Large Language ModelsSpeech Encoder

  30. Speech Meets ELF: Audio Conditional Continuous-Target Diffusion for Speech Recognition and Translation

    Jun 9, 2026Xuanchen Li, Tianrui Wang, Yuheng Lu +11Speech EncoderAudio

  31. FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognition

    Jun 4, 2026Fernando López, Santosh Kesiraju, Jordi LuqueSpeech EncoderSpeech Large Language Models

  32. Echo: A Joint-Embedding Predictive Architecture for Speaker Diarization and Speech Recognition in a Shared Latent Space

    Jun 1, 2026Louis MouchonSpeaker DiarizationSpeech Encoder

  33. Thaka at KSAA-2026 Task 2: Regularized Fine-Tuning for Arabic Speech Diacritization

    May 25, 2026Meshal Alamr, Hassan Alqaeri, Abdullah AldahlawiSpeech EncoderArabic Natural Language Processing

  34. Frame-Aligned Fusion of Canary and WavLM for Non-Intrusive Intelligibility Prediction of Hearing-Aid-Processed Speech

    May 22, 2026Kazushi NakazawaSpeaker RecognitionSpeech Encoder

  35. Word-Level Modeling with Alignment-Aware Acoustic Fusion for Text-Assisted Intelligibility Prediction in Listeners with Hearing Loss

    May 22, 2026Kazushi NakazawaSpeaker RecognitionSpeech Encoder

  36. Optimising Neural Speech Codecs for 300bps Communication using Reinforcement Learning

    May 19, 2026Junyi Wang, Chi Zhang, Jing Qian +4Neural Audio CodecsUltra-Low Bitrates

  37. A Semi-Supervised Framework for Speech Confidence Detection using Whisper

    May 12, 2026Adam Wynn, Jingyun WangSpeaker RecognitionSpeaker Attributes

  38. Mechanistic Interpretability of ASR models using Sparse Autoencoders

    May 12, 2026Dan Pluth, Zachary Nicholas Houghton, Yu Zhou +1Llm-Based Automatic Speech RecognitionSpeech Encoder

  39. WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modeling

    May 7, 2026Guanrou Yang, Tian Tan, Qian Chen +12Discrete Speech RepresentationsSpeech Encoder

  40. Minimizing Modality Gap from the Input Side: Your Speech LLM Can Be a Prosody-Aware Text LLM

    May 7, 2026Wenqian Cui, Xiao-Hui Li, Daxin Tan +2Speech Large Language ModelsSpeech Encoder

  41. LASE: Language-Adversarial Speaker Encoding for Indic Cross-Script Identity Preservation

    May 1, 2026Venkata Pushpak Teja MentaCross-Lingual Voice CloningSpeech Encoder

  42. Identifying and typifying demographic unfairness in phoneme-level embeddings of self-supervised speech recognition models

    Apr 24, 2026Felix Herron, Solange Rossato, Alexandre Allauzen +1Phoneme-Level AnalysisSelf-Supervised Speech Models

  43. ClariCodec: Optimising Neural Speech Codes for 200bps Communication using Reinforcement Learning

    Apr 16, 2026Junyi Wang, Chi Zhang, Jing Qian +4Neural Audio CodecsUltra-Low Bitrates

  44. Do Modern Video-LLMs Need to Listen? A Benchmark Audit and Scalable Remedy

    Sep 22, 2025Geewook Kim, Minjoon SeoAudio-Visual ReasoningVision Encoders

  45. Kronecker Factorization Improves Efficiency and Interpretability of Sparse Autoencoders

    May 28, 2025Vadim Kurochkin, Yaroslav Aksenov, Daniil Laptev +2Model ActivationsSpeech Encoder