Speech Processing

Follow this topic Ask about this topic

Momentum

48 papers in the last four weeks, up 433% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 295

All topics

TargetSEC: Plug-and-Play In-the-Wild Speech Emotion Conversion via Arousal-Conditioned Latent Style Diffusion
Jun 5, 2026Constantin Alexander AugaLatent Diffusion Models Audio Diffusion Models
Hasso Plattner Institute / University of Potsdam, Potsdam, Germany
A Large-Scale Per-Speaker Analysis of Re-identification Risk in Speech Anonymization
Jun 5, 2026Orane Dufour, Paul Magron, Mickael Rouvier +1Privacy Auditing Speech Processing
Université de Lorraine, CNRS, Inria, LORIA, F-54000 Nancy, France · LIA, Avignon University, F-84911 Avignon, France
Phonetic Error Analysis of Raw Waveform Acoustic Models
Jun 5, 2026Erfan Loweimi, Zhengjun Yue, Andrea Carmantini +3ASR Evaluation Speech Processing
Centre for Speech Technology Research (CSTR), University of Edinburgh, UK · SLAI & CUHK-SZ, China · King’s College London, UK
Multilingual Multi-Speaker Unit Vocoders: A Systematic Analysis of Discrete Speech Representations
Jun 4, 2026Naman Kothari, Arjun Gangwar, Adarsh Arigala +1TTS Synthesis Speech Processing
National Institute of Technology, Trichy · Indian Institute of Technology, Madras
Revisiting Lexicon Evaluation in Unsupervised Word Discovery
Jun 4, 2026Simon Malan, Danel Slabbert, Herman KamperUnsupervised Clustering Speech Processing
Electrical and Electronic Engineering Stellenbosch University, South Africa
SpeechJBB: Probing Safety Alignment and Comprehension in Large Audio Language Models under Code-Switched Speech
Jun 4, 2026Virginia Ceccatelli, Yejin Jeon, David Ifeoluwa AdelaniAudio-Language Model Evaluation Language Model Safety Evaluation
Mila - Quebec AI Institute · McGill University, Canada · Canada CIFAR AI Chair
Do speech foundation models perceive speaker similarity as humans do?
Jun 4, 2026Minoru Kishi, Hayato Yagi, Shinnosuke Takamichi +1Audio Representation Learning Speech Foundation Models
Keio University, Japan · The University of Tokyo, Japan
Domain-Aware Mispronunciation Detection and Diagnosis Using Language-Specific Statistical Graphs
Jun 4, 2026Huu Tuong Tu, Hanh Nguyen, Thien Van Luong +3Speech Processing
1Hanoi University of Science and Technology · 2VNPT AI, VNPT Group · 3National Economics University
Multilingual Detection of Alzheimer's Disease from Speech: A Cross-Linguistic Transfer Learning Approach
Jun 4, 2026Nadine Yasser Abdelhalim, Emmanuel Akinrintoyo, Nicole SalomonsSpeech-Based Dementia Detection Speech Processing
Department of Computing, Imperial College London, United Kingdom
CleanCodec: Efficient and Robust Speech Tokenization via Perceptually Guided Encoding
Jun 3, 2026Eugene Kwek, Feng Liu, Rui Zhang +1Audio Token Compression Audio Representation Learning
Pennsylvania State University · Drexel University
Feasibility of Time-Domain DNN-Based Speech Enhancement on Embedded FPGA for Hearing Aid
Jun 2, 2026Feyisayo Olalere, Umut Altin, Kiki van der Heijden +1Efficient Neural Network Inference Speech Processing
Radboud University, Donders Institute for Brain, Cognition, and Behaviour, The Netherlands · Mortimer B. Zuckerman Mind, Brain, Behavior Institute, Columbia University, USA.
Echo: A Joint-Embedding Predictive Architecture for Speaker Diarization and Speech Recognition in a Shared Latent Space
Jun 1, 2026Louis MouchonAudio Representation Learning Joint-Embedding Predictive Architecture
Independent Research
Advancing Electrolaryngeal Speech Enhancement Through Speech-Text Representation Learning
Jun 1, 2026Ding Ma, Jinyi Mi, Fengji Li +5Representation Learning Speech Processing
Graduate School of Informatics, Nagoya University, Nagoya 464-8601, Japan · School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China · TARVO, Inc., Nagoya 460-0008, Japan +1
SpeechEditBench: A Bilingual Multi-Attribute Benchmark for Instruction-Guided Speech Editing
Jun 1, 2026Hanlin Zhang, Daxin Tan, Dehua Tao +3Audio-Language Model Evaluation Audio Editing
Department of Computer Science, City University of Hong Kong · AI Lab, Leibniz Research Center, Huawei
Context-aware child-directed speech detection from long-form recordings
May 31, 2026Théo Charlot, Tarek Kunze, Kaveri K. Sheth +2Speech Processing Audio Understanding
LSCP, DEC, ENS, EHESS, CNRS, PSL University, France · Laboratoire d’Informatique et Syst`emes, Universit´e Aix-Marseille, CNRS, France
MelT: A Portable, Single-GEMM Mel Audio Frontend via Non-Uniform DFT with Measured Latency and Energy Gains on GPUs
May 31, 2026Augusto Camargo, Marcelo FingerGPU Acceleration Speech Processing
Institute of Mathematics and Statistics (IME), University of São Paulo, São Paulo, Brazil
Local Diagnostics of Continuous Normalizing Flow for Out-of-Distribution Detection
May 30, 2026Xinwei Cao, Mengxuan Lu, Torbjørn Svendsen +1Speech Processing Distribution Shift Detection
Department of Electronic Systems Norwegian University of Science and Technology Trondheim, Norway · School of Future Technology South China University of Technology Guangzhou, China
Extracting accent features in spoken Brazilian Portuguese without sociolinguistic labels
May 28, 2026Pedro H. L. Leite, Pedro Benevenuto Valadares, Luiz W. P. BiscainhoAudio Representation Learning Speech Processing
PEE/COPPE, UFRJ, Rio de Janeiro-RJ · Faculdade de Engenharia Elétrica e Computação (FEEC), UNICAMP, Campinas-SP · DEL/Poli & PEE/COPPE, UFRJ, Rio de Janeiro-RJ
HoliTok:A Coutinuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding
May 28, 2026Bohan Li, Shi Lian, Hankun Wang +6Audio Representation Learning Speech Foundation Models
X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University, China · hi lab, Xiaohongshu Inc, China
ChildVox: A Speech, Audio, and Large Audio-Language Model Benchmark in Understanding and Characterizing Sound across Childhood
May 28, 2026Tiantian Feng, Anfeng Xu, Xuan Shi +10Audio-Language Model Evaluation Speech Quality Assessment
University of Southern California · The Ohio State University · University of California, Los Angeles +3
Bandwidth-Efficient and Privacy-Preserving Edge-Cloud Many-to-Many Speech Translation
May 27, 2026Yexing Du, Kaiyuan Liu, Youcheng Pan +4Speech Translation Speech Processing
Harbin Institute of Technology, Shenzhen, China · Pengcheng Laboratory, Shenzhen, China · Harbin Institute of Technology, Harbin, China
Do Audio LLMs Listen or Read? Analyzing and Mitigating Paralinguistic Failures with VoxParadox
May 26, 2026Jiacheng Pang, Ashutosh Chaubey, Mohammad SoleymaniAudio-Language Model Evaluation Speech Processing
Institute for Creative Technologies, University of Southern California, Los Angeles, USA
Beyond Binary: Speech Representations Across the Cognitive Score Hierarchy
May 26, 2026Serli Kopar, Roshan Prakash Rane, Christian Mychajliw +6Speech Processing Audio Understanding
Hertie Institute for AI in Brain Health, University of Tübingen, Tübingen, Germany · Tübingen AI Center, University of Tübingen, Tübingen, Germany · Department of Psychology, Humboldt-Universität zu Berlin +8
A Dataset of Robot-Patient and Doctor-Patient Medical Dialogues for Spoken Language Processing Tasks
May 26, 2026Heriberto Cuayahuitl, Grace JangHealthcare Speech Processing
School of Engineering and Physical Sciences University of Lincoln, UK · Lincoln Medical School Universities of Lincoln and Nothingham, UK
Multilingual Phonological Feature Recognition with Self-Supervised Speech Models
May 25, 2026Abner Hernandez, Tomás Arias-Vergara, Daiqi Liu +2Speech Processing Cross-Lingual Transfer
Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany · GITA Lab. Facultad de Ingenier´ıa. Universidad de Antioquia UdeA, Medell´ın, Colombia
A Multimodal Framework for Dementia Detection via Linguistic and Acoustic Representation Learning
May 25, 2026Loukas Ilias, Dimitris AskounisSpeech-Based Dementia Detection Speech Processing
Decision Support Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, 15780 Athens, Greece
Rethinking Continual Learning for Speech and Audio: A Representation-Centric Taxonomy and Open Problems
May 24, 2026Yang Xiao, Siyi Wang, Eun-Jung Holden +1Audio Representation Learning Speech Foundation Models
University of Melbourne, Melbourne, Australia.
Zero-Shot Parkinson's Disease Detection from Speech: Comparing Large Audio and Language Models
May 24, 2026Muhammad Ashad Kabir, Sirajam MuniraAudio-Language Model Evaluation Zero-Shot Learning
School of Computing, Mathematics and Engineering, Charles Sturt University, NSW, Australia · Department of Computer Science, Rensselaer Polytechnic Institute, NY, USA
Phonetic Modeling of Dialectal Variation in Vietnamese Speech
May 23, 2026Quan Ngoc Hoang, Long Hoang Huu Nguyen, Nghia Hieu Nguyen +2Speech Processing Automatic Speech Recognition
4Vietnam National University, Ho Chi Minh city, Vietnam
Frame-Aligned Fusion of Canary and WavLM for Non-Intrusive Intelligibility Prediction of Hearing-Aid-Processed Speech
May 22, 2026Kazushi NakazawaSpeech Quality Assessment Speech Processing
Advanced Media, Inc. Tokyo, Japan

Jun 5, 2026, cs.SDJ/K move · Enter open · S save

TargetSEC: Plug-and-Play In-the-Wild Speech Emotion Conversion via Arousal-Conditioned Latent Style Diffusion

Constantin Alexander Auga

Hasso Plattner Institute / University of Potsdam, Potsdam, Germany

Latent Diffusion Models Audio Diffusion Models Speech Processing Controllable Speech Generation

Open paper AskPDF arXiv

Speech Emotion Conversion (SEC) aims to transform the emotion of a source utterance into a target emotion while preserving content and speaker identity. SEC on in-the-wild data is challenging due to the non-parallel nature of training data and complex real-world acoustics. Existing fixed-duration approaches either struggle to shift the emotion effectively (high quality, low conversion) or degrade speech naturalness (low quality, high conversion). We propose TargetSEC, an embedding-driven latent diffusion framework that generates emotion-focused style embeddings conditioned on speaker identity and continuous emotion. Unlike methods that diffuse over spectrograms, TargetSEC operates in a compact latent space. Experiments on the MSP-Podcast dataset show that TargetSEC outperforms current non-duration baselines and matches or exceeds the duration-prediction baseline in conversion MSE and naturalness without explicit temporal modeling.

Momentum

Related topics

Latest papers 295