FireRedASR2S: A State-of-the-Art Industrial-Grade All-in-One Automatic Speech Recognition System
Organizations: Super Intelligence Team, Xiaohongshu Inc.
Abstract
We present FireRedASR2S, a state-of-the-art industrial-grade all-in-one automatic speech recognition (ASR) system. It integrates four modules in a unified pipeline: ASR, Voice Activity Detection (VAD), Spoken Language Identification (LID), and Punctuation Prediction (Punc). All modules achieve SOTA performance on the evaluated benchmarks: FireRedASR2: An ASR module with two variants, FireRedASR2-LLM (8B+ parameters) and FireRedASR2-AED (1B+ parameters), supporting speech and singing transcription for Mandarin, Chinese dialects and accents, English, and code-switching. Compared to FireRedASR, FireRedASR2 delivers improved recognition accuracy and broader dialect and accent coverage. FireRedASR2-LLM achieves 2.89% average CER on 4 public Mandarin benchmarks and 11.55% on 19 public Chinese dialects and accents benchmarks, outperforming competitive baselines including Doubao-ASR, Qwen3-ASR, and Fun-ASR. FireRedVAD: An ultra-lightweight module (0.6M parameters) based on the Deep Feedforward Sequential Memory Network (DFSMN), supporting streaming VAD, non-streaming VAD, and multi-label VAD (mVAD). On the FLEURS-VAD-102 benchmark, it achieves 97.57% frame-level F1 and 99.60% AUC-ROC, outperforming Silero-VAD, TEN-VAD, FunASR-VAD, and WebRTC-VAD. FireRedLID: An Encoder-Decoder LID module supporting 100+ languages and 20+ Chinese dialects and accents. On FLEURS (82 languages), it achieves 97.18% utterance-level accuracy, outperforming Whisper and SpeechBrain. FireRedPunc: A BERT-style punctuation prediction module for Chinese and English. On multi-domain benchmarks, it achieves 78.90% average F1, outperforming FunASR-Punc (62.77%). To advance research in speech processing, we release model weights and code at https://github.com/FireRedTeam/FireRedASR2S.
Figures & tables
| Item | FireRedASR | FireRedASR2 |
|---|---|---|
| Training data | ~70k hours | ~200k hours |
| Vocab size (AED) | 7,832 | 8,667 |
| Timestamps (AED) | Not Supported | Supported |
| Test set \ Model | FRASR2-LLM | FRASR2-AED | Doubao-ASR | Qwen3-ASR | Fun-ASR |
|---|---|---|---|---|---|
| Avg-All-24 | 9.67 | 9.80 | 12.98 | 10.12 | 10.92 |
| Avg-Mandarin-4 | 2.89 | 3.05 | 3.69 | 3.76 | 4.16 |
| Avg-Dialect-19 | 11.55 | 11.67 | 15.39 | 11.85 | 12.76 |
| Sing-1 | 1.12 | 1.17 | 4.36 | 2.57 | 3.05 |
| aishell1 | 0.64 | 0.57 | 1.52 | 1.48 | 1.64 |
| aishell2 | 2.15 | 2.51 | 2.77 | 2.71 | 2.38 |
| Metric \ Model | FireRedVAD | Silero-VAD | TEN-VAD | FunASR-VAD | WebRTC-VAD |
|---|---|---|---|---|---|
| AUC-ROC (%) | 99.60 | 97.99 | 97.81 | – | – |
| F1 (%) | 97.57 | 95.95 | 95.19 | 90.91 | 52.30 |
| FAR (%) | 2.69 | 9.41 | 15.47 | 44.03 | 2.83 |
| MR (%) | 3.62 | 3.95 | 2.95 | 0.42 | 64.15 |
| Test set \ Model | FireRedLID | Whisper | SpeechBrain | Dolphin |
|---|---|---|---|---|
| FLEURS test | 97.18 | 79.41 | 92.91 | – |
| CommonVoice test | 92.07 | 80.81 | 78.75 | – |
| Chinese dialects | 88.47 | – | – | 69.01 |
| Test set \ Model | FireRedPunc | FunASR-Punc |
|---|---|---|
| Multi-domain Chinese | 82.84 / 83.08 / 82.96 | 77.27 / 74.03 / 75.62 |
| Multi-domain English | 78.40 / 71.57 / 74.83 | 55.79 / 45.15 / 49.91 |
| Average F1 | 78.90 | 62.77 |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Test set \ Model | FRASR2-LLM | FRASR2-AED | Doubao-ASR | Qwen3-ASR | Fun-ASR | Fun-Nano |
|---|---|---|---|---|---|---|
| Avg-Mandarin-4 | 2.89 | 3.05 | 3.69 | 3.76 | 4.16 | 4.55 |
| Avg-Dialect-19 | 11.55 | 11.67 | 15.39 | 11.85 | 12.76 | 15.07 |
| Avg-All-24 | 9.67 | 9.80 | 12.98 | 10.12 | 10.92 | 12.81 |
| aishell1 | 0.64 | 0.57 | 1.52 | 1.48 | 1.64 | 1.96 |
| aishell2 | 2.15 | 2.51 | 2.77 | 2.71 | 2.38 | 3.02 |
| ws-net | 4.44 | 4.57 | 5.73 | 4.97 | 6.85 | 6.93 |
| Code | English Name | Chinese Name | Code | English Name | Chinese Name |
|---|---|---|---|---|---|
| zh | Chinese | 中文 | en | English | 英语 |
| es | Spanish | 西班牙语 | fr | French | 法语 |
| ja | Japanese | 日语 | ko | Korean | 韩语 |
| ru | Russian | 俄语 | de | German | 德语 |
| pt | Portuguese | 葡萄牙语 | ar | Arabic | 阿拉伯语 |
| ab | Abkhazian | 阿布哈兹语 | af | Afrikaans | 南非荷兰语 |
| Code | English Name | Chinese Name |
|---|---|---|
| mandarin | Chinese (Mandarin) | 中文 (普通话) |
| yue | Chinese (Yue: Guangdong/Hong Kong) | 中文 (粤语:广东/香港) |
| wu | Chinese (Wu: Shanghai/Wu) | 中文 (吴语:上海/吴语片区) |
| min | Chinese (Min: Fujian) | 中文 (闽语:福建) |
| north | Chinese (Mandarin-North: Shandong/Gansu/Ningxia/Hebei/Shanxi/Liaoning/Shaanxi) | 中文 (官话-北方:山东/甘肃/宁夏/河北/山西/辽宁/陕西) |
| xinan | Chinese (Mandarin-Southwest: Sichuan/Yunnan/Guizhou/Hubei/Chongqing) | 中文 (官话-西南:四川/云南/贵州/湖北/重庆) |