Few-shot voice cloning makes it cheap to produce daily Japanese financial commentary with several synthetic speakers, but kanji words with more than one reading, such as the word for "market" (shijo vs. ichiba) or "overall trend" (taisei vs. oze), are still misread. A common quality gate transcribes each synthesized sentence with automatic speech recognition (ASR), converts both the input and the transcript to kana, and regenerates on mismatch. We show that this gate is unreliable in both directions: when the audio contains a misreading, the ASR language model frequently writes the expected kanji back, hiding the error, and when the audio is correct, ordinary recognition errors trigger needless regeneration. We propose a reading-level check that scores the expected reading and its confusable alternatives with a connectionist temporal classification (CTC) hiragana recognizer and flags a word when an alternative explains the audio better. On 540 utterances from three voice-cloned production voices covering 30 financial terms, with misreadings injected under controlled conditions, the transcript-based gate detected 78.9% of misreadings at a 44.4% false-alarm rate, whereas the proposed check detected 91.7% at 5.0% (AUC 0.990). On natural kanji input, it caught a front-end error that the transcript-based gate missed for one voice, and reduced regeneration requests from 38.9% to 6.1% of sentences.
Figures & tables
Fig. 1: Generate–verify–regenerate loop. Stage 1 is the deployed transcript-based gate; Stage 2 is the proposed reading-level check.
Word
Expected
Injected
Word
Expected
Injected
市場
しじょう
いちば
決算
けっさん
けつざん
大手
おおて
おおで
増益
ぞうえき
ぞうやく
上値
うわね
じょうね
千円
せんえん
せんねん
下値
したね
しもね
十分
じゅっぷん
じゅうぶん
大引け
おおびけ
おおひけ
人気
にんき
ひとけ
相場
そうば
あいば
大勢
たいせい
おおぜい
TABLE I: Financial terms, expected readings and injected misreadings
Method
Recall (W)
False alarm (K)
Precision
Stage 1: Whisper + kana
78.9 [72.4, 84.2]
44.4 [37.4, 51.7]
64.0
Greedy hiragana CTC
100 [97.9, 100]
48.3 [41.1, 55.6]
67.4
Proposed ( θ=0 )
91.7 [86.7, 94.9]
5.0 [2.7, 9.2]
94.8
TABLE II: Detection on the controlled set (3 voices, 180 W and 180 K utterances). Brackets: Wilson 95% CI.
Fig. 2: Distribution of the margin m(w) in ( 2 ) for utterances with the correct (K) and the injected wrong (W) reading. Dashed line: θ=0 .
Fig. 3: ROC curve of the proposed margin on the controlled set, with the operating points of the two baselines.
θ
Recall (W)
False alarm (K)
−10
98.9% (178/180)
15.0% (27/180)
−5
93.9% (169/180)
8.3% (15/180)
0
91.7% (165/180)
5.0% (9/180)
5
90.6% (163/180)
1.7% (3/180)
10
86.7% (156/180)
0.6% (1/180)
TABLE III: Effect of the threshold θ (controlled set, 3 voices)
Voice
Stage 1
Proposed ( θ=0 )
AUC
F1 (female)
81.7 / 50.0
93.3 / 6.7
0.988
F2 (female)
80.0 / 45.0
86.7 / 5.0
0.983
M1 (male)
75.0 / 38.3
95.0 / 3.3
0.998
TABLE IV: Per-voice recall / false-alarm rate (%) and AUC of the margin
TTS input (injected reading)
Whisper transcript
m(w)
今週の東京 いちば は、…
今週の東京 市場 は…
+19.3
金利の上昇が、 あいば の重しに…
金利の上昇が 相場 の重しに…
+28.7
取引開始から じゅうぶん 後に、…
取引開始から 十分 後に、…
+32.1
あとば は日銀の発表待ちで、…
後場 は日銀の発表待ちで、…
+24.7
にちけいへいきん は、三日ぶりに…
日経平均 は3日ぶりに…
+16.4
原油価格の からく が、…
原油価格の 下落 が…
+22.9
TABLE V: Injected misreadings hidden by the recognizer (voice F1). The transcript restores the expected kanji, so Stage 1 passes.
Stage 1
Proposed
Stage 1
Proposed
Term
W
K
W
K
Term
W
K
W
K
市場
2
3
5
0
決算
5
1
6
0
大手
3
1
5
0
増益
6
3
6
0
上値
6
3
6
0
千円
6
1
6
0
下値
6
1
6
0
十分
3
1
6
1
大引け
3
2
6
3
人気
3
4
5
0
TABLE VI: Detections per term (out of 6 utterances: 3 voices × 2 sentences). W: misreadings detected; K: false alarms.
Type (terms, utterances per class)
Stage 1
Proposed
(a) Reading choice (21, 126)
104/126, 61 FA
118/126, 1 FA
(b) Sound change (7, 42)
29/42, 17 FA
35/42, 7 FA
(c) Numeral euphony (2, 12)
9/12, 2 FA
12/12, 1 FA
TABLE VII: Recall / false alarms by misreading type (controlled set)
Fig. 4: Margin m(w) per voice and condition (K: correct reading injected, W: wrong reading injected, N: natural kanji input). Natural utterances behave like K except for the front-end misreadings of 大勢, which appear as positive outliers.