High-Value Synthetic Supervision for Parameter-Efficient Adaptation of a Compact Japanese Speech Model
Organizations: Blossom AI Labs Blossom AI Tokyo, Japan
Abstract
Private domain speech is difficult to collect and redistribute, while compact models need task-specific supervision. We study an auditable synthetic pipeline that maps Japanese care handoffs directly to six-field structured notes. Using 182 synthetic training and development clips, we adapt a 1.47B audio model by full fine-tuning and rank-16 LoRA. On a 39-clip scenario-seed-disjoint synthetic test, an unadapted model obtains a model-judged factuality-recall score of 0.0500, full tuning 0.8664, and LoRA 0.8461. LoRA reaches 97.7% of the full-tuning aggregate as a descriptive ratio while project telemetry reports 12.4M trainable parameters, about 0.85% of the backbone. Both adaptations show large paired gains over the same base; the full-versus-LoRA interval crosses zero, and differing optimization settings preclude an equivalence claim. This is a parameter-efficient capability-acquisition result, not a device-performance result: latency, memory, energy, and real-time factor were not measured. All evaluation speech and targets are synthetic, references are model-proposed, and the judge is uncalibrated. The evidence shows that a compact model can acquire a narrow audio-to-structure transformation from a few hundred provenance-linked synthetic examples; it does not establish clinical validity, real-speech transfer, or superiority to a clean cloud system.
Figures & tables
| System | FC | CR | FCR | Hall. | Missed |
|---|---|---|---|---|---|
| Unadapted | 1.0000 | 0.0256 | 0.0500 | 0 | 184 |
| Cascade † | 0.9128 | 0.7873 | 0.8454 | 36 | 97 |
| Full tuning | 0.9121 | 0.8251 | 0.8664 | 27 | 79 |
| LoRA | 0.9069 | 0.7929 | 0.8461 | 26 | 72 |
Parameter-Efficient Fine-Tuning
Parameter-efficient fine-tuning adapts pretrained models by updating small parameter subsets or lightweight modules instead of all weights.
See all 610 papers