From 50% to Mastery in 3 Days: A Low-Resource SOP for Localizing Graduate-Level AI Tutors via Shadow-RAG
Organizations: School of Mechanics and Engineering Science, Peking University, Beijing, 100871, China · Readraft Intelligent Technology Co., Ltd., China · Graduate School of Education, Peking University, Beijing, 100871, China · AI for Science Institute, Beijing, 100080, China
Abstract
Deploying high-fidelity AI tutors in schools is often blocked by the Resource Curse -- the need for expensive cloud GPUs and massive data engineering. In this practitioner report, we present a replicable Standard Operating Procedure that breaks this barrier. Using a Vision-Language Model data cleaning strategy and a novel Shadow-RAG architecture, we localized a graduate-level Applied Mathematics tutor using only 3 person-days of non-expert labor and open-weights 32B models deployable on a single consumer-grade GPU. Our pilot study on a full graduate-level final exam reveals a striking emergence phenomenon: while both zero-shot baselines and standard retrieval stagnate around 50-60% accuracy across model generations, the Shadow Agent, which provides structured reasoning guidance, triggers a massive capability surge in newer 32B models, boosting performance from 74% (Naive RAG) to mastery level (90%). In contrast, older models see only modest gains (~10%). This suggests that such guidance is the key to unlocking the latent power of modern small language models. This work offers a cost-effective, scientifically grounded blueprint for ubiquitous AI education.
Figures & tables
| Configuration | RAG | Shadow | Reason | Code |
|---|---|---|---|---|
| Baseline (Zero-shot) | ||||
| Naive RAG | ||||
| Shadow (Full/Dynamic) | ||||
| Shadow (No Code) | ||||
| Shadow (Forced Tools) |
| Configuration | Qwen2.5-32B Acc. (%) | Qwen3-32B Acc. (%) |
|---|---|---|
| Baseline (Zero-shot) | 47 | 67 |
| Naive RAG | 56 | 74 |
| Shadow (Full/Dynamic) | 65 | 85 |
| Shadow (No Code) | 50 | 85 |
| Shadow (Forced Tools) | 57 | 90 |
Generative AI in Education
Generative AI in education uses language and multimodal models to support teaching, learning, feedback, assessment, and educational design.
See all 282 papers