cs.AINov 10, 2026

The WoW: A Large-Scale World Knowledge Corpus for Full-Lifecycle LLM Training

Authors: Tianze Sun, Yongyao Duan, Sam Chen

Organizations: Harbin Institute of Technology · OpenCSG

Abstract

Existing Chinese educational corpora often suffer from fragmented coverage and a lack of systematic organization. In this paper, we propose WoW (World Knowledge), a large-scale dataset designed for the full-cycle training of foundation models. The construction of this dataset is driven by an Educational Knowledge Graph, which serves as a taxonomic backbone for the systematic collection and completion of missing educational modules across all levels. Compared to previous versions, this iteration provides enhanced systematicity, superior quality, and a larger scale, while incorporating multimodal signals and supporting every stage of model development. Experiments demonstrate that WoW significantly improves model performance across diverse benchmarks. To facilitate community research, we further provide an interactive platform for graph-based data selection and retrieval.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. K12-KGraph: A Curriculum-Aligned Knowledge Graph for Benchmarking and Training Educational LLMs

    May 10, 2026Hao Liang, Qihan Lin, Zhaoyang Han +5AI in EducationKnowledge Augmentation for Language Models

  2. LittleLearner: Language Models Under Pedagogically Controlled Knowledge Exposure

    Aug 13, 2026Fanfei Li, Jana Zeller, Manuel Prada-Corral +4Language Model PretrainingKnowledge Augmentation for Language Models

  3. It's All Training: A Fully Synthetic Single-Stage Recipe for LLMs

    Sep 29, 2026Pierre-Carl Langlais, Pieter Delobelle, Yannick Detrois +7Language Model PretrainingSynthetic Data Pretraining