cs.CLOct 29, 2026

EDU-Jev Training System-One Decision Models for Education

Authors: Jiazheng Li, Yulan He

Organizations: King’s College London

Abstract

Many automated decisions in education involve choosing from a fixed set of options: assigning a rubric score, checking whether an answer meets a marking criterion, or identifying the first wrong step in a solution. Generative language models are increasingly used to make these decisions, but their responses require parsing, longer outputs increase inference costs, and confidence expressed in words does not necessarily reflect the probability of being correct. We present EDU-Jev, a family of single-pass ("System One") decision models at 0.8B, 2B and 4B parameters. Given an assessment context and a question with predefined answer options, the model returns a probability distribution over those options without generating text. A pointer head scores a marker for each option, ensuring the predictions are restricted to the allowed choices. Training uses a single supervised stage with soft cross-entropy against the available target label distributions; calibration is assessed empirically. Across twelve education benchmarks, EDU-Jev 4B achieves an average accuracy of 67.6%, exceeding the strongest of five commercial decision APIs by 9.4 percentage points and the best open 4B decision model by 18.7 points. On four cross-domain education sets, it matches the strongest API, which remains ahead on general decision-making and reasoning tasks. The 2B model processes about 150 decisions per second on a single H100 GPU.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Releasing the Inner Jev: A Simple Recipe for Open Decision Models

    Oct 12, 2026Jonathan Geuter, Andrew Cheng, David Alvarez-MelisSystem One Decision ModelsLLM Decision-Making

  2. Specialized Decision Models vs. General-Purpose LLMs: Benchmarking Jev Across Knowledge, Reasoning, and Multilingual Tasks

    Oct 8, 2026Xing Li, Qingcheng Chang, Jinzhong Ning +5LLM EvaluationMultiple-Choice Question Answering

  3. General Decision Models: Benchmarking and Insights Beyond Jev

    Oct 2, 2026Feiyu Duan, Jiayu Lin, Jia Wang +6LLM Decision-MakingUncertainty Calibration