cs.AIOct 29, 2026

CoToan: Executable Rules and a Representation Contract for Reproducible Game AI Evaluation

Authors: Ha-Thanh Nguyen

Organizations: College of Engineering and Computer Science, VinUniversity, Hanoi, Vietnam

Abstract

Game AI results are comparable only when different implementations expose the same decision problem. Yet seemingly minor representation choices can silently change that problem by altering action probabilities or collapsing states with different outcomes. We study this issue through CoToan, an executable specification and representation contract for Vietnamese Mathematical Chess connecting the Game Description Language (GDL) with OpenSpiel. The game provides a useful case because a single capture may have multiple arithmetic justifications, while outcomes can depend on scoring rules and a finite playing horizon. CoToan therefore represents actions by their state transitions rather than by arithmetic witnesses, and treats time and victory configuration as part of task identity. Cross-representation tests show agreement in legal actions, successor states, and terminal outcomes across hundreds of sampled and constructed positions, complemented by exhaustive checks of all 32 operator masks and 512 opposing-material subsets. Controlled diagnostics further show that uniform witness-level sampling alters endpoint-action probabilities, while omitting remaining time or victory settings can merge states with different terminal behavior. These results show that action semantics, time, and victory configuration are not merely implementation details. They are part of the experimental task itself and must be represented explicitly for reproducible game AI.

Figures & tables

Explore similar work

CardsList
  1. Spec2Game: Can LLMs Generate Complete Playable Games from Detailed Specifications?

    Oct 3, 2026Yixue Cai, Yuzhe Zhao, Hanxiang Chao +4Code GenerationLLM Code Generation

  2. Towards Understanding Specification Gaming in Reasoning Models

    May 4, 2026Kei Nishimura-Gasparian, Robert McCarthy, David LindnerReward HackingRL for Language Model Reasoning