cs.CLMar 19, 2026

What Really Controls Temporal Reasoning in Large Language Models: Tokenisation or Representation of Time?

Authors: Gagan Bhatia, Ahmad Muhammad Isa, Maxime Peyrard, Wei Zhao

Organizations: University of Aberdeen · Université Grenoble Alpes & CNRS

Abstract

We present MultiTempBench, a multilingual temporal reasoning benchmark spanning three tasks, date arithmetic, time zone conversion, and temporal relation extraction across five languages (English, German, Chinese, Arabic, and Hausa) and multiple calendar conventions (Gregorian, Hijri, and Chinese Lunar). MultiTempBench contains 15,00015,000 examples built by translating 750750 curated English questions and expanding each into controlled date-format variants. We evaluate 20 LLMs and introduce the multilingual Date Fragmentation Ratio (mDFR), calibrated with human severity ratings, together with geometric-probing analyses of internal temporal representations. We find tokenisation quality of temporal artefacts is a resource-dependent bottleneck: in low-resource languages and rarer calendar formats, fragmentation disrupts Year/Month/Day separation and accuracy collapses, while high-resource settings are often robust to digit-level splitting. Beyond tokenisation, crossed mixed-effects regression shows that temporal linearity is the strongest predictor of temporal reasoning in high-resource languages, whereas fragmentation is the stronger predictor in low-resource languages. Code is available at: https://github.com/gagan3012/mtb

Explore similar work

CardsList
  1. Measuring Iterative Temporal Reasoning with Time Puzzles

    Jan 12, 2026Zhengxiang Wang, Zeyu DongLLM EvaluationTemporal Reasoning in Language Models

  2. Evaluating Temporal Reasoning in Large Language Models: Event Temporal Relation Extraction with Allen's Interval Algebra, Logical Consistency, and Relative Time in Narratives

    Oct 12, 2026Adib Sakhawat, Fardeen Sadab, Tamjid Hasan Fahim +9Temporal Reasoning in Language ModelsRelation Extraction

  3. From Recognition to Understanding: Unlocking Cognitive Time Series Reasoning with LLMs

    Jun 20, 2026Xin Qiu, Junlong Tong, Yao Zhang +3Time Series ReasoningTime Series QA