TRACTA: Benchmarking Temporal Reasoning over Semantic Trajectories
Authors: Michael Romei De Socio, Gian Luca Pozzato, Alessio Merlo
Organizations: Department of Computer Science, University of Turin, Corso Svizzera 185, 10149 Turin, Italy · CASD – School of Advanced Defense Studies, Piazza della Rovere 83, 00165 Rome, Italy
Abstract
High-complexity operational environments require methods that characterize temporally distributed patterns rather than classify isolated events. This paper introduces TRACTA (Temporal Reasoning and Capability-Trajectory Analysis), a knowledge-aligned synthetic benchmark for temporal structural reasoning, instantiated through Multi-Domain Operations (MDO)-like scenarios. TRACTA defines offline structural annotations over contextual direct-impact and accumulated capability trajectories and evaluates three tasks: early_warning, pattern_detection, and run_classification. The frozen comparison includes raw-event neural references, a contract-lite rule comparator, and a recurrent semantic-input reference. The semantic-input recurrent reference has the highest aggregate macro-F1 point estimates, with the largest margins on the two temporal tasks, while raw-event references remain predictive and lead in four individual early-warning target--lead settings. Component-zeroing diagnostics show that both semantic trajectory blocks contain useful signal within the evaluated recurrent configuration. Run-local aliasing removes stable cross-run target and location identities from the primary raw input, although executed diagnostics retain shallow predictivity. These results are configuration-level: semantic inputs are aligned with the benchmark's target-generation space, and the evaluated systems also differ in architecture, training, and available information. TRACTA therefore provides a reproducible testbed for examining knowledge-aligned temporal prediction, not evidence of a causal representation advantage, statistically resolved superiority, or operational readiness.
Despite significant advances, large language models (LLMs) continue to exhibit brittle performance on complex temporal reasoning tasks. This failure mode is widely attributed to inherent deficits in autoregressive logical deduction. In this paper, we challenge this prevailing narrative, demonstrating that temporal reasoning is not the fundamental bottleneck; rather, the locus of failure lies in unstructured text-to-event representation. We introduce a novel neuro-symbolic question-answering framework governed by a Probabilistic Inconsistency Signal (PIS) that explicitly isolates perceptual errors from reasoning failures. By lifting unstructured text into explicit event graphs and interval constraints, our architecture strictly decouples semantic extraction from a symbolic reasoning engine. To robustly detect structural breaks, the PIS elegantly unifies symbolic credal intervals with epistemic neural uncertainty extracted via Evidential Deep Learning on LLM hidden states. Empirical evaluations reveal a striking paradigm shift: when provided with correct structural representations, our system's explicit proof traces achieve perfect 1.0 accuracy (4000/4000) and strictly zero false positives/negatives on temporal arithmetic benchmarks. On broader, noise-injected QA settings, the framework maintains a competitive 75.1% accuracy while enabling deterministic, step-level failure localization. Ultimately, by isolating the representation bottleneck from the reasoning substrate, this work reframes temporal QA from an algorithmic reasoning challenge to a structural alignment problem, charting a verifiable path forward for reliable neuro-symbolic AI.
Current agentic workflows usually involve decomposing user requests into sequences of tool calls with correctly resolved parameters, the results of which are processed through reasoning traces in the language model's context window. The prevailing route to improve such reasoning is test-time scaling, which trains models to search over long chains of thought; but the resulting capability is entangled in model weights, is not verifiable step-by-step, and is costly at inference. We present Forethought, a neurosymbolic reasoning system that instead treats reasoning as an explicit, verifiable program, that builds from a library of symbolic and neural primitives which are composed through a domain-specific language. The result are reasoning programs, which are concrete representations of the model's work, and as such can be inspected and modified before deployment. Instantiated as a tool-calling execution kernel and evaluated across five benchmarks, Forethought improves base-model accuracy by about 30% relative and outperforms vanilla prompting, reinforcement learning scaffolds, and prompt-evolution methods, enabling small models to match or exceed frontier models capabilities. In a direct comparison, a non-reasoning model augmented with Forethought competes with a dedicated reasoning model while requiring roughly three orders of magnitude less post-training investment, and remains model-agnostic and auditable.
Vishvesh Bhat, Jay Vaghasiya, Emmanuel Anaya Gonzalez
Most of the existing neuro-symbolic AI methods focus on the scenario of static knowledge where objects do not change according to a temporal dimension. Temporal neuro-symbolic works are still under explored and are mainly developed for time-interval logic or propositional linear temporal logic. There is a lack of models studying linear temporal logics with predicates that deal with objects whose properties and relations change through the time. We present First-Order Temporal Logic Tensor Networks (FOT-LTN) that is an extension of Logic Tensor Networks (LTN) that fills this gap by considering a linear-temporal dimension. In particular, FOT-LTN joins the syntax of First-Order Linear Temporal Logic with the fuzzy (and real-valued) semantics of LTN obtaining a framework that supports both temporal operators and quantifiers and is totally differentiable. A first evaluation regards a temporal knowledge graph completion task on two synthetic datasets showing better performance of FOT-LTN with respect to dedicated (purely neural) methods.
Luca Boscarato, Ivan Donadello, Alessandro Artale +2