cs.SENov 10, 2026

Where Should the Code Go? Locating Foundation-Model Errors in Bitemporal Inventory Simulation

Authors: Durga Sandeep Saluru, Lanchen Song, Aditya Kumaran

Organizations: Distyl AI

Abstract

Operational reports carry two clocks: when an event happened and when its report arrived; later reports can revise earlier ones. A foundation-model component that maintains the state supported by the reports visible at a cutoff, then rolls a supplied scenario forward, can be helped by exact code before it, after it or inside the call, or asked to reason harder. We ask which remedy removes which error, for which models, on an exactly solvable lost-sales inventory environment: 36,672 independently rescored requests over twelve configurations of closed and open-weight models, with a forced-answer-call interface as a control and protocols frozen before the calls. Weak models fail in separable ways. Canonical input removes report-selection error, exact continuation removes rollout error, neither repairs the other, and which error dominates differs by model; strong models are at ceiling on raw reports. Asking for more reasoning is no substitute and can depend on the interface: under a forced answer call high effort collapses GPT-5.4 mini and DeepSeek V4 Pro, which gain or hold under automatic choice; on its provider the forced call disables reasoning for DeepSeek V4 Flash; and at high effort gpt-oss exhausts its output budget. The contribution is a controlled component diagnostic, released with every request, and evidence that for some model and provider pairs the tool-calling interface confounds reasoning evaluation.

Figures & tables

Appendix figures & tables18 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. From Forecasting to World Modeling: Can Temporal Foundation Models Recover Causal Response?

    Nov 11, 2026Juwon Hong, Minha Hwang, Venkatesh ShankarCausal Effect EstimationCausal Foundation Models

  2. Procedure without Judgment: What Small Language Models Learn under an Exact Verifier

    Nov 16, 2026Arunkumar V, Manoranjan Gandhudi, Gangadharan G. R. +2llm agent policy complianceConcept-Based Explanations

  3. Broken Chains: The Cost of Incomplete Reasoning in LLMs

    Feb 16, 2026Ian Su, Gaurav Purushothaman, Jey Narayan +5LLM ReasoningCoT Reasoning