In Search of Lost Time: Temporal Competence in Large Language Models
Organizations: Department of Computer Science, Princeton University · Department of Operations Research and Financial Engineering, Princeton University · Department of Industrial Engineering and Operations Research, Columbia University · Department of EECS, University of California, Berkeley ·
Abstract
Today's large language models (LLMs) increasingly interact with time: AI agents schedule tasks, coordinate with people and other AI systems, and even decide how long to think. Yet LLMs only ever encounter time secondhand---in descriptions rather than experience. Does this hinder their reasoning and decisions that involve time? Our paper traces this question from a model's knowledge to its actions through four successive evaluations. We find that models know the rules of time, which can be read, but struggle to predict durations, which must be lived; while they are highly accurate (92.0-97.5%) on a collection of questions built from the theorems of various time-related literatures, they underestimate their own completion times by up to 99.5% and fail to identify which tasks will take them longer to run. And while they are better at estimating durations of human tasks, their duration judgments change based on how an event is worded, magnifying similar human biases by up to 1.3. Moving from estimation to action, we find that some LLMs disregard time costs completely when answering user queries, ignoring a 1,200-fold increase in wait time entirely. Together, our experiments reveal new challenges posed to LLMs as they navigate a dimension they cannot directly perceive, and highlight how their blind spots can even be simple cognitive abilities that humans take for granted.
Figures & tables
| Information Input | Mental Processes | Work Output | Interacting w/ Others |
|---|---|---|---|
| Summarize sources | Math problems | Brick wall | Social media posts |
| Fact-check claims | Logic questions | Brick steps | Reply to comments |
| Axiom / Theorem | Claude Opus 5 | 000 GPT-5.6 Sol | Gemini 3.7 Flash |
| Learning | 100.0 † | 100.0 † | 100.0 † |
| Decay | 100.0 † | 100.0 † | 100.0 † |
| Screening | 0 99.2 (98.1–100.0) | 0 90.0 (82.0–96.1) | 0 95.2 (88.3–99.8) |
| Loading | 0 99.3 (97.4–100.0) | 0 92.5 (86.9–97.3) | 0 72.3 (50.2–91.5) |
| Recovery | 100.0 † | 0 99.4 (98.3–100.0) | 100.0 † |
| Interruption count | 0 74.1 (59.3–87.4) | 0 97.9 (95.6–99.6) | 100.0 † |
Appendix figures & tables35 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Order | Scored | Accuracy | Unanimous | accuracy (95% CI) |
|---|---|---|---|---|---|
| Claude Opus 5 | Fixed | 351 | 65.5 | 72.9 | ( , ) |
| Shuffled | 353 | 67.7 | 74.6 | ||
| GPT-5.6 Sol | Fixed | 384 | 93.5 | 98.4 | ( , ) |
| Shuffled | 384 | 93.8 | 100.0 | ||
| Gemini 3.7 Flash | Fixed | 384 | 94.5 | 96.9 | ( , ) |
| Shuffled | 384 | 93.8 | 100.0 |
| Model | Gold in (a) | Gold in (b) | Gold in (c) | Gold in (d) |
|---|---|---|---|---|
| Claude Opus 5 | 62.0 (47.6, 75.9) | 69.9 (55.7, 82.7) | 67.6 (54.0, 79.6) | 71.0 (58.0, 82.4) |
| GPT-5.6 Sol | 94.1 (86.4, 100) | 91.1 (81.0, 98.8) | 93.1 (85.3, 99.1) | 96.2 (90.7, 100) |
| Gemini 3.7 Flash | 94.1 (86.4, 100) | 91.1 (81.0, 98.8) | 93.1 (85.3, 99.1) | 96.2 (90.8, 100) |
| Domain | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Axiom/theorem | Queries per cell | BS | BW | LQ | MP | CR | FC | SP | SS | Total |
| learning | 60 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0/480 |
| decay | 60 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0/480 |
| screening | 120 | 0 | 0 | 0 | 0 | 107 | 120 | 0 | 108 | 335/960 |
| loading | 60 | 0 | 0 | 0 | 0 | 0 | 60 | 0 | 0 | 60/480 |
| recovery | 60 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 6 | 6/480 |
| Model | 50% interval | 80% interval | 95% interval |
|---|---|---|---|
| Claude Opus 5 | 43.75% (7/16) | 56.25% (9/16) | 93.75% (15/16) |
| GPT-5.6 Sol | 43.75% (7/16) | 75.00% (12/16) | 87.50% (14/16) |
| Gemini 3.7 Flash | 18.75% (3/16) | 31.25% (5/16) | 50.00% (8/16) |
| All model–task pairs | 35.42% (17/48) | 54.17% (26/48) | 77.08% (37/48) |
| Estimator and target | 50% interval | 80% interval | 95% interval |
|---|---|---|---|
| Claude Opus 4.6 self | 40.00% (6/15) | 66.67% (10/15) | 66.67% (10/15) |
| GPT-5.2 self | 0.00% (0/16) | 0.00% (0/16) | 0.00% (0/16) |
| Gemini 3.1 Pro Preview Gemini 3 Pro | 0.00% (0/16) | 0.00% (0/16) | 0.00% (0/16) |
| All evaluable model–task pairs | 12.77% (6/47) | 21.28% (10/47) | 21.28% (10/47) |
| Estimator | Original | Additional | Factor (95% CI) | Adj. |
|---|---|---|---|---|
| Claude Opus 4.6 | 8.93 | 7.01 | 0.785 [0.577, 1.067] | .113 |
| GPT-5.2 | 18.19 | 11.22 | 0.617 [0.507, 0.751] | |
| Gemini proxy | 8.55 | 6.31 | 0.738 [0.567, 0.960] | .053 |
| Model | Bias factor | Abs. error factor | Within | Within | ||
|---|---|---|---|---|---|---|
| Claude Opus 5 | 497 | 0.94 | 1.96 | 52.5% | 95.6% | 0.61 |
| GPT-5.6 Sol | 500 | 0.70 | 1.61 | 73.4% | 96.8% | 0.86 |
| Gemini 3.7 Flash | 498 | 0.50 | 2.04 | 46.2% | 99.4% | 0.82 |
| Sensitivity gain | |||||
|---|---|---|---|---|---|
| Judge | Bias | All features | Predicate | Context | |
| One annotator (reference) | 0.49 | – | 1 | 1 | 1 |
| Claude Opus 5 | 0.688 [0.67, 0.71] | +0.49 | 1.35 [1.22, 1.47] | 1.62 [1.50, 1.76] | 0.89 [0.69, 1.11] |
| GPT-5.6 Sol | 0.619 [0.60, 0.64] | +0.01 | 1.27 [1.13, 1.39] | 1.57 [1.40, 1.72] | 0.76 [0.52, 0.99] |
| Gemini 3.7 Flash | 0.632 [0.61, 0.65] | +0.50 | 1.30 [1.15, 1.42] | 1.66 [1.49, 1.83] | 0.69 [0.47, 0.92] |
| Qwen2.5-32B | 0.430 | -0.91 | 0.67 [0.30, 1.03] | 1.13 [0.75, 1.51] | 0.37 [-0.17, 0.90] |
| Model | Calls | Tokens (in / out) | Cost |
|---|---|---|---|
| Claude Opus 5 | 14315 | 7.13M / 0.21M | $40.99 |
| GPT-5.6 Sol | 12202 | 2.87M / 0.69M | $25.17 |
| Gemini 3.7 Flash | 12211 | 2.01M / 1.72M | $7.95 |
| Qwen2.5-32B | 1042 | – | local |
| Total | $74.11 |
| Feature | Humans (5k) | Claude Opus 5 | GPT-5.6 Sol | Gemini 3.7 | Qwen 2.5 | Humans (1k) |
|---|---|---|---|---|---|---|
| Non-verbal pred. | +1.38 (0.09) | +2.76 (0.12) | +2.69 (0.14) | +3.00 (0.13) | +1.77 (0.35) | +1.16 (0.18) |
| Simple present | +1.14 (0.08) | +2.03 (0.11) | +2.02 (0.13) | +2.44 (0.12) | +0.99 (0.35) | +1.36 (0.18) |
| Perfect | +1.27 (0.14) | +1.56 (0.19) | +1.28 (0.23) | +1.03 (0.22) | +1.23 (0.50) | +0.72 (0.28) |
| Progressive | +0.92 (0.12) | +1.19 (0.16) | +1.33 (0.18) | +1.29 (0.16) | +0.54 (0.35) | +0.62 (0.25) |
| Imperative | -0.20 (0.14) | -0.37 (0.16) | -0.35 (0.18) | -0.28 (0.18) | -0.02 (0.53) | -0.03 (0.28) |
| Plural-noun subj. | +1.15 (0.11) | +1.25 (0.14) | +1.00 (0.18) | +1.06 (0.17) | +0.20 (0.42) | +0.89 (0.24) |
| Model | Prompt | Gain (all) | Gain (predicate) | Gain (context) | |
|---|---|---|---|---|---|
| Claude Opus 5 | base (mean of 5) | 0.676 | 1.16 | 1.82 | 0.72 |
| reworded | 0.651 | 1.09 | 1.85 | 0.57 | |
| reversed | 0.679 | 1.14 | 1.87 | 0.64 | |
| numeric | 0.653 | 1.12 | 1.85 | 0.62 | |
| GPT-5.6 Sol | base (mean of 5) | 0.591 | 1.05 | 1.73 | 0.58 |
| reworded | 0.608 | 0.97 | 1.64 | 0.52 |
| Same category | Mean difference (steps) | SD of | SD of gain | |
|---|---|---|---|---|
| Two annotators | 29.2% | 1.82 | – | – |
| Claude Opus 5, two runs | 92.2% | 0.15 | 0.004 | 0.058 |
| GPT-5.6 Sol, two runs | 80.4% | 0.45 | 0.007 | 0.080 |
| Gemini 3.7 Flash, two runs | 89.4% | 0.20 | 0.008 | 0.035 |
| inst. | sec. | min. | hours | days | weeks | months | years | dec. | cent. | forever | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Humans | 6.0 | 8.6 | 27.7 | 11.5 | 11.1 | 6.5 | 10.2 | 12.5 | 2.6 | 0.7 | 2.6 |
| Claude Opus 5 | 2.4 | 6.6 | 27.2 | 11.5 | 8.8 | 4.8 | 8.1 | 26.3 | 2.0 | 0.4 | 2.0 |
| GPT-5.6 Sol | 9.8 | 13.1 | 21.0 | 10.3 | 7.7 | 2.9 | 8.5 | 22.7 | 1.0 | 0.4 | 2.6 |
| Gemini 3.7 Flash | 5.1 | 10.5 | 19.1 | 11.3 | 10.0 | 4.2 | 11.7 | 20.6 | 2.7 | 0.9 | 4.0 |
| Qwen2.5-32B † | 27.2 | 5.1 | 34.5 | 4.6 | 7.7 | 1.0 | 3.2 | 9.7 | 0.4 | 0.5 | 6.1 |
| Event | Class | Humans | Claude Opus 5 | GPT-5.6 Sol | Gemini 3.7 Flash | Qwen2.5-32B |
|---|---|---|---|---|---|---|
| embracing | punctive | 0.50 | 0.80 | 1.00 | 0.83 | 1.67 |
| hugging | punctive | 1.21 | 1.00 | 1.00 | 1.00 | 1.00 |
| cuddling | punctive | 0.10 | 0.07 | 0.03 | 0.03 | 0.30 |
| kicking | punctive | 0.67 | 1.00 | 0.67 | 1.00 | 1.00 |
| shaking | punctive | 0.41 | 0.67 | 0.50 | 1.00 | 0.17 |
| poking | punctive | 0.40 | 1.00 | 1.00 | 1.00 | 1.00 |
| Model | Reasoning | Tool | Acc. | pp [95% CI] | OR [95% CI] | Var. | |||||
| Cubic equations | |||||||||||
| Claude Opus 5 | Default | 2,100 | 0.0% | 100.0% | 3 | – | – | – | 0/30 | ||
| None | 1,912 | 72.5% | 42.4% | 10 | 0.79 | [ , ] | [0.14, 0.48] | 18/30 | |||
| GPT-5.6 Sol | Default | 2,100 | 13.4% | 99.7% | 7 | 0.86 | [ , ] | [0.88, 1.18] | 16/30 | ||
| None | 2,100 | 53.0% | 12.7% | 19 | 0.91 | [ , ] | [0.85, 1.37] | 13/30 | |||
| Gemini 3.7 Flash | Default | 2,068 | 26.1% | 97.4% | 18 | 0.81 | [ , ] | [0.42, 0.74] | 13/30 | ||
| Model | Reasoning | Tool | Acc. | |||
| Cubic equations | ||||||
| Claude Opus 5 | Default | 300 | 0.0% | 100.0% | 4 | – |
| None | 267 | 81.4% | 40.2% | 13 | 0.59 | |
| GPT-5.6 Sol | Default | 300 | 15.3% | 99.7% | 7 | 0.61 |
| None | 300 | 61.0% | 10.3% | 18 | 0.89 | |
| Gemini 3.7 Flash | Default | 295 | 32.5% | 98.6% | 18 | 0.80 |
| Model | Reasoning | No | 1 s | 5 s | 10 s | 20 s | 30 s | 3 min | 20 min |
|---|---|---|---|---|---|---|---|---|---|
| Cubic equations | |||||||||
| Claude Opus 5 | Default | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| None | 81.4 | 77.3 | 76.9 | 71.1 | 79.6 | 73.8 | 67.0 | 50.2 | |
| GPT-5.6 Sol | Default | 15.3 | 13.3 | 15.0 | 12.7 | 12.7 | 13.0 | 12.7 | 14.7 |
| None | 61.0 | 51.7 | 55.7 | 51.3 | 50.3 | 53.7 | 54.3 | 53.7 | |
| Gemini 3.7 Flash | Default | 32.5 | 32.7 | 30.1 | 26.6 | 22.5 | 24.0 | 25.1 | 22.0 |
| Calculator use (%) | Accuracy (%) | ||||||
|---|---|---|---|---|---|---|---|
| Model | Reasoning | Easy | Medium | Hard | Easy | Medium | Hard |
| Claude Opus 5 | Default | 0.0 | 0.0 | 0.0 | 100.0 | 100.0 | 100.0 |
| None | 39.8 | 78.8 | 99.0 | 47.7 | 55.3 | 24.3 | |
| GPT-5.6 Sol | Default | 0.3 | 6.6 | 33.4 | 100.0 | 99.6 | 99.6 |
| None | 26.3 | 43.0 | 89.6 | 18.0 | 11.1 | 8.9 | |
| Gemini 3.7 Flash | Default | 0.0 | 12.6 | 65.6 | 100.0 | 98.5 | 93.8 |
| Median (%) | Median (pp) | ||||||
| Model | Reasoning | Easy | Med. | Hard | Easy | Med. | Hard |
| Cubic equations | |||||||
| Claude Opus 5 | Default | 95 | 91 | 85 | 2 | 4 | 8 |
| None | 85 | 75 | 35 | 5 | 10 | 35 | |
| GPT-5.6 Sol | Default | 97 | 95 | 65 | 3 | 4 | 33 |
| None | 93 | 85 | 35 | 6 | 13 | 63 | |
| Domain | Model | Matched tasks | Median difference (s) |
|---|---|---|---|
| Cubics | Claude Opus 5 | 0 | – |
| GPT-5.6 Sol | 16 | ||
| Gemini 3.7 Flash | 13 | ||
| Search | Claude Opus 5 | 4 | |
| GPT-5.6 Sol | 6 | ||
| Gemini 3.7 Flash | 14 |
| Model | Reasoning | Estimated (s) | Recorded (s) | Ratio ( ) |
| Cubic equations | ||||
| Claude Opus 5 | Default | [ – ] | ||
| None | [ – ] | |||
| GPT-5.6 Sol | Default | [ – ] | ||
| None | [ – ] | |||
| Gemini 3.7 Flash | Default | [ – ] | ||
| Model | Reasoning | Estimated (s) | Recorded (s) | Ratio ( ) |
|---|---|---|---|---|
| Cubic equations | ||||
| Claude Opus 5 | Default | |||
| None | ||||
| GPT-5.6 Sol | Default | |||
| None | ||||
| Gemini 3.7 Flash | Default | |||
| Believed faster, by | Actual | ||||||||
| Model | Reasoning | 1 s | 5 s | 10 s | 20 s | 30 s | 3 min | 20 min | at 1 s |
| Cubic equations | |||||||||
| Claude Opus 5 | Default | ||||||||
| None | |||||||||
| GPT-5.6 Sol | Default | ||||||||
| None | |||||||||
| Source | Median time (s) | ||||
| Model | Reasoning | Sec. 6.1 | Forced | No tool | Tool |
| Cubic equations | |||||
| Claude Opus 5 | Default | 30/60 | 30/60 | ||
| None | 48/60 | 12/60 | |||
| GPT-5.6 Sol | Default | 46/60 | 14/60 | ||
| None | 43/60 | 17/60 | |||
| Model | Reasoning | Tool | pp [95% CI] | OR [95% CI] | Var. | ||
| Cubic equations | |||||||
| Claude Opus 5 | Default | 2,098 | % | – | – | – | 0/30 |
| None | 2,039 | % | [ , ] | [ , ] | 13/30 | ||
| GPT-5.6 Sol | Default | 2,100 | % | [ , ] | [ , ] | 9/30 | |
| None | 2,100 | % | [ , ] | [ , ] | 13/30 | ||
| Gemini 3.7 Flash | Default | 2,058 | % | [ , ] | [ , ] | 11/30 | |
| Model | Reasoning | 1 s | 5 s | 10 s | 20 s | 30 s | 3 min | 20 min |
|---|---|---|---|---|---|---|---|---|
| Cubic equations | ||||||||
| Claude Opus 5 | Default | |||||||
| None | ||||||||
| GPT-5.6 Sol | Default | |||||||
| None | ||||||||
| Gemini 3.7 Flash | Default | |||||||
| Model | Reasoning | Easy | Medium | Hard | |||
| Claude Opus 5 | Default | – | – | – | |||
| None | |||||||
| GPT-5.6 Sol | Default | ||||||
| None | |||||||
| Gemini 3.7 Flash | Default | – | |||||
| None | |||||||
Temporal Reasoning in Language Models
Temporal reasoning in language models studies how models represent, order, update, and apply facts and events across time.
See all 107 papers