Overview

State tracking asks whether a model can keep an accurate account of what has happened and use it to interpret later inputs or choose actions. Approaches include recurrent networks and state-space models that update hidden states, Transformers that infer state from context, and explicit memories, state machines, or structured records that agents update and retrieve. Evaluations range from synthetic counting and permutation tasks to dialogue benchmarks such as MultiWOZ, video entity and event tracking, and long-horizon agent tasks. Explicit state representations can improve reliability, but models still struggle with long sequences, changing or partially observed states, and generalizing learned updates; greater representational power does not ensure that training will discover robust tracking mechanisms.

Latest papers

CardsList

99 papers20 papers in the last four weeks, down 17% on the four weeks before. 0.1% of all new papers.

  1. Tracking vs. Deciding: The Dual-Capability Bottleneck in Searchless Chess Transformers

    Mar 31, 2026Quanhao Li, Wei JiangInstance ReweightingGame-Playing Agents

  2. Mamba-3: Improved Sequence Modeling using State Space Principles

    Mar 16, 2026Aakash Lahoti, Kevin Y. Li, Berlin Chen +5State Space Language ModelsSequence Modeling

  3. SVCBench: A Streaming Video Counting Benchmark for Spatial-Temporal State Maintenance

    Mar 13, 2026Pengyiang Liu, Zhongyue Shi, Hongye Hao +7VLM EvaluationStreaming Video Understanding

  4. Dynamic Knowledge Fusion for Multi-Domain Dialogue State Tracking

    Mar 11, 2026Haoxiang Su, Ruiyu Fang, Liting Jiang +2State TrackingTask-Oriented Dialogue Systems

  5. Can Vision-Language Models Solve the Shell Game?

    Mar 9, 2026Tiedong Liu, Wee Sun LeeVisual Object TrackingTemporal Video Understanding

  6. The Expressive Limits of Diagonal SSMs for State-Tracking

    Mar 2, 2026Mehran Shakerinava, Behnoush Khavari, Siamak Ravanbakhsh +1State Space ModelsState Tracking

  7. On the "Induction Bias" in Sequence Models

    Feb 20, 2026M. Reza Ebrahimi, Michaël Defferrard, Sunny Panchal +1TransformerState Tracking

  8. Learning State-Tracking from Code Using Linear RNNs

    Feb 16, 2026Julien Siems, Riccardo Grazzi, Korbinian Pöppel +3Recurrent Neural NetworksState Tracking