Overview

Sequence modeling asks how information in an ordered stream—such as words, sensor readings, user actions, or DNA—can be used to predict what comes next or interpret the sequence as a whole. Common approaches include recurrent networks such as LSTMs, Transformer attention, state-space models such as Mamba, and Markov or hidden Markov models; hybrids and diffusion methods are also used for long or structured sequences. Applications range from language and time-series forecasting to recommendation, biological analysis, and action recognition, with evaluation often testing prediction quality, long-range recall, and generalization to new lengths or domains. A central tension is balancing expressive memory and reliable long-context behavior against computation, latency, and memory costs, while ensuring benchmarks measure genuine sequence understanding rather than leakage or repetition.

Latest papers

CardsList

268 papers18 papers in the last four weeks, down 31% on the four weeks before. 0.1% of all new papers.

  1. The Mask Is Not the Model: Auditing Prefix Invariance in Attention, State-Space, and Hybrid Sequence Models

    Aug 24, 2026Taebong Kim, Youngsik Hong, Minsik Kim +3LLM AuditingSequence Modeling

  2. Mechanistic Interpretability of Structure-Aware Numerical Reasoning in LLaMA 3.1 8B

    Aug 19, 2026Rahul Chowdhury, Timothy A Rupprecht, Senhao Cao +5Numerical Reasoning in Language ModelsLLM Interpretability

  3. How Far Should Tokenization Go? Predictive Effectiveness and Relational Losslessness

    Aug 18, 2026Yi WangTokenizationToken Efficiency

  4. RecipeNet: A Hierarchical Transformer for Recipe Data

    Aug 14, 2026Pin-Yen Huang, Sachin Chhabra, Prasanth Sai Gouripeddi +2Representation LearningHierarchical Representation Learning

  5. Learning to Forecast Crop Growth from Earth Observation Data

    Aug 14, 2026Dominik Senti, Mehmet Ozgur Turkoglu, Michele Volpi +1Sequence-to-Sequence ModelsAgricultural Remote Sensing

  6. Sequence prediction under a lying oracle

    Aug 14, 2026Puspabeethi Samanta, Nikhil Karamchandani, Jayakrishnan NairRegret MinimizationSequence Prediction

  7. Cross-View Sequential Visual Localization with Spatio-Temporal Context Modeling for Autonomous Driving

    Aug 11, 2026Jiaping Wang, Shaobo Li, Zhen WangCross-View Geo-LocalizationAutonomous Driving

  8. ChronoSSM: Training for Temporally Aware Representations in Autoregressive State Space Models

    Aug 10, 2026Adrien Schoen, Nachiketa Ratnakar Patil, Arjun Bhagoji +1Representation LearningTemporal Representation Learning

  9. Recurrent Neural Networks Beyond Time: Learning from Multiple Ordered Projections

    Aug 10, 2026Vagan Terziyan, Artur Terziian, Oleksandra VitkoMulti-View LearningRecurrent Neural Networks

  10. iStructTab: Structured Feature Sequencing for Multimodal Learning of Image and Tabular Data

    Aug 5, 2026Al Zadid Sultan Bin Habib, Md Younus Ahamed, Prashnna Gyawali +2Sequence ModelingMultimodal Learning

  11. Entity-Aware Sequence Transduction for Player-Centric Ball Action Spotting

    Aug 3, 2026Ruifeng Wang, Di Yang, Jiangtao WangSports Video AnalysisTemporal Action Detection

  12. Evolutionary Curriculum Learning Improves Biological Sequence Modeling

    Aug 1, 2026Richard Zhu, Kento NishiVariational Autoencodersprotein mutation effect prediction

  13. PTP: Previous-Token Prediction based LLM Inversion for Near-Exact Prompt Reconstruction

    Jul 31, 2026Pirzada Suhail, Nagasai Saketh Naidu, Atanu R Sinha +1LLM PromptingNext-Token Prediction

  14. Revisiting Predictive Process Monitoring in the Age of Foundation Models: A Comparative Study of Sequence, Tabular, and LLM Approaches

    Jul 30, 2026Lennart Fertig, Lukas Kirchdorfer, Tobias SesterhennTabular Foundation ModelsPredictive Process Monitoring

  15. Modeling Decisions in Blockchain Analytics: A Leakage-Aware Evaluation of Tree-Based vs. Sequential Models

    Jul 29, 2026Michał Bartnicki, Jarosław A. ChudziakData LeakageSequence Modeling

  16. GraphIDyOM: A graph-native Python reimplementation of IDyOM for musical expectation modelling

    Jul 28, 2026Lluc Bono RossellóSequence Modeling

  17. A scaling law of contextual persistence in human language

    Jul 28, 2026Elan BarenholtzLong-Range Dependency ModelingSequence Modeling

  18. StageGuard: Physiologically Constrained Sleep Staging

    Jul 25, 2026Juntang Wang, Yihan Wang, Hao Wu +3Constrained DecodingSleep Stage Classification

  19. End-to-End Markov State Sequence Learning for Auditory Attention Decoding

    Jul 21, 2026Yushan Yashengjiang, Jie Zhang, Miao Sun +3Markov ModelsNeural Decoding

  20. Stringological sequence prediction II: Right-to-left automaticity and related complexity measures

    Jul 19, 2026Vanessa KosoySequence PredictionSequence Modeling

  21. RTL-Sequencer: Towards Scalable RTL Timing Prediction with the Sequence-based Paradigm

    Jul 17, 2026Ziyan Guo, Wenji Fang, Wenkai Li +3Electronic Design AutomationSequence Modeling