Overview

Sequence modeling asks how information in an ordered stream—such as words, sensor readings, user actions, or DNA—can be used to predict what comes next or interpret the sequence as a whole. Common approaches include recurrent networks such as LSTMs, Transformer attention, state-space models such as Mamba, and Markov or hidden Markov models; hybrids and diffusion methods are also used for long or structured sequences. Applications range from language and time-series forecasting to recommendation, biological analysis, and action recognition, with evaluation often testing prediction quality, long-range recall, and generalization to new lengths or domains. A central tension is balancing expressive memory and reliable long-context behavior against computation, latency, and memory costs, while ensuring benchmarks measure genuine sequence understanding rather than leakage or repetition.

Latest papers

CardsList

268 papers18 papers in the last four weeks, down 31% on the four weeks before. 0.1% of all new papers.

  1. STEP: Career-Path Recommendation via Temporal and Educational Trajectory Modeling

    Jul 13, 2026Iman Johary, Guillaume Bied, Alexandru C. Mara +1Sequence Modeling

  2. RecRec: Recursive Refinement for Sequential Recommendation

    Jul 12, 2026Pervez Shaik, Prosenjit Biswas, Abhinav Thorat +2Sequential RecommendationIterative Refinement

  3. A Foundation Model for Multimodal Event Sequences in Financial Applications

    Jul 10, 2026Nikita Rusakov, Vladislav Meshkov, Konstantin Zorin +4Financial ServicesMultimodal Pretraining

  4. TS-Mask VLA: 2D Temporal-Spatial Masking for Vision-Language-Action Model with Effective Bridging

    Jul 10, 2026Shengzhuo Yang, Ronghao Yu, Chuanjie Lv +5Vision-Language-Action ModelsRobot Motion Generation

  5. Event-Based Token Sequences for Audio-Conditioned Music-Game Level Modeling

    Jul 10, 2026Ke Zhang, Chu-Hsuan Hsueh, Kokolo IkedaProcedural Content GenerationConditional Generative Modeling

  6. Tensorized algorithms and scalable filtering methods for hidden Markov and factorial hidden Markov models

    Jul 8, 2026Roxana Barrios, Ioannis SgouralisBayesian FilteringSequence Modeling

  7. Zeus: Towards Tuning-Free Foundation Model for Time Series Analysis

    Jul 2, 2026Yisong Fu, Zezhi Shao, Chengqing Yu +4Zero-Shot Time Series ForecastingMulti-Task Learning

  8. MuonSSM: Orthogonalizing State Space Models for Sequence Modeling

    Jun 29, 2026Thai-Khanh Nguyen, Ngoc-Bich-Uyen Vo, Thieu N. Vo +2Long-Context ModelingSequence Modeling

  9. From Clicks to Intent: Cross-Platform Session Embeddings with LLM-Distilled Taxonomy for Financial Services Recommendations

    Jun 24, 2026Dianjing Fan, Yao Li, Kyaw Hpone Myint +4Sequential RecommendationRepresentation Learning

  10. Latent Block-Diffusion Temporal Point Processes: A Semi-Autoregressive Framework for Asynchronous Event Sequence Generation

    Jun 23, 2026Shuai Zhang, Yancheng Chen, Chuan Zhou +5Temporal Point ProcessesLatent Diffusion Models

  11. Text Distance from Nested and Hierarchical Repetitions: A Compression-Based Perspective

    Jun 23, 2026Xiaojun Hu, Jing Wang, Jingwen Zhang +5Text ClassificationSequence Modeling

  12. Scalable Bayesian Additive Models for Stellar Flare Detection via Amortized Gaussian Process Inference and Hidden Markov Models

    Jun 21, 2026Rodrigo Herrera, Vianey Leos-Barajas, Gwendolyn Eadie +2Neural Surrogate ModelingAmortized Inference

  13. Test-Time Training with Next-Token Prediction

    Jun 19, 2026Xuan Ouyang, Zefan Cai, Junjie HuLong-Context Language ModelingNext-Token Prediction

  14. SOHET: Sequence Of Heterogeneous Events Transformer with Self-Supervised Pre-Training

    Jun 19, 2026Kees Jan de Vries, Mustafa Radha, Mathijs de JongTransformerSelf-Supervised Pre-Training

  15. Topological Neural Dynamics: A Neuron-wise Framework for Sequence Modeling

    Jun 19, 2026Borui Cai, Yao ZhaoDynamical SystemsDynamic Neural Networks

  16. JourneyFormer: Encoding Airbnb Guest Journey with Sequence Modeling

    Jun 17, 2026Daochen Zha, Chun How Tan, Xin Liu +9Learning to RankUser Modeling

  17. Graph Grounded Cross Attention Transformer Neural Network for Structurally Constrained Full Event Sequence Generation in Predictive Process Monitoring

    Jun 17, 2026Fang Wang, Ernesto DamianiPredictive Process MonitoringProcess Mining

  18. Protein-Based Fish Species Identification: Dataset, Models, and Insights from Native Bangladeshi Fish

    Jun 16, 2026Md Nasiat Hasan Fahim, Md. Abid Ullah Muhib, Mohammad Shahidur RahmanHybrid CNN-Transformer ArchitecturesProtein Language Models

  19. Machine learning modeling of hit-into-play probability and quantification of pitch sequence effects

    Jun 15, 2026Ryota Takamido, Hiroki NakamotoSequence Modeling

  20. Moonlight in Latent Space: Chirality and Structural Correspondence Between Beethoven's Op. 27 No. 2 and Machine Learning Mechanisms

    Jun 12, 2026Chen Ying Claude, Zhihan LuoMusic Information RetrievalSequence Modeling

  21. LongSpike: Fractional Order Spiking State Space Models for Efficient Long Sequence Learning

    Jun 11, 2026Xinrui He, Qiyu Kang, Xuhao Li +1Long-Context ModelingSpiking Neural Networks

  22. On Subquadratic Architectures: From Applications to Principles

    Jun 10, 2026Anamaria-Roberta Hartl, Levente Zólyomi, David Stap +6Sequence Modeling