Overview

Sequence modeling asks how information in an ordered stream—such as words, sensor readings, user actions, or DNA—can be used to predict what comes next or interpret the sequence as a whole. Common approaches include recurrent networks such as LSTMs, Transformer attention, state-space models such as Mamba, and Markov or hidden Markov models; hybrids and diffusion methods are also used for long or structured sequences. Applications range from language and time-series forecasting to recommendation, biological analysis, and action recognition, with evaluation often testing prediction quality, long-range recall, and generalization to new lengths or domains. A central tension is balancing expressive memory and reliable long-context behavior against computation, latency, and memory costs, while ensuring benchmarks measure genuine sequence understanding rather than leakage or repetition.

Latest papers

CardsList

268 papers18 papers in the last four weeks, down 31% on the four weeks before. 0.1% of all new papers.

  1. Elucidating the Space of Enzymatic Reaction: A Unified Benchmark and Pretrained Model

    Oct 8, 2026Yutong Hu, Tianming Huang, Yanbo Zhao +6Sequence-to-Sequence ModelsChemical Reaction Prediction

  2. CASM: Context-Aware Semi-Markov Post-Processor for Beat Tracking

    Oct 7, 2026Zhanhong He, Hanyu Meng, Yaolong JuMusic Information RetrievalSequence Modeling

  3. SepsisLens: Structure-Preserving Sequence Modelling for Decomposable Early Sepsis Warning

    Oct 6, 2026Yikun Ou, Wei LiSepsis PredictionInterpretable ML

  4. How Far Back Should a Transformer Look? Repetition and Copying in Music Sequence Models

    Oct 2, 2026Amir FathiLong-Context ModelingSequence Modeling

  5. VANDAM: Viewing a nucleotide sequence with DNA molecular priors

    Sep 30, 2026Jeremy Levy, Ariel Larey, Yury Nahshan +18Self-Supervised Pre-TrainingGenomic Foundation Models

  6. RiboUnmix: Learning Shared Translational Dynamics from Biased and Noisy Ribo-seq Measurements

    Sep 30, 2026Gabriele Martino, Denis Skibinski, Ivo L. Hofacker +1Multi-Task LearningSequence Modeling

  7. Generative sequence modeling for infinite memory processes via predictive states

    Sep 29, 2026Michael Wieck-Sosa, Cosma Rohilla ShaliziConditional Distribution EstimationSequence Modeling

  8. LEMON-ZEST: Evolution-Informed Tokenization for Efficient Protein Language Modeling

    Sep 29, 2026Biswajit Banerjee, Claudia Alvarez Carreno, Anton S. PetrovProtein Language ModelsProtein Representation Learning

  9. Non-Commutative Lie-Algebraic State-Space Models: Finite-Division Variety Laws, Semidirect Cascades, and Gradient Saddle Escape

    Sep 29, 2026Zeyu JiaState Space ModelsSequence Modeling

  10. Riccati State Space Models: Non-iterative Parallelization for Nonlinear Sequence Modeling

    Sep 28, 2026Mónika Farsang, Ramin Hasani, Daniela Rus +1Sequence ModelingState Space Models

  11. ADPTNet: Adaptive with Prescriptive Timescales Non-Linear SSM for Sequence Modelling

    Sep 27, 2026Matei-Ioan Stan, Oliver RhodesParallel Training of Recurrent NetworksRecurrent Neural Networks

  12. Length-Independent State Tracking Under a Parallel Scan

    Sep 26, 2026Julien Brandoit, Arthur Fyon, Thomas Braipson +5Finite-State MachineRecurrent Neural Networks

  13. DP-Rec: Towards Dynamic Patching for Efficient Long-Sequence Recommendation

    Sep 26, 2026Dwipam Katariya, Thomas Caputo, Akshat Shreemali +6Sequential RecommendationSequence Modeling

  14. Brain-Token Learning: Microstate-Based Tokenization and Multi-Scale Interaction for Long-Horizon EEG Sequence Modeling

    Sep 21, 2026Weishan Ye, Yue Pan, Li Zhang +2ElectroencephalographySequence Modeling

  15. Stringological sequence prediction III: layered ziplines and a tradeoff between efficiency and expressivity

    Sep 17, 2026Vanessa KosoySequence ModelingSequence Prediction

  16. Behavioral Fingerprinting and Navigation Prediction in Web Browsing

    Sep 16, 2026Ralph Elsaghbini, Omran Berjawi, Walid Fahs +1User ModelingHuman Behavior Prediction

  17. HyCoSeq: Contextual Hyperbolic Representation Learning for Genomic Sequences

    Sep 15, 2026Chenhao Zeng, Zhibin Pu, Shufei GeSequence ModelingHyperbolic Representation Learning

  18. tcnerv:dual-domain temporal context modeling for implicit neural video compression

    Sep 15, 2026Xuezhi Xiang, Yixin Zhao, Heqi Xiang +2Implicit Neural RepresentationsNeural Video Compression

  19. SeqMaestro: From nucleotide sequences to biological hypotheses through interpretable machine learning

    Sep 14, 2026Evgeny S. Saveliev, Krzysztof Kacprzyk, Charlotte Capitanchik +7Interpretable MLGenomics

  20. Compressed Recurrent Feedback in Tsetlin Machines: A Reproducible Boolean-FSM Study

    Sep 5, 2026Ankit Kumar, Utkarsh Raj, Rishad Shafik +1Sequence Modeling

  21. Memory in Deep Time-Series Models

    Sep 5, 2026Minh Hoang Nguyen, Huu Hiep Nguyen, Manh Nguyen +3Memory-Augmented Neural NetworksSequence Modeling

  22. Prospective Coding Improves Learning in Deep Continuous-Time Recurrent Networks

    Sep 3, 2026Shivang Rawat, Mirko Morello, Flaviano Morone +1Recurrent Neural NetworksSequence Modeling

  23. Almost Free State Prediction Separation

    Sep 3, 2026John Langford, Nathan Godey, Giovanni Monea +5Language Model PretrainingEfficient Language Model Training

  24. A Unified Particle Filter LSTM for Data-Driven Process Simulation

    Sep 2, 2026Parvin Malekzadeh, Opher Baron, Dmitry KrassParticle FilteringProcess Mining

  25. SSAKG 2.0: An Open-Source Package for Structural Associative Sequence Memory and Context-Based Retrieval

    Sep 1, 2026Przemysław Stokłosa, Janusz A. Starzyk, Paweł RaifGraph-Based RetrievalKnowledge Graphs

  26. Stochastic Estimation of Transduced Language Models

    Aug 27, 2026Vésteinn Snæbjarnarson, Samuel Kiegeland, Manuel de Prada Corral +2Language ModelingSequence Modeling

  27. HelaBERT: Enhancing Sinhala Language Understanding with Dual Pooling Classification Head

    Aug 24, 2026Thisen Ekanayake, Nisansa de SilvaLanguage Model PretrainingLarge Language Model-Based Text Classification