Sequence Prediction

Ask about this topic

Latest papers

CardsList

33 papers5 papers in the last four weeks, down 17% on the four weeks before. 0.0% of all new papers.

  1. Efficient Lempel-Ziv Prediction with the Run-Length BWT

    Nov 1, 2026Ohad AvnerySequence PredictionNext-Event Prediction

    Computational Rational Agents Laboratory (CORAL)

  2. Polynomial-Time Minimax Prediction for Stationary Renewal Processes

    Nov 1, 2026Xinyu Chen, Yiming MaSequence Prediction

  3. Next Token or Vector? Learning How Far to Decode

    Oct 16, 2026Sai Sreenivas Chintha, Chidera Biringa, Rishab Sharma +6LLM Inference AccelerationMulti-Token Prediction

    Microsoft · University of Massachusetts Amherst

  4. SteerCast: Retrieval-Based Latent Steering for Decoder-Only Time Series Forecasting

    Oct 8, 2026Van Dai Do, Huu Hiep Nguyen, Minh Hoang Nguyen +1Multivariate Time Series ForecastingSequence Prediction

    Deakin’s Applied Artificial Intelligence Initiative Deakin University, Geelong, Australia

  5. LightMTP: Lightweight Latent Multi-Token Prediction

    Oct 5, 2026Tamara Czinczoll, Julie Kallini, Gerard de Melo +1Language Model PretrainingMulti-Token Prediction

    Hasso Plattner Institute / University of Potsdam · Stanford University · Tel-Aviv University

  6. How Far Back Should a Transformer Look? Repetition and Copying in Music Sequence Models

    Oct 2, 2026Amir FathiLong-Context ModelingSequence Modeling

    Department of Computing Science University of Alberta Edmonton, AB, Canada

  7. OpenTSLM TeeMoE: A Unified Time-Series Language Model for Forecasting, Contextual Prediction, and Reasoning

    Sep 30, 2026Tony Chen, Timo Stoffregen, Maxwell Xu +8Temporal Reasoning in Language ModelsLLM-Based Time Series Forecasting

    Columbia University, USA · Stanford University, USA · Aionic Labs, Switzerland +4

  8. Information-Theoretic Analysis of Next-Token Prediction under Markovian Data

    Sep 28, 2026Masoud Kavian, Abdellatif Zaidi, Milad SefidgaranInformation-Theoretic Generalization BoundsNext-Token Prediction

    Mathematical and Algorithmic Science Laboratory, Huawei Paris Research Center, 92100 Boulogne-Billancourt, France · Laboratoire d’Informatique Gaspard Monge, Université Gustave Eiffel, 77420 Champs-sur-Marne, France

  9. Decoupling Token Roles in Autoregressive Pretraining

    Sep 27, 2026Suqin Yuan, Runqi Lin, Kevin Qinghong Lin +4Language Model PretrainingAutoregressive Language Modeling

    University of Sydney · University of Oxford · Southeast University

  10. The Cost of Long Memory: State, Context, and Stability Complexity in Sequence Models

    Sep 24, 2026Yuheng SongSequence PredictionTime Series Forecasting

    School of Management, Huazhong University of Science and Technology

  11. Stringological sequence prediction III: layered ziplines and a tradeoff between efficiency and expressivity

    Sep 17, 2026Vanessa KosoySequence ModelingSequence Prediction

    Faculty of Mathematics, Technion, Haifa, Israel · Computational Rational Agents Laboratory, Delaware, USA

  12. SIDE: Sensor Impersonation Detection at the Edge via Sequence Prediction

    Sep 5, 2026Nahom BirhanInternet of ThingsTime-Series Anomaly Detection

    Department of Electrical and Computer Engineering Old Dominion University Virginia, USA

  13. Fast Weight Attention for Continual Learning

    Aug 27, 2026Yifan Zhang, Steve Ta, Jasper Zhang +8Recurrent Language ModelsMemory-Augmented Language Models

    Bytedance Seed · Princeton University · Hyperbolic Labs +1

  14. Truthful Calibration Measures for Sequential Prediction

    Aug 21, 2026Anagha Gokul, Jason Hartline, Lunjia Hu +2Online CalibrationSequence Prediction

    Northeastern University. Khoury College of Computer Sciences. · Northwestern University. Department of Computer Science. · Microsoft Research. Microsoft Research New England.

  15. How Far Should Tokenization Go? Predictive Effectiveness and Relational Losslessness

    Aug 18, 2026Yi WangTokenizationToken Efficiency

    Department of Electronic Engineering, Tsinghua University

  16. Sequence prediction under a lying oracle

    Aug 14, 2026Puspabeethi Samanta, Nikhil Karamchandani, Jayakrishnan NairRegret MinimizationSequence Prediction

    Department of Electrical Engineering IIT Bombay

  17. Hierarchical Latent Prediction for Language Models

    Aug 6, 2026Chang Shi, Tim Pearce, Manan Tomar +2Language Model PretrainingMulti-Token Prediction

    University of Texas at Austin · Microsoft Research

  18. Hierarchical Solomonoff Induction: An Unbounded Machine Learning Model

    Aug 2, 2026Nathan YoungHierarchical Bayesian ModelingStatistical Learning Theory

    Strong AI Lab, University of Auckland

  19. Stringological sequence prediction II: Right-to-left automaticity and related complexity measures

    Jul 19, 2026Vanessa KosoySequence PredictionSequence Modeling

    Faculty of Mathematics, Technion, Haifa, Israel · Computational Rational Agents Laboratory, Delaware, USA

  20. ReDiTT: Retrieval Augmented Conditional Diffusion Transformers for Asynchronous Time Series

    Jul 14, 2026Saiyue Lyu, Zhitian Zhang, Ruizhi Deng +1Irregular Time-Series ModelingEvent Time Prediction

    Department of Computer Science, University of British Columbia · Work done during an internship at RBC Borealis. · RBC Borealis

  21. Pretraining Recurrent Networks without Recurrence

    Jun 4, 2026Akarsh Kumar, Phillip IsolaParallel Training of Recurrent NetworksRecurrent Neural Networks

    MIT

  22. Prediction Under Imperfect Compression: A Theory of Approximate MDL

    Jun 3, 2026Qian Li, Xinyu Mao, Shang-Hua Teng +1Minimum Description LengthApproximation Algorithms

    Shenzhen Research Institute of Big Data · University of Southern California

  23. Time Series as Language: A Universal Tokenizer for General-Purpose Time Series Foundation Models

    May 31, 2026Yunhao Zhang, Ruiying Qi, Jiale Zheng +3Time Series TokenizationTime Series Generation

    Shanghai Jiao Tong University · Huawei Noah’s Ark Lab

  24. EviTrack: Selection over Sampling for Delayed Disambiguation

    May 19, 2026Omer HaqSequence PredictionSequential Hypothesis Testing

    Independent Researcher · Baltimore, MD, USA

  25. Conditional Attribute Estimation with Autoregressive Sequence Models

    May 13, 2026Erica Stutz, Giacomo Marino, Daniella Meeker +2Next-Token PredictionControllable Text Generation

    Department of Biomedical Informatics and Data Science Yale University New Haven, CT 06510 · Department of Biostatistics Yale University New Haven, CT 06510 · Department of Biomedical Informatics and Data Science, Department of Pediatrics Yale University New Haven, CT 06510

  26. The Power of Second Order Methods for Sequence Preconditioning

    May 8, 2026Annie Marsden, Elad HazanDynamical SystemsSequence Modeling

    Google DeepMind · Princeton University

  27. Sessa: Selective State Space Attention

    Apr 20, 2026Liubomyr HorbatkoAttention MechanismsSelf-Attention

  28. Stringological sequence prediction I: efficient algorithms for predicting highly repetitive sequences

    Mar 27, 2026Vanessa KosoySequence PredictionSequence Modeling

    Faculty of Mathematics, Technion – Israel Institute of Technology, Haifa, Israel 3200003. · Computational Rational Agents Laboratory (coral-research.org), 2810 N Church St PMB 49028, Wilmington, DE 19802.

  29. Thinking into the Future: Latent Lookahead Training for Transformers

    Mar 3, 2026Lorenzo Noci, Gregor Bachmann, Seyed-Mohsen Moosavi-Dezfooli +1Autoregressive Language ModelingSequence Prediction

    Apple

  30. Online Prediction of Stochastic Sequences with High Probability Regret Bounds

    Feb 18, 2026Matthias Frey, Jonathan H. Manton, Jingge ZhuSequence PredictionSequence Modeling

    Department of Electrical and Electronic Engineering, The University of Melbourne