Sequence Modeling

Ask about this topic

Momentum

40 papers in the last four weeks, up 135% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 264

All topics
CardsList

  1. CT-Miner: Fast and Coarse-Grained Time-Series Pattern Mining via Cartesian Trees

    Oct 4, 2026Hyundong Jin, Hyunki Hong, Yo-Sub HanSequence ModelingTime-Frequency

    Department of Computer Science Yonsei University, Seoul, Republic of Korea

  2. LogSig-SSM: Time-Series Modelling with Multi-Scale Log-Signature Compression for State-Space Models

    Oct 4, 2026Felix Oury, Nicolas Calvo Peiro, Reiko J. TanakaState Space ModelsSequence Modeling

    Department of Computing Imperial College London · Department of Bioengineering Imperial College London

  3. Generative modeling of intrinsically disordered protein regions by reinforcing sparse autoencoder features

    Oct 1, 2026Jason X. Liu, Sebastian Ibarraran, Frank Hu +7Protein DesignSparse Autoencoder Features

    Stanford University

  4. A foundation for systematic analysis of transformers and RNNs for tractography

    Oct 1, 2026Emmanuelle Renauld, Philippe Poulin, Hugo Larochelle +2Magnetic Resonance ImagingTransformer Architectures

    Computer Sciences Department, Université de Sherbrooke · Mila, Université de Montréal · Imeka Solutions Inc, Sherbrooke, QC, Canada

  5. LineupRL: Verifiable Reinforcement Learning for Time Series Captioning via Caption-to-Series Identification

    Oct 1, 2026Haochen Zhang, Laura Yao, Zachary Plotkin +2Video CaptioningReinforcement Learning With Verifiable Reward

    University of North Carolina at Chapel Hill · Foci Labs

  6. World Motion Models: Flexible Sequence Modeling of SE(3) Trajectories

    Oct 1, 2026Jiahui Lei, Qianqian Wang, Trevor Darrell +1Cross-Embodiment RetargetingRigid-Body Dynamics

    UC Berkeley · Harvard University

  7. Mixture of Decoders for Diverse Dialog Response Generation

    Sep 30, 2026Wenchao DuConditional Variational AutoencoderDiversity

    Microsoft Corporation Redmond, WA 98052

  8. VANDAM: Viewing a nucleotide sequence with DNA molecular priors

    Sep 30, 2026Jeremy Levy, Ariel Larey, Yury Nahshan +18Genome-Wide Association StudySequence Modeling

    Applied AI Architecture, NVIDIA, Israel. · Worldwide Field Ops, NVIDIA, Israel. · Developer Programs, NVIDIA, Israel. +3

  9. TTLab at Daleel 2026: STAR-Ar, Sequence Tagging for Argument Recognition in Arabic

    Sep 30, 2026Bhuvanesh Verma, Ali Abusaleh, Alexander MehlerArabic Natural Language ProcessingArabic

    Text Technology Lab (TTLab), Goethe University Frankfurt

  10. Shared Phase and Retention Control for Efficient Adaptive Spectral Recurrence

    Sep 30, 2026Wentao Wang, Hengyu Zhong, Yunhan Jiang +2Frequency-Aware RegularizationSequence Modeling

    Peking University · GigaAI

  11. Provable Test-Time Scaling for Beam Search in LLM Reasoning

    Sep 29, 2026Qijia He, Yu Huang, Yuan Cheng +2Beam SearchLLM Reasoning Strategies

    The Ohio State University · University of Pennsylvania · National University of Singapore

  12. Generative sequence modeling for infinite memory processes via predictive states

    Sep 29, 2026Michael Wieck-Sosa, Cosma Rohilla ShaliziNext-State PredictionSequence Modeling

    Department of Statistics & Data Science Carnegie Mellon University

  13. Decompose Radicals, Then Reward: Fine-Grained Inspection for Accurate Chinese Text Rendering

    Sep 29, 2026Yazhen Xie, Xingsong Ye, Zhineng ChenOptical Character RecognitionText-To-Image

    Institute of Trustworthy Embodied AI, Fudan University · Shanghai Key Laboratory of Multimodal Embodied AI

  14. SMat-Attention: Structured Long-Context Sequence Modeling

    Sep 28, 2026Emile Anand, Abdullah Ateyeh, Archer Wang +1Linear AttentionSequence Modeling

    Massachusetts Institute of Technology

  15. Riccati State Space Models: Non-iterative Parallelization for Nonlinear Sequence Modeling

    Sep 28, 2026Mónika Farsang, Ramin Hasani, Daniela Rus +1State Space ModelsSequence Modeling

    TU Wien · MIT CSAIL · Liquid AI

  16. FAST-Brain: A Flow-Aligned Spatio-Temporal Surrogate Brain Model

    Sep 28, 2026Shucheng Liu, Changchun Shi, Kai Zhang +1SubspaceSpatiotemporal

    University of North Carolina at Chapel Hill · London School of Economics and Political Science

  17. SPINET: Sheaf Protein Inverse Folding Network

    Sep 28, 2026Jens Lundsgaard, Colin Mikulski, Zhixuan Yan +1Protein Structure PredictionProtein

    Department of Computer Sciences, University of Wisconsin–Madison, Madison, WI, USA · Department of Mathematics, University of Wisconsin–Madison, Madison, WI, USA · Department of Biomedical Engineering, University of Wisconsin–Madison, Madison, WI, USA +4

  18. ADPTNet: Adaptive with Prescriptive Timescales Non-Linear SSM for Sequence Modelling

    Sep 27, 2026Matei-Ioan Stan, Oliver RhodesNeuromorphic ComputingSpiking Neural Networks

    International Centre for Neuromorphic Systems The University of Manchester Manchester, United Kingdom

  19. Native Association: Confidence-Aware Human Perception in the Wild with a Foundation VLM

    Sep 27, 2026Igal Dmitriev, Ofir LibaFine-Grained Video UnderstandingOptical Character Recognition

    WSC Sports, Tel Aviv, Israel

  20. pylazaro: a Python package for anglicism extraction in Spanish

    Sep 24, 2026Elena Alvarez-MelladoSpanishPython

    Department of Linguistics Universidad Autónoma de Madrid

  21. A Systematic Benchmark of Explainable Methods for Temporal Attribution in Sequential Recommendation Systems

    Sep 23, 2026Akash Pandey, Kanisha Shah, Addrish Roy +5Multimodal Recommendation ModelSequential Recommendation

    Capital One, AI Foundations San Jose, CA, USA · Capital One, AI Foundations New York, NY, USA · Capital One, AI Foundations McLean, VA, USA +1

  22. Rolling Conformal Prediction in Sequential Model Training

    Sep 22, 2026Chen Cheng, Ruiting Liang, Rina Foygel BarberOnline Conformal PredictionSequence Modeling

    Department of Statistics, University of Illinois Urbana-Champaign · Department of Statistics, Harvard University · Department of Statistics, University of Chicago

  23. MT-ProtBERT: Multi-task Learning ProtBERT for Intrinsically Disordered Proteins Classification with Scarce Data

    Sep 21, 2026Jian Sun, Kingshuk Ghosh, Lilianna Houston +1Protein Structure PredictionProtein

    Department of Computer Science, Ritchie School of Engineering and Computer Science, University of Denver, 2155 E Wesley Ave, Denver, CO 80210 · Department of Surgery, David Geffen School of Medicine at the University of California, Los Angeles, 10833 Le Conte Ave, Los Angeles, CA 90095 · Department of Physics and Astronomy, at the University of Denver, CO 80210 +1

  24. Extracting Arguments, Not Just Classifying Them: Instruction-Tuned LLMs for Generative Component Detection

    Sep 21, 2026Sofiane Elguendouze, Erwan Hain, Elena Cabrio +1Argumentation FrameworksSequence Modeling

    UniCA, I3S, MARIANNE · Universit´e Cˆote d’Azur, CNRS, INRIA, I3S Sophia-Antipolis, France · UniCA, MARIANNE +2

  25. Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation

    Sep 21, 2026Aoxiang Fan, Corentin Dumery, Nicolas Talabot +1Visual Geometry Grounded TransformerMulti-View

    CVLab, EPFL Switzerland

  26. QLoRA Fine-Tuning of Ministral LLM for Sequence-to-Function Protein Annotation

    Sep 21, 2026Demian Pavlyshenko, Bohdan PavlyshenkoMessenger RnaLarge Language Model Annotations

  27. ShapeLex: Decoupling Local Shape Symbolization and Global Scale Modeling for Text-Controlled Time Series Generation

    Sep 21, 2026Subo Wei, Jianqi Gao, Mingyan Fan +3Time-Series GenerationText Generation

    School of Computer Engineering and Science, Shanghai University, Shanghai, China · Shanghai Institute of Applied Physics, Chinese Academy of Sciences, Shanghai, China

  28. Tool-Augmented On-Policy Distillation for LLM Domain Adaptation in Sequence-Based Omics Tasks

    Sep 20, 2026Jie Ying, Zhefan Wang, Zihong Chen +11Multi-Omic IntegrationReasoning Benchmark

    Shanghai Artificial Intelligence Laboratory · Yazhouwan National Laboratory · Shanghai Innovation Institute +2

  29. Intrinsic Sequence-Likelihood Confidence in Retrieval-Dominated Extractive QA: Two Pre-Specified Negatives, and What They Do and Do Not Attribute

    Sep 17, 2026Gunwoo Lee, Changmin Sung, Sang-Hwan Gwak +3Large Language Model ReliabilityNegative Results

    Large-scale AI Research Center, Korea Institute of Science and Technology Information (KISTI), 245 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea. · Department of Applied AI, University of Science and Technology (UST), 217 Gajeong-ro, Yuseong-gu, Daejeon, 34113, Republic of Korea.

  30. Stringological sequence prediction III: layered ziplines and a tradeoff between efficiency and expressivity

    Sep 17, 2026Vanessa KosoySequence ModelingStructural Complexity

    Faculty of Mathematics, Technion, Haifa, Israel · Computational Rational Agents Laboratory, Delaware, USA

  31. Delphi Scanner: efficient and interpretable static malware detection via API sequence modeling

    Sep 17, 2026Bijied Brahimi, Vincent Cohadon, Gabriel Glazman +3MalwareMalicious Agents

    Université Paris Cité, Paris, France · Institut Polytechnique de Paris, Télécom Paris, Palaiseau, France

  32. Variational Quantum Transformer Architecture for Synthetic Language Generation

    Sep 16, 2026Julian Hager, Michael Kölle, Gerhard Stenzel +3Transformer ArchitecturesAutoregressive Token Prediction

    Institute of Informatics, LMU Munich, Oettingenstraße 67, 80538 Munich, Germany

  33. On the Importance of Gating: Memorization vs. In-Context Learning in State Space Models

    Sep 15, 2026William L. Tong, Aryo Lotfi, Emmanuel Abbe +6State Space ModelsSequence Modeling

    Harvard University · Apple

  34. What Does Layer-Importance Reveal About Transformers and State-Space Models?

    Sep 15, 2026Istabrak Abbes, Nizar Islah, Irina Rish +1Transformer ArchitecturesTransformer Residual Streams

    Chandar Research Lab · Mila - Quebec AI Institute · Université de Montréal +2

  35. Complete Suffix Prediction for Recommendation via Latent Retrieval over Process Graphs

    Sep 14, 2026Sarra Madad, Myriam Maumy, Fr{é}d{é}ric Bertrand +1Graph-Based RetrievalGraph Representations

    UTT, LIST3N - OPTI, QAD · LIST3N Lab, AI Lab · University of Technology of Troyes (UTT), QAD +11

  36. RunningTensor: Generalizing Linear Attention to Higher-Order Recurrent States

    Sep 14, 2026Luca Herranz-Celotti, Vincent GuigueKimi Delta AttentionRecurrent State

    ISIR Sorbonne, France

  37. SeqMaestro: From nucleotide sequences to biological hypotheses through interpretable machine learning

    Sep 14, 2026Evgeny S. Saveliev, Krzysztof Kacprzyk, Charlotte Capitanchik +7Genome-Wide Association StudyBioinformatics

    Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK · The Francis Crick Institute, London, UK · UK Dementia Research Institute at King’s College London, London, UK +1

  38. GGUF-Metadata Prediction of Single-Sequence llama.cpp Throughput Across Three Systems

    Sep 14, 2026Xinyu Qiu, Chuhong Xu, Bo Su +3Sequence ModelingMean Squared Error

    Northeastern University · Sofia University · Indiana University +2

  39. Improving Cross-Lingual Token Representations by Adding a Pinch of SALT

    Sep 9, 2026Guillem RamírezCross-EncoderMotion-Language Alignment

    ILCC, University of Edinburgh

  40. SequenceO1: End-to-End Ultra-Long (100K) Sequence Modeling in Recommendation with Low-Rank Caching

    Sep 8, 2026Lin Guan, Jia-Qi Yang, Zhishan Zhao +15Multimodal Recommendation ModelSequential Recommendation

    ByteDance

  41. Out-of-Distribution Generalisation with Sequence Models in Offline Multi-Agent Reinforcement Learning

    Sep 3, 2026Oussama Hidaoui, Omer Ebead, Ulrich Armel Mbou Sob +14Multi-Agent Reinforcement LearningOut-Of-Distribution

    InstaDeep · AIMS · Stellenbosch University

  42. WIDE: Wildcard Inference with Dynamic Expansion for Cross-Modal Generative Retrieval

    Sep 3, 2026Teng Guo, Xin Wang, Jiayou Xu +3Cross-ModalCross-Encoder Reranking

  43. BASP: Communication-Efficient Batch-Aware Sequence Parallelism for LLM Training

    Sep 2, 2026Bigyan Ghimire, Jon C. CalhounLarge Language Model TrainingSequence Modeling

    Holcombe Department of Electrical and Computer Engineering Clemson University Clemson, USA

  44. SymFold: Synergizing Evolutionary and Structural Priors for Accurate Protein Inverse Folding

    Sep 1, 2026Handong Wang, Jiaxin Qi, Baisheng Lai +1Sequence ModelingInverse Design

    Computer Network Information Center, Chinese Academy of Sciences · University of Chinese Academy of Sciences

  45. From Language to Behavior: Scaling Sequence Transformers for Industrial Recommendation Ranking with Rec-Native Designs

    Sep 1, 2026Jie Chen, Xiangqian Yu, Yanchao Lian +9RecommendationSequential Scaling

    ByteDance

  46. A Dataset for Modeling Iterative Problem-Solving

    Sep 1, 2026Fagun Patel, Sang T. Truong, Duc Q. Nguyen +4Problem Solving CapabilityAi-Assisted Programming Tasks

    Stanford University · National University of Singapore

  47. Hyper-Fold: Exploring the Expressive Limit of Sequence-Geometry Learning for Proteins via Hypergraph Modeling

    Aug 29, 2026Yifan Feng, Guanjie Cheng, Shihui Ying +2ProteinGeometric Machine Learning

    1{School of Software, BNRist, THUIBCS}, Tsinghua University, Beijing 100084, China · School of Software Technology, Zhejiang University, Ningbo 315100, China · 3Shanghai Institute of Applied Mathematics and Mechanics, School of Mechanics and Engineering Science, Shanghai University, Shanghai 200072, China +1

  48. The Mask Is Not the Model: Auditing Prefix Invariance in Attention, State-Space, and Hybrid Sequence Models

    Aug 24, 2026Taebong Kim, Youngsik Hong, Minsik Kim +3Sequence ModelingReal-World Cloud Fault Injection Dataset

    VIDRAFT AI Research · QuantumOS, Seoul, Republic of Korea

  49. WorldToken: Time-First Sequence Modeling for Robotic Imitation Learning

    Aug 23, 2026Chunkai Yang, Andong Yang, Di Huang +2Discrete Action TokenizersEfficient World-Action Model

    School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, China. · Department of Electronic Engineering, Tsinghua University, Beijing, China. · Institute for AI Industry Research, Tsinghua University, Beijing, China.

  50. Sequence prediction under a lying oracle

    Aug 14, 2026Puspabeethi Samanta, Nikhil Karamchandani, Jayakrishnan NairSequence ModelingOracles

    Department of Electrical Engineering IIT Bombay

  51. Jointly Predicting Courses and Grades Using a Transformer-Based Model

    Aug 13, 2026Paul SavalaForecasting BackboneSequence Modeling

    Mathematics, St. Edward’s University, 3001 S Congress Ave, Austin, 78704, TX, USA. · S Congress Ave

  52. Probing and steering biology across Boltz-1s trunk-diffusion boundary

    Aug 11, 2026Piotr Jedryszek, Tongmeng Xie, Adam Winnifrith +5Protein Structure PredictionModel Activations

    Department of Biology, University of Oxford, Oxford, UK · Evolvere Biosciences, London, UK · Independent Researcher +4

  53. MAD-HOI: Masked Autoregressive Diffusion for Generating Articulated Hand Object Interactions from Text

    Aug 10, 2026Ananya Bal, Kartik Sharma, Ethan Lai +4Hand-Object Interaction DetectionHuman Motion Generation

    Carnegie Mellon University

  54. ChronoSSM: Training for Temporally Aware Representations in Autoregressive State Space Models

    Aug 10, 2026Adrien Schoen, Nachiketa Ratnakar Patil, Arjun Bhagoji +1Dual-Branch Temporal ModelingAutoregressive Model

    Institut universitaire de France

  55. Recurrent Neural Networks Beyond Time: Learning from Multiple Ordered Projections

    Aug 10, 2026Vagan Terziyan, Artur Terziian, Oleksandra VitkoRecurrent Neural NetworksSequence Modeling

    Faculty of Information Technology, University of Jyväskylä, FINLAND · Faculty of Informatics and Statistics, Prague University of Economics and Business, Czech Republic · Department of Artificial Intelligence, Kharkiv National University of Radio Electronics, Ukraine

  56. MixFormer: Linear Transformer with Mixture of Memory Experts

    Aug 10, 2026Yu Guo, Lei DuanKimi Delta AttentionEfficient Long-Context Inference

    School of Computer Science, Sichuan University Chengdu, China · School of Artificial Intelligence, Sichuan University Chengdu, China

  57. HOPPER: Learnable Hop Extraction for Linearized Graph Sequence Models

    Aug 10, 2026Isuru Herath, Arin Gopakumar, Sharan SahuMessage Passing Neural NetworksSequence Modeling

    Carnegie Mellon University · UC Berkeley · Cornell University

  58. Temperature-Driven Sequential Modeling for the Prediction of Annual Power Conversion Efficiency Profiles of Organic Photovoltaic Materials: Douala Case Study

    Aug 9, 2026Steve Cabrel Teguia Kouam, Rockefeller Rockefeller, Raoult Dabou Teukam +4PhotovoltaicConformational Ensembles

    Department of Physics, Faculty of Science, University of Douala, Douala, PO. Box 24157, Littoral, Cameroon. · Division of Applied Mathematics, Faculty of Science, Stellenbosch University, Stellenbosch, South Africa. · Department of Engineering, University of Quebec in Abitibi-T´emiscamingue, Quebec, Canada. +1

  59. Modular TTT: Rethinking Test-Time Training as Composable Modules

    Aug 7, 2026Bohao Tang, Zhen Qin, Yuqi Pan +3Test-Time TrainingSequence Modeling

    Shanghai Jiao Tong University · Shanghai Innovation Institute · ByteDance Seed

  60. State Propagation Also Satisfies: A Complex-Valued State-Space Model for Deterministic State Tracking

    Aug 4, 2026Xiaohe Li, Yang LuState Space ModelsSequence Modeling

    GuangDong Police College · Department of Computer Science and Technology, School of Informatics, Xiamen University