Recurrent Model

Ask about this topic

Momentum

27 papers in the last four weeks, up 800% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 98

All topics
CardsList

  1. Towards Looped Models Done Right, Part II: Rethinking at Fixed Points

    Oct 5, 2026Benhao Huang, Chufan Shi, Junlin Chen +4Recurrent Model

    Institute of Foundation Models · CMU · USC

  2. Balancing Memory Pathways: Analyzing and Improving Memory Utilization in Hybrid LMs

    Oct 5, 2026Hyunji Lee, Joykirat Singh, Zaid Khan +5Recurrent Model

    UNC Chapel Hill · The University of Texas at Austin · Mila +1

  3. Voltic: Distinguishing Volatility from Stochasticity in Recurrent Memory

    Oct 5, 2026Parsa Hejabi, Morteza Dehghani, Payam PirayRecurrent Model

    University of Southern California

  4. Closing the Loop: Practical Training Recipes for Looped Language Models

    Sep 30, 2026Andrei Marchenko, Viacheslav Bezrukov, Oleg Kashurin +5Recurrent ModelLoop

    RND NLP, DAIMLD, Russian Federation

  5. LOCI: Spatial Linear Memory for Streaming World Models

    Sep 30, 2026Ji Xia, Tingting Liao, Xuezhi Liang +2Spatial MemoryRecurrent Model

    Institute of Foundation Models, Mohamed bin Zayed University of Artificial Intelligence · Mohamed bin Zayed University of Artificial Intelligence · Pinscreen

  6. Finite-Horizon Fisher Memory in Two-Sided Power-Bounded Recurrent Systems

    Sep 30, 2026Jeonghoon LeeFisher Information MatrixRecurrent Model

    Attractor Dynamics Inc.

  7. Linear Recurrent Memory Suffices to Distil a World-Model Policy for Robot Air Hockey

    Sep 30, 2026F. Olivia Fan, Oliver ObstRecurrent ModelState-Tracking

    UNSW Sydney, NSW 2052, Australia

  8. Uncovering Uncontrolled Repetition through Residual Stream Dynamics

    Sep 30, 2026Yuanhe Zhang, Xinyao Zhou, Haoran Gao +5RepetitionAutoregressive Language Models

    Beijing University of Posts and Telecommunications · JIUTIAN Research · Nanyang Technological University +1

  9. Continual Learning of Dynamical Systems in Recurrent Neural Networks through Recyclable Unit Gating

    Sep 29, 2026Sima Hashemi, Daniel Durstewitz, Georgia KoppeRecurrent Neural NetworksRecurrent Model

    Faculty of Mathematics and Computer Science, Interdisciplinary Center for Scientific Computing, Heidelberg University, Heidelberg, Germany · Department of Theoretical Neuroscience, Central Institute of Mental Health (CIMH), Medical Faculty Mannheim, Heidelberg University, Heidelberg, Germany · Hector Institute for AI in Psychiatry & Department of Psychiatry and Psychotherapy, CIMH, Medical Faculty Mannheim, Heidelberg University, Heidelberg, Germany +1

  10. ReLMem: Learning Recurrent Memory for Longitudinal EHR Modeling

    Sep 29, 2026Zijie Meng, Xiwei Dai, Yingying Zhang +3Electronic Health RecordsRecurrent Model

    Zhejiang University · Tencent Jarvis Lab

  11. MS-GLA: Multi-Scale Gated Linear Attention for Addressing Representational Bottlenecks via Multi-Temporal Resolution

    Sep 28, 2026Prasoon Dev, Anirudh Sankar, Vasudeva VarmaLinear AttentionMulti-Scale Attention

    Language Technologies Research Center International Institute of Information Technology Hyderabad Hyderabad, Telangana, India

  12. Multilinguality in Hybrid Attention LLMs

    Sep 28, 2026Lucas Bandarkar, Junlin Hu, Chenyuan Yang +2Multilingual Language ModelsMultilingual

    University of California, Los Angeles · Fudan University

  13. ReCAT: Remember, Count, and Time: Structured Recurrent Memory for Robot Manipulation

    Sep 28, 2026Pankhuri Vanjani, Mostafa Hatab, Can Mizrakli +4Robotic ManipulationRecurrent Model

    Intuitive Robots Lab, Karlsruhe Institute of Technology (KIT), Germany · University of Edinburgh, UK · NVIDIA +1

  14. Don't Forget! Decomposing the Training Dynamics of Memorization in Language Models

    Sep 28, 2026Florian Eichin, Philipp Mondorf, Andrei Mircea +3MemorizationRecurrent Model

    MaiNLP, Center for Information and Language Processing, LMU Munich & Munich Center for Machine Learning (MCML), Germany · Mila – Quebec AI Institute & University of Montreal, Canada · Saarland University, Germany

  15. Shallow Queries, Mature Values: Depth-Asynchronous Self-Speculation for Looped Transformers

    Sep 28, 2026Guanghao Li, Zihan Su, Hao Yu +6Speculative DecodingSelf-Speculative

    Tsinghua University · Southern University of Science and Technology · The University of Hong Kong +2

  16. SchemaMem: Schema-Indexed Recurrent Memory for Delayed State Retrieval

    Sep 27, 2026Sungwoo Goo, Hwi-yeol Yun, Sangkeun JungRecurrent ModelPersistent State

    College of Pharmacy, Chungnam National University Daejeon, Republic of Korea · Department of Computer Science & Engineering, Chungnam National University Daejeon, Republic of Korea

  17. Template Ageing and Longitudinal Verification in Fixed-Text Keystroke Dynamics: A Subject-Disjoint Study Across Eight Weeks

    Sep 24, 2026Simon Parkinson, Saad Khan, Na Liu +1Vascular AgeBiometrics

    Department of Computer Science, University of Huddersfield, HD1 3DH Huddersfield, U.K. · College of Intelligence and Computing, Tianjin University, Tianjin, China

  18. Log-Depth Recurrent Language Modeling

    Sep 23, 2026Yiqin Wang, Nuri Cingillioglu, Charles PertRecurrent ModelLanguage Modeling

    Department of Computing Imperial College London London, United Kingdom

  19. Attention Routing Stabilizes Early: Working-Set Inference for Recurrent Language Models

    Sep 23, 2026Ke Wan, Chen ChenRecurrent Model

    Department of Computer Science University of Virginia Charlottesville, VA, USA

  20. Shaft-Configuration-Adaptive Catheter Tip Position Estimation via Motor-History Conditioned Residual Learning

    Sep 22, 2026Peihan Zhang, Michael C. Yip, Ankur Kapoor +1CathetersUncertain Joint Stiffness

    Digital Technology & Innovation, Siemens Healthineers, Princeton, NJ, USA. · Department of Electrical and Computer Engineering, University of California San Diego, United States.

  21. PREM: Prefix-Steered Recurrent Memory for Long-Video Understanding

    Sep 20, 2026Siru Zhong, Qiongyan Wang, Xiaohui Lv +5Frozen Vision-Language ModelsLong-Video Benchmarks

    The Hong Kong University of Science and Technology (Guangzhou) · Beta Infinity · Tsinghua University

  22. Persistent Recurrent Memory Between Transformer Layers - Improves Language Model Generalization

    Sep 15, 2026Eduardo Novaes HeringTransformer EncoderTransformer Architectures

    FITec Labs / Ericsson São Paulo

  23. CorrRisk-WM: Corridor-Conditioned Risk World Modeling for Safety-Critical Trajectory Planning

    Sep 15, 2026Tingyu Guo, Reza LangariWorld Model PlanningWorld Models

    J. Mike Walker ’66 Department of Mechanical Engineering, Texas A&M University, College Station, TX 77843, USA

  24. Anatomy of Associative Recall in Fixed-State Recurrences: A Matched-State Decomposition, an Interference Wall, and a Curriculum That Breaks It

    Sep 14, 2026Julian Boesch, Andrew WeeDense Associative MemoryRecurrent State

    1Purdue University · 2Obit Research

  25. OneLA: Scaling Linear-Attention Decoding to Large Beams in Generative Recommendation

    Sep 14, 2026Xiangrui Yang, Cheng Peng, Yunfeng Zhao +9Kimi Delta AttentionLinear Attention

    Kuaishou Technology China · Peking University China

  26. Temporal Recurrence Favors Fewer Layers

    Sep 14, 2026Ivan Anokhin, Johan Obando-Ceron, Irina Rish +1Recurrent ModelRecurrence

    Mila – Qu´ebec AI Institute · Universit´e de Montr´eal · Sakana AI

  27. The information geometry of large language models is shared, learned, and controllable

    Sep 11, 2026Dario PicozziRecurrent Model

    Department of Physics and Astronomy, University College London (UCL), Gower Street, London WC1E 6BT, United Kingdom · London Centre for Nanotechnology, 19 Gordon St, London WC1H 0AH, United Kingdom

  28. Learning Length-Extrapolatable Recurrent Models

    Sep 8, 2026Hanwen JiangRecurrent ModelBackpropagation

    Adobe Research

  29. Kalman Delta Networks: Uncertainty-aware Associative Memory

    Sep 7, 2026Ngoc Bui, Tinglin Huang, Rex YingKimi Delta AttentionLinear Attention

    Department of Computer Science, Yale University

  30. Pre-Whitening and BCJR Posterior Distillation for Bi-LSTM Detection in Faster-than-Nyquist Signaling

    Sep 7, 2026Nurettin Safak, Osman Tokluoglu, Enver CavusBidirectional Long Short-Term MemoryWhitening

    Department of Electrical and Electronics Engineering, Ankara Yildirim Beyazit University, Ankara, Turkiye

  31. Prospective Coding Improves Learning in Deep Continuous-Time Recurrent Networks

    Sep 3, 2026Shivang Rawat, Mirko Morello, Flaviano Morone +1Recurrent Neural NetworksRecurrent Model

    Telepath · New York University

  32. Kathleen Remembers: Length-Invariant One-Shot Recall Without Attention

    Aug 31, 2026George FountzoulasFactual RecallRecurrent Model

    Department of Computer Engineering & Informatics Frederick University, Nicosia, Cyprus

  33. MARCH: Scaling Recurrent Memory with Content-Routed State Anchors

    Aug 12, 2026Ming Zhang, Kaisen Yang, Shu Yu +6Efficient Long-Context InferenceRecurrent Model

    Shanghai AI Laboratory · Tsinghua University · Fudan University

  34. Phase State Space Models: Parallel, Surrogate-Free Training of Spiking Networks

    Aug 7, 2026Wilkie Olin-AmmentorpSpiking Neural NetworksRecurrent Neural Networks

    Argonne National Laboratory, Lemont, Illinois, USA

  35. Why Knowing Both Hops Is Not Enough: Understanding Two-Hop Generalization in Language Models

    Aug 7, 2026Zili Zhang, Yilin Wang, Heng Wang +2Recurrent Model

    1Xi’an Jiaotong University · University of Illinois Urbana-Champaign

  36. Maglev: Sliding Recurrent Memory

    Aug 3, 2026Bo Liu, Qiang LiuRecurrent ModelMemory-Augmented Framework

    The University of Texas at Austin

  37. Retrofitting Recurrent Depth into a Pretrained Language Model: Installation, Extrapolation, Transfer, and Retention at Two Parameter Budgets

    Jul 31, 2026Mark ShapiroLarge Language Model PretrainingRecurrent Model

  38. Lindblad-Inspired Multi-Timescale Reservoir Computing with Separable Rotation and Dissipation

    Jul 27, 2026Jyotiranjan Beuria, Amit ShuklaReservoir ComputingReservoir

  39. Eviction as Estimation: A Fixed-Lag Smoothing View of Test-Time Memory, and When Measuring Beats Accumulating

    Jul 27, 2026Maruthi Vemula, Neeraj Praneeth GajulaWorking MemoryEviction

    University of North Carolina at Chapel Hill · New York University

  40. Frequency-Based Reservoir computing

    Jul 27, 2026Arthur S PowanweReservoir ComputingReservoir

    Department of Mathematics, Western University, London, ON, Canada

  41. Strong Gravitational Lensing Posterior Sampling in Pixel-Space Using Diffusion Models and Recurrent Inference Machines

    Jul 21, 2026Guillaume Payeur, Laurence Perreault-Levasseur, Gabriel Missael Barco +1Astronomical ImagesPosterior Sampling

    Department of Physics, Universit´e de Montr´eal, Montreal QC, Canada · 2Mila - Quebec AI Institute, Montreal QC, Canada · 3Ciela Institute, Institute for Astrophysics and Machine Learning, Montreal QC, Canada +3

  42. T^2MLR: Transformer with Temporal Middle-Layer Recurrence

    Jul 16, 2026Ziyang Cai, Xingyu Zhu, Yihe Dong +2Transformer ArchitecturesRecurrent Model

    Princeton Language and Intelligence, Department of Computer Science Princeton University

  43. LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget

    Jul 16, 2026Changhai Zhou, Kieran Liu, Yuhua Zhou +17Efficient Long-Context InferenceLLM Inference Optimization

    MindLab · Fudan University

  44. Per-Token Fixed-Point Convergence in Depth-Recurrent Transformers

    Jul 15, 2026Joe LoganRecurrent ModelRecurrent State

    Independent researcher

  45. Learning-based Probabilistic Load Forecasting with Post-hoc and In-model Uncertainty

    Jul 14, 2026Sarah Al-Shareeda, Gulcihan Ozdemir, Heung Seok JeonAccurate Short-Term Electricity Load ForecastingProbabilistic Forecasting

    aComputer System and Technology Department, Faculty of Computer Science and Information Technology, University of Malaya, Malaysia · bInformatics Institute, Istanbul Technical University, Turkey · cComputer Engineering Department Konkuk University South Korea

  46. Event-based Neural Decoding for Neuroprosthetic Motor Control

    Jul 13, 2026Khaleelulla Khan Nazeer, Sirine Arfa, Matthias Jobst +2Abox Abduction ProblemRecurrent Model

    Chair of Highly-Parallel VLSI-Systems and Neuromorphic Circuits, Technische Universität Dresden, Germany · Centre for Tactile Internet with Human-in-the-Loop (CeTI), Dresden, Germany

  47. LayerNorm as Implicit Gain Control in Looped Transformers

    Jul 12, 2026Matthias M. M. BuehlmaierBatch NormalizationRecurrent Model

    Faculty of Business and Economics, The University of Hong Kong · Pokfulam Road, Hong Kong

  48. Robustly Invertible Nonlinear Dynamics and the BiLipREN: From Inversion-Based Control to Generative Trajectory Modelling

    Jul 10, 2026Yurui Zhang, Ruigang Wang, Ian R. ManchesterNonlinear DynamicsRecurrent Neural Networks

    Australian Centre for Robotics (ACFR), and the School of Aerospace, Mechanical and Mechatronic Engineering, The University of Sydney, Australia

  49. When Does Tool Use Increase the Expressive Power of Finite-Precision Recurrent Models?

    Jul 7, 2026Nikola Zubić, Qian Li, Yuyi Wang +1Recurrent ModelExpressivity

    Robotics and Perception Group, University of Zurich · Shenzhen International Center for Industrial and Applied Mathematics, Shenzhen Research Institute of Big Data · Tengen Intelligence Institute, CRRC Zhuzhou Institute

  50. Train Smarter, Not Longer: Memorization-Guided Data Reuse for Efficient LLM Training

    Jul 6, 2026Jingwei Zuo, Cong Zeng, Ilyas Chahed +6Large Language Model TrainingRecurrent Model

    Technology Innovation Institute Abu Dhabi, UAE

  51. SHiPPO: Recurrent Memory with Transported Polynomial Projections

    Jul 3, 2026Tomoya Mizuguchi, Bum Jun KimRecurrent ModelRecurrent State

    Kyoto University, Japan · The University of Tokyo, Japan

  52. The Orthogonalized Read Is a Removable Training Scaffold for Recurrent Memory

    Jul 2, 2026Keston Aquino-MichaelsOrthogonalityMemorization

    No Way Labs

  53. Stable Self-Modulating Quantum Fast-Weight Programmers with Bounded Memory Gates

    Jul 2, 2026Kuo-Chung Peng, Jiun-Cheng Jiang, Chun-Hua Lin +8Quantum LearningRecurrent Model

    National Taiwan University, Taiwan · Stevens Institute of Technology, NJ, USA · Seoul National University, Korea +3

  54. Finite-Lag Operator Geometry of Recurrent Representations

    Jul 2, 2026Kanishka ReddyRecurrent ModelCovariance

    Department of Applied Mathematics University of Washington Seattle, WA 98105

  55. Multi-Head Recurrent Memory Agents

    Jul 1, 2026Jiatong Li, Samuel Yeh, Sharon LiEfficient Long-Context InferenceRecurrent Model

    Department of Computer Science, University of Wisconsin-Madison

  56. TiRex-2: Generalizing TiRex to Multivariate Data and Streaming

    Jul 1, 2026Patrick Podest, Marco Pichler, Elias Bürger +7Time Series Foundation ModelsAsymmetric Grouped-Attention Variate Mixer

    ELLIS Unit Linz, LIT AI Lab & Institute for Machine Learning, JKU Linz, Austria · NXAI Lab, Linz, Austria · NXAI GmbH, Linz, Austria +1

  57. CARVE: Content-Aware Recurrent with Value Efficiency for Chunk-Parallel Linear Attention

    Jun 25, 2026Sayak DuttaRecurrent ModelKimi Delta Attention

  58. Erase-then-Delta Attention: Decoupling Erase and Write Addresses in Delta-Rule Linear Attention

    Jun 25, 2026Xiao Li, Chengruidong Zhang, Hao Luo +15Kimi Delta AttentionRecurrent Model

    1Qwen Team · 2Nanjing University · 3Zhejiang University

  59. Recursive QLSTM with Dynamic Variational Quantum Circuit Adaptation

    Jun 22, 2026Samuel Yen-Chi Chen, Yifeng Peng, Jiun-Cheng Jiang +8Quantum LearningVariational Quantum Circuits

    Wells Fargo · Stevens Institute of Technology · National Taiwan University +3

  60. Learning the ARTS of Search for Automated Discovery

    Jun 20, 2026Gurusha Juneja, Arnav Kumar Jain, Deepak Nathani +2Tree SearchAgentic Reasoning

    University of California, Santa Barbara · Université de Montréal and Mila- Quebec AI Institute