Recurrent Language Models

Ask about this topic

Latest papers

CardsList

23 papers8 papers in the last four weeks, up 167% on the four weeks before. 0.0% of all new papers.

  1. ReLaDrift: Recurrent Language Generation via Drifting for Test-Time Scaling

    Oct 16, 2026Yuki Otsuka, Daisuke Oba, Naoaki OkazakiTest-Time ScalingRecurrent Language Models

    Institute of Science Tokyo · AIST · NII LLMC

  2. DeepThink: A Conceptual Model for Knowledge-Addressable Recurrent Language Modeling

    Oct 12, 2026Weiguo ChenRecurrent Language ModelsLanguage Modeling

  3. Running Fewer Loops Removes Refusal Behaviour in Recurrent-Depth Language Models

    Oct 10, 2026Seyedarmin Azizi, Erfan Baghaei Potraghloo, Arya Fayyazi +2Recurrent Language ModelsRefusal Behavior in Language Models

    University of Southern California (USC), USA

  4. RAMP: Recurrent Adaptive Mixed Precision for Efficient Prefill in Recurrent-Depth Language Models

    Oct 9, 2026Ke Wan, Chen ChenRecurrent Language ModelsLLM Inference Acceleration

    Department of Computer Science, University of Virginia

  5. One Model to Loop Them All: Elastic Latent Recurrence for Language Models

    Oct 8, 2026Faisal Ladhak, Shantanu Acharya, Santiago Akle Serano +3Language ModelingRecurrent Language Models

    NVIDIA

  6. Towards Looped Models Done Right, Part II: Rethinking at Fixed Points

    Oct 5, 2026Benhao Huang, Chufan Shi, Junlin Chen +4Efficient Language Model TrainingRecurrent Transformers

    Institute of Foundation Models · CMU · USC

  7. Closing the Loop: Practical Training Recipes for Looped Language Models

    Sep 30, 2026Andrei Marchenko, Viacheslav Bezrukov, Oleg Kashurin +5Efficient Language Model TrainingLLM Training

    RND NLP, DAIMLD, Russian Federation

  8. KV-streams for Efficient Compaction in Agentic Reinforcement Learning

    Sep 28, 2026Emiliano Penaloza, Dane Malenfant, Dheeraj Vattikonda +15Recurrent Language ModelsAgentic RL

    Mila · Microsoft · Université de Montréal +9

  9. Log-Depth Recurrent Language Modeling

    Sep 23, 2026Yiqin Wang, Nuri Cingillioglu, Charles PertRecurrent Language ModelsLong-Context Language Modeling

    Department of Computing Imperial College London London, United Kingdom

  10. Attention Routing Stabilizes Early: Working-Set Inference for Recurrent Language Models

    Sep 23, 2026Ke Wan, Chen ChenLong-Context Language Model InferenceRecurrent Transformers

    Department of Computer Science University of Virginia Charlottesville, VA, USA

  11. Temporal Recurrence Favors Fewer Layers

    Sep 11, 2026Ivan Anokhin, Johan Obando-Ceron, Irina Rish +1Recurrent Neural NetworksRecurrent Language Models

    Mila – Qu´ebec AI Institute · Universit´e de Montr´eal · Sakana AI

  12. Fast Weight Attention for Continual Learning

    Aug 27, 2026Yifan Zhang, Steve Ta, Jasper Zhang +8Recurrent Language ModelsMemory-Augmented Language Models

    Bytedance Seed · Princeton University · Hyperbolic Labs +1

  13. Allocating Recurrent Compute in Looped Language Models

    Aug 18, 2026Ruhai Lin, Yiyang Guo, Rui-Jie Zhu +2Recurrent Language ModelsRecurrent Transformers

    University of California, Santa Cruz

  14. Retrofitting Recurrent Depth into a Pretrained Language Model: Installation, Extrapolation, Transfer, and Retention at Two Parameter Budgets

    Jul 31, 2026Mark ShapiroLLM Fine-TuningRecurrent Transformers

  15. Pretraining Recurrent Networks without Recurrence

    Jun 4, 2026Akarsh Kumar, Phillip IsolaRecurrent Neural NetworksRecurrent Language Models

    MIT

  16. An Algebraic View of the Expressivity of Recurrent Language Models

    Jun 1, 2026Franz Nowak, Ryan Cotterell, Reda BoumasmoudRecurrent Neural NetworksNeural Network Expressivity

    ETHZürich.

  17. WriteSAE: Sparse Autoencoders for Recurrent State

    May 12, 2026Jack YoungRecurrent Language ModelsLanguage Model Steering

    Indiana University

  18. A Single-Layer Model Can Do Language Modeling

    May 11, 2026Zanmin WangLanguage Model PretrainingRecurrent Language Models

  19. Structured Recurrent Mixers for Massively Parallelized Sequence Generation

    May 9, 2026Benjamin L. BadgerRecurrent Neural NetworksAutoregressive Language Modeling

    IBM

  20. MinMax Recurrent Neural Cascades

    May 7, 2026Alessandro RoncaRecurrent Neural NetworksNeural Network Training Dynamics

    IRIS-AI

  21. Linear-Time and Constant-Memory Text Embeddings Based on Recurrent Language Models

    Apr 20, 2026Tobias Grantner, Emanuel Sallinger, Martin FlechlRecurrent Language ModelsMemory-Efficient Inference

    Dynatrace Research · TU Wien · University of Oxford

  22. IQuest-Coder-V1 Technical Report

    Mar 17, 2026Jian Yang, Wei Zhang, Shawn Guo +35Recurrent Language ModelsCode Language Models

  23. AdaPonderLM: Gated Pondering Language Models with Token-Wise Adaptive Depth

    Mar 2, 2026Shixiang Song, He Li, Zitong Wang +6Recurrent Language ModelsInference-Time Adaptation of Language Models

    LUMIA Lab, School of Artificial Intelligence, Shanghai Jiao Tong University · Shanghai Innovation Institute · Sun Yat-sen University +2