Recurrent Neural Networks

Also known as RNN

Ask about this topic

Overview

Recurrent neural networks study how a model can process ordered inputs by repeatedly updating an internal state, which is useful for streaming data, long-term memory, and decisions under partial observability. Common approaches include gated LSTMs and GRUs, linear and state-space recurrences, continuous-time and spiking networks, and weight-shared loops for iterative reasoning; training ranges from backpropagation through time to online learning and parallel scans. Researchers test these models on state-tracking and recall tasks, language modeling, time-series forecasting, control, and physical-system prediction. A central tension is how to preserve useful information and stable learning over long sequences while keeping computation efficient and matching the accuracy and flexibility of Transformers.

Latest papers

CardsList

302 papers47 papers in the last four weeks, up 15% on the four weeks before. 0.3% of all new papers.

  1. ParaRNN: An Interpretable and Parallelizable Recurrent Neural Network for Time-Dependent Data

    May 4, 2026Yuxi Cai, Lan Li, Feiqing Huang +1Interpretable MLRecurrent Neural Networks

    Department of Statistics and Actuarial Science, University of Hong Kong

  2. Benchmarking LightGBM and BiLSTM for Sentiment Analysis on Indonesian E-Commerce Reviews

    May 2, 2026Lidia Natasyah Marpaung, Vania Claresta, Iqfina Haula Halika +3Gradient-Boosted Decision TreesSentiment Analysis

    Department of Data Science Institut Teknologi Sumatera · Institut Teknologi Sumatera · Department of Informatics Institut Teknologi Sumatera

  3. Benchmarking local Hebbian learning rules for memory storage and prototype extraction

    May 1, 2026Anders Lansner, Andreas Knoblauch, Naresh B Ravichandran +1Hebbian LearningRecurrent Neural Networks

    1KTH Royal Institute of Technology, EECS, Stockholm · 2Stockholm University, Dept. of Mathematics, Stockholm · 3KEIM-Institute, Albstadt-Sigmaringen University, Germany +1

  4. Multi-frame Restoration for High-rate Lissajous Confocal Laser Endomicroscopy

    May 1, 2026Minhee Lee, Sangyoon Lee, Jiwook Lee +4EndoscopyMedical Imaging

    POSTECH, Pohang, Republic of Korea · VPIX Medical, Seoul, Republic of Korea

  5. Scalable Learning in Structured Recurrent Spiking Neural Networks without Backpropagation

    May 1, 2026Bo Tang, Weiwei XieRecurrent Neural NetworksSpiking Neural Networks

    Department of Electrical and Computer Engineering Worcester Polytechnic Institute Worcester, USA

  6. State Stream Transformer (SST) V2: Parallel Training of Nonlinear Recurrence for Latent Space Reasoning

    Apr 30, 2026Thea AvissRecurrent Neural NetworksRecurrent Transformers

    Fifth Dimension

  7. Attractor FCM

    Apr 30, 2026Alexis KafantarisRecurrent Neural NetworksPhysics-Informed ML

  8. Benchmarking PyCaret AutoML Against BiLSTM for Fine-Grained Emotion Classification: A Comparative Study on 20-Class Emotion Detection

    Apr 29, 2026Arya Muda Siregar, Arielva Simon Siahaan, Haikal Fransisko Simbolon +3Recurrent Neural NetworksText Classification

    Institut Teknologi Sumatera Lampung Selatan, Indonesia

  9. PPG-Based Affect Recognition with Long-Range Deep Models: A Measurement-Driven Comparison of CNN, Transformer, and Mamba Architectures

    Apr 28, 2026Karim Alghoul, Hussein Al Osman, Abdulmotaleb El SaddikSelective SSMsRecurrent Neural Networks

    School of Electrical Engineering and Computer Science University of Ottawa Ottawa, Canada

  10. Teacher Forcing as Generalized Bayes: Optimization Geometry Mismatch in Switching Surrogates for Chaotic Dynamics

    Apr 28, 2026Andre Herz, Daniel Durstewitz, Georgia KoppeNeural Surrogate ModelingGeneralized Bayesian Inference

    Interdisciplinary Center for Scientific Computing, Heidelberg University, Germany · Dept. of Theoretical Neuroscience, Central Institute of Mental Health (CIMH), Mannheim, Germany · Hector Institute for AI in Psychiatry and Dept. of Psychiatry and Psychotherapy, CIMH, Mannheim, Germany +1

  11. Learning-Based Dynamics Modeling and Robust Control for Tendon-Driven Continuum Robots

    Apr 28, 2026Ziqing Zou, Ke Qiu, Fei Wang +3Gated Recurrent UnitRobot Trajectory Tracking

    Department of Control Science and Engineering, Zhejiang University, Hangzhou, China

  12. Benchmarking Logistic Regression, SVM, and LightGBM Against BiLSTM with Attention for Sentiment Analysis on Indonesian Product Reviews

    Apr 28, 2026Razin Hafid Hamdi, Ivana Margareth Hutabarat, Hanna Gresia Sinaga +3Sentiment AnalysisRecurrent Neural Networks

    Institut Teknologi Sumatera Lampung Selatan, Indonesia

  13. Sentiment and Emotion Classification of Indonesian E-Commerce Reviews via Multi-Task BiLSTM and AutoML Benchmarking

    Apr 27, 2026Hermawan Manurung, Ibrahim Al-Kahfi, Ahmad Rizqi +1Sentiment AnalysisRecurrent Neural Networks

    Department of Data Science · Institut Teknologi Sumatera · Lampung Selatan, 35365, Indonesia +1

  14. Primitive Recursion without Composition: Dynamical Characterizations, from Neural Networks to Polynomial ODEs

    Apr 27, 2026Olivier BournezDynamical SystemsReLU Neural Networks

    Institut Polytechnique de Paris, Ecole Polytechnique, LIX, Palaiseau, France

  15. New non-Euclidean neural quantum states from additional types of hyperbolic recurrent neural networks

    Apr 27, 2026H. L. DaoNeural Quantum StatesRecurrent Neural Networks

  16. Neural surrogates for crystal growth dynamics with variable supersaturation: explicit vs. implicit conditioning

    Apr 23, 2026Matteo Rigoni, Daniele Lanzoni, Francesco Montalenti +1Neural Surrogate ModelingConvolutional RNNs

    Dept. of Materials Science, University of Milano-Bicocca, 20125 Milano, Italy · Dept. of Physics, University of Genova, 16146 Genova, Italy

  17. How Much Is One Recurrence Worth? Iso-Depth Scaling Laws for Looped Language Models

    Apr 22, 2026Kristian Schwethelm, Daniel Rueckert, Georgios KaissisTruncated Backpropagation Through TimeLanguage Model Scaling Laws

    Chair for AI in Healthcare and Medicine, Technical University of Munich, Germany · Department of Computing, Imperial College London, UK · Munich Center for Machine Learning (MCML), Germany +1

  18. Preconditioned DeltaNet: Curvature-aware Sequence Modeling for Linear Recurrences

    Apr 22, 2026Neehal Tumma, Noel Loo, Daniela RusLong-Context Language ModelingRecurrent Neural Networks

    1MIT · 2Liquid AI

  19. Physics-Enhanced Deep Learning for Proactive Thermal Runaway Forecasting in Li-Ion Batteries

    Apr 22, 2026Salman Khan, Syed Sajid Ullah, Muhammad Zunair Zamir +3Recurrent Neural NetworksPhysics-Informed ML

  20. Machine Learning Hamiltonian Dynamical Systems with Sparse and Noisy Data

    Apr 19, 2026Vedanta Thapar, Abhinav GuptaNonlinear System IdentificationRecurrent Neural Networks

    The Mathematical Institute, University of Oxford, Oxford OX2 6GG, United Kingdom · Center for Theoretical Physics, St. Stephen’s College, University of Delhi, Delhi 110007, India

  21. Fully Analog Resonant Recurrent Neural Network via Metacircuit

    Apr 19, 2026Zixin Zhou, Tianxi Jiang, Menglong Yang +3Efficient Neural Network InferenceTime Series Classification

    Institute of Humanoid Robots, CAS Key Laboratory of Mechanical Behavior and Design of Materials, Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China, Hefei 230026, People’s Republic of China · State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai 200240, People’s Republic of China

  22. LASER: Low-Rank Activation SVD for Efficient Recursion

    Apr 19, 2026Ege Çakar, Ketan Ali Raghu, Lia ZhengLow-Rank Matrix DecompositionRecurrent Neural Networks

    Harvard University Cambridge, MA, USA

  23. The Topological Trouble With Transformers

    Apr 18, 2026Michael C. Mozer, Shoaib Ahmed Siddiqui, Rosanne LiuTransformer FFNsRecurrent Neural Networks

    Google DeepMind

  24. Multilevel neural networks with dual-stage feature fusion for human activity recognition

    Apr 17, 2026Abeer FathAllah Brery, Ascensión Gallardo-Antolín, Israel Gonzalez-Carrasco +1Human Activity RecognitionRecurrent Neural Networks

  25. Combining Convolution and Delay Learning in Recurrent Spiking Neural Networks

    Apr 17, 2026Lúcio Folly Sanches Zebendo, Eleonora Cicciarella, Michele RossiConvolutional RNNsEfficient Neural Network Inference

    University of Padova, Department of Information Engineering · Department of Mathematics “Tullio Levi Civita” at the University of Padova, Italy

  26. Impact of leaky dynamics on predictive path integration accuracy in recurrent neural networks

    Apr 17, 2026Yanlin Zhang, Yan Zhang, Muhua Zheng +1Recurrent Neural NetworksContinuous Attractor Neural Networks

    School of physics and Electronic Engineering, Jiangsu University, Zhenjiang, Jiangsu 212013, China · Teaching Department, Jiangsu University Jingjiang College, Zhenjiang 212028, Jiangsu, China

  27. A Nonlinear Separation Principle via Contraction Theory: Applications to Neural Networks, Control, and Learning

    Apr 16, 2026Anand Gokhale, Anton V. Proskurnikov, Yu Kawano +1Dynamical SystemsContraction Theory

    Center for Control, Dynamical Systems, and Computation, UC Santa Barbara, Santa Barbara, CA 93106 USA · Department of Electronics and Telecommunications, Politecnico di Torino, Italy, 10129 · Graduate School of Advanced Science and Engineering, Hiroshima University, Higashi-Hiroshima 739-8527, Japan

  28. NEAT-NC: NEAT guided Navigation Cells for Robot Path Planning

    Apr 16, 2026Hibatallah Meliani, Khadija Slimani, Samira KhouljiEvolutionary OptimizationRobot Navigation

    ISI Laboratory, National School of Applied Sciences (ENSA), Abdelmalek Essaadi University Tetouan, Morocco · EsieaLab LDR, Higher School of Computer Science, Electronics and Automation (ESIEA) Paris, France

  29. Neuromorphic Spiking Ring Attractor for Proprioceptive Joint-State Estimation

    Apr 15, 2026Federica Ferrari, Flavia Davidhi, Bernard Maacaron +6Continuous Attractor Neural NetworksRobot State Estimation

    Istituto Italiano di Tecnologia, Genoa, Italy · Department of Neurosurgery, University Hospital Zürich, Switzerland · Institute of Neuroinformatics, Univ. of Zurich and ETH Zurich, Switzerland +3

  30. Modeling of Self-sustained Neuron Population without External Stimulus

    Apr 15, 2026İhsan Ertuğrul Karakaş, Özden Özel, İlkay Ulusoy +1Neural ProcessesSpiking Neural Networks

    Middle East Technical University · Başkent University