Recurrent Neural Networks

Also known as RNN

Overview

Recurrent neural networks study how a model can process ordered inputs by repeatedly updating an internal state, which is useful for streaming data, long-term memory, and decisions under partial observability. Common approaches include gated LSTMs and GRUs, linear and state-space recurrences, continuous-time and spiking networks, and weight-shared loops for iterative reasoning; training ranges from backpropagation through time to online learning and parallel scans. Researchers test these models on state-tracking and recall tasks, language modeling, time-series forecasting, control, and physical-system prediction. A central tension is how to preserve useful information and stable learning over long sequences while keeping computation efficient and matching the accuracy and flexibility of Transformers.

Latest papers

CardsList

329 papers24 papers in the last four weeks, down 59% on the four weeks before. 0.2% of all new papers.

  1. Exploring Interpretability in Deep Learning-Based Forest Classification - Separating Similar Forest Classes using Sentinel-2 Time Series

    Oct 13, 2026Maximilian Kirsch, Christine PreisachInterpretable Time-Series ClassificationTree Species Classification

  2. ST-GRU PredRNN-V2: A GRU-Based Reformulation of PredRNN-V2 for Video Prediction

    Oct 13, 2026Augusta van Haren, Hanna Hoogen, Luca Pattavina +1Video PredictionRecurrent Neural Networks

  3. Compression Through Time: An Interplay of Separability, Stationarity and Capacity

    Oct 12, 2026Nikolaus Kopp, Franz Pernkopf, Bernhard GeigerNeural Network GeneralizationRecurrent Neural Networks

  4. Interactive 4D Volumetric Liquid Forecasting under Moving-Solid Interaction

    Oct 12, 2026Jongwon Ryu, Sunjae Yoon, Junyeong KimFluid-Structure InteractionSpatiotemporal Forecasting

  5. Manifold Navigation Learning Using Recurrent Networks: Efficient Training Techniques

    Oct 9, 2026Sarah Harkins Dayton, Sathya Rengaswami, Vasileios Maroulas +2Trajectory PredictionRecurrent Neural Networks

  6. The RNN Homunculus: Learning to Gate Long-Term Memory

    Oct 9, 2026Zeyu Fan, Alexandru-Dragos Manolache, Jan van GemertLong-Range Dependency ModelingRecurrent Neural Networks

  7. Neural Networks for Temporal Pattern Recognition and Dynamic Arm Gesture Speed Estimation for Robot Control

    Oct 8, 2026Milán Zsolt Bagladi, László GulyásRecurrent Neural NetworksRobotic Perception

  8. Reconstruction of Multiscale Plasma Dynamics Across Operating Regimes

    Oct 7, 2026Maryam Reza, Farbod FarajiRecurrent Neural NetworksMultiscale Time-Series Modeling

  9. Learning infinite context windows in recurrent architectures via spatial neural computing

    Oct 7, 2026Aleix Salvador-Pomarol, Arthur N. Montanari, Earl K. Miller +2Recurrent Neural NetworksLong-Context Modeling

  10. Continuous Memory Machines

    Oct 6, 2026Ciaran Regan, Kai Arulkumaran, Luke Darlow +3Memory-Augmented Neural NetworksRecurrent Neural Networks

  11. Forecast Accuracy Is Not Trading Profit: Evolving Small Recurrent Networks for Stock Return Prediction

    Oct 6, 2026Jonathan Chang, Zimeng LyuTime Series ForecastingRecurrent Neural Networks

  12. Learned Monotone Recurrent Features in Governed Credit Scoring: The Price of the Frame and the Necessity of Macro Conditioning

    Oct 6, 2026Yew Lee Tanmonotone neural networksCredit Scoring

  13. Learning to Remember: Distilling Memory Retention for Compact Recurrent Neural Networks

    Oct 3, 2026Nilushika Udayangania, Kishor Nandakishora, Marimuthu PalaniswamiKnowledge DistillationNeural Network Compression

  14. On architectural choices for interpretability and thermodynamic consistency in Physically Recurrent Neural Networks in the low-data regime

    Oct 2, 2026M. A. Maia, K. A. Meyer, A. M. C. M. van Gils +2Recurrent Neural NetworksNeural Network Interpretability

  15. Most-Recent Anchoring with Recurrent Ordering for Time Series Forecasting

    Oct 2, 2026Jung Min Choi, Ngoc Son Le, Ibram Abdelmalak +2Time Series ForecastingLong-Term Time Series Forecasting

  16. Self-Repairing Recurrent Ensembles for Real-Time Recovery from Distribution Shift

    Oct 2, 2026Julian Lemmel, Pedro D. Wendel Garcia, Taisuke Kobayashi +1RL ControlRecurrent Neural Networks

  17. RAOA: Alternating-Operator Neural Computation with Programmable Radio Propagation

    Oct 2, 2026Toshiaki Koike-AkinoOnline Language Model AdaptationRecurrent Neural Networks

  18. A foundation for systematic analysis of transformers and RNNs for tractography

    Oct 1, 2026Emmanuelle Renauld, Philippe Poulin, Hugo Larochelle +2Recurrent Neural NetworksRecurrent Transformers

  19. From Redundancy to Minimality: Fixed-Point-Guided Hierarchical Reduction of Learned Piecewise-Linear Dynamics

    Oct 1, 2026Hiroto Tamura, Gouhei TanakaDynamical SystemsNonlinear System Identification

  20. Extreme Length Generalization in a Compact Recurrent Architecture for One-Shot Exploration

    Oct 1, 2026Izen Thornton, Aaron Shey, William SuMemory-Augmented Neural NetworksRecurrent Neural Networks

  21. Disentangling Computation in Multi-Task Neural Networks with the Green's Operator

    Sep 30, 2026James HazeldenRecurrent Neural NetworksNeural Network Interpretability

  22. A Tilted Bowl Is Not a Slippery Slope: Compressing Looped Models

    Sep 30, 2026Steven Kolawole, Pearse Jim, Opegbemi M. Busoye +2Efficient Neural Network InferenceRecurrent Neural Networks