Gated Recurrent Unit

Also known as GRU

Follow this topic Ask about this topic

Latest papers

17 papers3 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

The RNN Homunculus: Learning to Gate Long-Term Memory
Oct 9, 2026Zeyu Fan, Alexandru-Dragos Manolache, Jan van GemertLong-Range Dependency Modeling Recurrent Neural Networks
Delft University of Technology, Mekelweg 5, 2628 CD Delft, The Netherlands
Bounded Channel-Adaptive Spectral Learning for Forward-Consistent Inverse Flapping-Wing Aerodynamics
Sep 30, 2026Haichuan LiGated Recurrent Unit Recurrent Neural Networks
University of Turku
BreathGRU: A Novel Semi-Supervised Bidirectional Gated Recurrent Unit Framework for Speech and Breath Segmentation for Respiratory Audio
Sep 25, 2026Sania Fatima Sayed, John W. Holloway, Reyer Zwiggelaar +1Gated Recurrent Unit Speech Processing
Department of Computer Science, Aberystwyth University, Aberystwyth, United Kingdom, UK SY23 3DB · Human Development and Health, Faculty of Medicine, University of Southampton, United Kingdom, SO16 6YD
Neural-Network Maxent: a general extension with learned nonlinearity, applied to time-series for Desert Locust distribution modelling
Sep 3, 2026Alessandro Grassi, Edoardo Kimani Bellotto, Wassim El Azami +2Gated Recurrent Unit Recurrent Neural Networks
SISTEMA GmbH, Vienna, Austria · Beyond EO, Paris, France
DevGRU: Depth-guided Visual Navigation using a Collision-aware Recurrent Model
Aug 19, 2026Kyung Min Han, Eunsom Kim, Young J. KimGated Recurrent Unit Robot Navigation
A Comparative Analysis of Machine Learning Models for Long and Short-Term Forecasting of the Egyptian Stock Market: A Focus on EGX30
Jul 15, 2026Muhammed Walid, Ahmed El-Naeimy, Hosam Moubarak +1Gated Recurrent Unit Long-Term Time Series Forecasting
Cyber Physical Lab, Department of Computer Science & Engineering · Egypt-Japan University Of Science and Technology, Alexandria, Egypt · Accounting Department +1
Dzongkha Next Word Prediction System
Jul 13, 2026Prerna Chhetri, Tenzin Yoezer, Phuntsho Wangmo +1Gated Recurrent Unit Next-Token Prediction
Information Technology Department, College of Science and Technology, Royal University of Bhutan
Towards Explainable Adjudicative Variance: Quantifying Judicial Discretion via Gated Multi-Task Learning
Jun 25, 2026Stanisław Sójka, Felix Steffek, Matthias GrabmairGated Recurrent Unit Legal NLP
School of Computation, Information, and Technology, Technical University of Munich, Germany · Faculty of Law, University of Cambridge
LK Jam: System Architecture and Implementation of a Real-Time Human-AI Interactive Music Generation System using Role-Aware GRU
Jun 19, 2026Yakun Liu, Zhiyu Jin, Dong Liu +1Gated Recurrent Unit Music Generation
Yakun Liu, Dong Liu, and Hai Luan are with the Shenyang Conservatory of Music. · Z. Jin is an independent collaborator.
From Compression to Deployment: Real-Time and Energy-Efficient FastGRNN on Ultra-Constrained Microcontrollers
Jun 15, 2026Emre Can KizilatesGated Recurrent Unit Efficient Neural Network Inference
Independent Researcher, Izmir, Turkey
A Random-Matrix Criterion for Initializing Gated Recurrent Neural Networks
May 11, 2026Tommaso Fioratti, Riccardo Marcaccioli, Francesco CasolaGated Recurrent Unit Neural Network Initialization
Capital Fund Management, 75007 Paris, France · Institute of Mathematics, EPFL, 1015 Lausanne, Switzerland
C2L-Net: A Data-Driven Model for State-of-Charge Estimation of Lithium-Ion Batteries During Discharge
May 9, 2026Khoa Tran, T. Nguyen-Thoi, Vin Nguyen-Thai +3Gated Recurrent Unit Causal Attention
Data Science Laboratory, Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City, Vietnam. · Laboratory for Applied and Industrial Mathematics, Institute for Computational Science and Artificial Intelligence, Van Lang University, Ho Chi Minh City, 70000, Viet Nam. · Faculty of Mechanical, Electrical, and Computer Engineering, Van Lang School of Technology, Van Lang University, Ho Chi Minh City, 70000, Viet Nam. +6
Learn-To-Learn on Arbitrary Textual Conditioning: A Hypernetwork-Driven Meta-Gated LLM
May 3, 2026Luo Ji, Qi Qin, Ningyuan Xi +3Gated Recurrent Unit Meta-Learning
Geely AI Lab, Geely Auto Group, Zhejiang, China · Peking University, Beijing, China
Learning-Based Dynamics Modeling and Robust Control for Tendon-Driven Continuum Robots
Apr 28, 2026Ziqing Zou, Ke Qiu, Fei Wang +3Gated Recurrent Unit Robot Trajectory Tracking
Department of Control Science and Engineering, Zhejiang University, Hangzhou, China
Real-Time Thermal-Inertial Odometry on Embedded Hardware for High-Speed GPS-Denied Flight
Mar 2, 2026Austin Stone, Mark Petersen, Cammy PetersonGated Recurrent Unit Inertial Odometry
Brigham Young University, Provo, UT 84602 USA.
DReX: An Explainable Deep Learning-based Multimodal Recommendation Framework
Feb 23, 2026Adamya Shyam, Venkateswara Rao Kagita, Bharti Rana +1Gated Recurrent Unit Multimodal Recommendation
University of Delhi, Delhi, India · National Institute of Technology, Warangal, India
Learnability Window in Gated Recurrent Neural Networks
Dec 5, 2025Lorenzo LiviGated Recurrent Unit Recurrent Neural Networks
OPIT – Open Institute of Technology

Oct 9, 2026J/K move · Enter open · S save

The RNN Homunculus: Learning to Gate Long-Term Memory

Zeyu Fan, Alexandru-Dragos Manolache, Jan van Gemert

Delft University of Technology, Mekelweg 5, 2628 CD Delft, The Netherlands

Long-Range Dependency Modeling Recurrent Neural Networks Sequence Modeling Gated Recurrent Unit Long Short-Term Memory Networks Deep Learning Optimization

Open paper AskPDF arXiv

Learning long-range dependencies with recurrent neural networks (RNNs) is difficult because of the vanishing gradient problem. Gated recurrent neural networks like GRUs and LSTMs address this problem and are commonly explained by their ability to create additive copy paths through time. This explanation is correct, but incomplete: useful RNN gate values must themselves be learned, which is typically done with another RNN. We study this gate-learning problem through carefully controlled sequence classification tasks. Our analysis shows that gated architectures struggle when all training samples require long-range memory and thus equally suffer from the vanishing gradient problem. We intervene by adding short-dependency samples which let gated models learn solutions that capture long-dependency samples, but also generalize across different class labels. When properly learned, gated RNNs match or even exceed the test accuracy of modern architectures like Mamba and xLSTM. Overall, our results highlight gate learning as a central part of learning long-range memory and show how training data can support this process by exposing the same task over shorter dependencies.