Recurrent Connection
Recurrent connections in neural networks, which allow information to flow back to previous layers, are crucial for processing sequential data and tasks requiring memory. Current research focuses on understanding how recurrent architectures, including recurrent neural cascades and recurrent vision transformers, achieve this, particularly investigating their stability, expressivity, and ability to solve complex reasoning problems. This research is significant because it improves our understanding of biological neural systems and informs the design of more powerful and efficient artificial intelligence models for applications ranging from language processing to visual reasoning and robust control systems.
Papers
Knowledge Distillation Applied to Optical Channel Equalization: Solving the Parallelization Problem of Recurrent Connection
Sasipim Srivallapanondh, Pedro J. Freire, Bernhard Spinnler, Nelson Costa, Antonio Napoli, Sergei K. Turitsyn, Jaroslaw E. Prilepsky
Bio-Inspired, Task-Free Continual Learning through Activity Regularization
Francesco Lässig, Pau Vilimelis Aceituno, Martino Sorbaro, Benjamin F. Grewe