Long-Range Dependency Modeling

Ask about this topic

Latest papers

CardsList

27 papers6 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. Limit Theory for Online Expectile Estimation under Short and Long Range Dependence

    Oct 12, 2026Younghun Lee, Jake Zummo, Wei Biao WuLong-Range Dependency ModelingStochastic Approximation

    Department of Statistics, University of Chicago

  2. The RNN Homunculus: Learning to Gate Long-Term Memory

    Oct 9, 2026Zeyu Fan, Alexandru-Dragos Manolache, Jan van GemertLong-Range Dependency ModelingRecurrent Neural Networks

    Delft University of Technology, Mekelweg 5, 2628 CD Delft, The Netherlands

  3. Double-Take: Improving Capacity, Binding, and Selectivity In Long-Context Within Bidirectional Memory

    Oct 9, 2026Vakul Raghavan, Utkarsh Grover, Mingyang Mao +2Long-Context ModelingMemory-Augmented Neural Networks

    Department of Mathematics and Computer Science, Rutgers University, Newark, NJ, USA · Embodied Robotics and Automation Lab, University of South Florida, Tampa, FL, USA

  4. LogSig-SSM: Time-Series Modelling with Multi-Scale Log-Signature Compression for State-Space Models

    Oct 4, 2026Felix Oury, Nicolas Calvo Peiro, Reiko J. TanakaIrregular Time-Series ModelingMultivariate Time Series Forecasting

    Department of Computing Imperial College London · Department of Bioengineering Imperial College London

  5. Memorizon: Training World Models Beyond Their Context Window

    Sep 30, 2026Tingting Liao, Xuezhi Liang, Hao Li +1World Model LearningWorld Models

    IFM, MBZUAI · MBZUAI

  6. Triadic Linear Attention: Three-Dimensional Recurrent States for Long-Context Sequence Modeling

    Sep 29, 2026Oliver Sieberling, Bharat Runwal, David Jin +3Linear AttentionLong-Range Dependency Modeling

    Massachusetts Institute of Technology · MIT-IBM Computing Research Lab

  7. Learning Fractional-Order Dynamics from a Single Trajectory

    Sep 16, 2026Xiaole Zhang, Ziyi Zhang, Zehao Zhao +4Dynamical SystemsLong-Range Dependency Modeling

    Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California · Department of Electrical and Computer Engineering, Carnegie Mellon University

  8. Learning Length-Extrapolatable Recurrent Models

    Sep 8, 2026Hanwen JiangBackpropagationTemporal Credit Assignment

    Adobe Research

  9. Informational Antilocality and the Locality Bias in LLMs

    Aug 27, 2026Andrew McInnerney, Shane Storks, Steven Abney +1Long-Range Dependency ModelingLanguage Modeling

    University of Michigan · Eastern Michigan University

  10. A Spatial Persistence Gradient in European Warming Consistent with North Atlantic Cold-Blob Influence

    Jul 28, 2026Mauricio Herrera-Marín, Alex Godoy-Faúndez, Diego RiveraClimate ScienceLong-Range Dependency Modeling

    Research Center on Sustainability and Strategic Resource Management (CISGER), Faculty of Engineering, Universidad del Desarrollo, Avda. Plaza 700, Santiago, Chile.

  11. Raven: High-Recall Sequence Modeling with Sparse Memory Routing

    Jul 28, 2026Arshia Afzal, Aviv Bick, Eric P. Xing +2Memory-Augmented Language ModelsLong-Context Language Modeling

    EPFL · Carnegie Mellon University · MBZUAI +1

  12. A scaling law of contextual persistence in human language

    Jul 28, 2026Elan BarenholtzLong-Range Dependency ModelingSequence Modeling

    Machine Perception and Cognitive Robotics Laboratory, Department of Psychology and Center for Complex Systems, Florida Atlantic University

  13. Naju: A Native Discrete State-Space Model with Independent Retention and Writing for Long-Sequence Memory

    Jul 23, 2026Hyuk Lim, Seunghyun YoonPersistent Memory for Language ModelsLong-Context Modeling

    Korea Institute of Energy Technology (KENTECH)

  14. Anti-Collapse Dynamics and the Emergence of Multi-Time-Scale Learning in Recurrent Neural Networks

    Jun 28, 2026Lorenzo LiviHeavy-Tailed NoiseRecurrent Neural Networks

    OPIT – Open Institute of Technology

  15. How Token Influence Decays with Distance: A Green-Function View of Trained Language Models

    Jun 28, 2026Matthias Brändel, Stephan Köhler, Oliver RheinbachTransformer InterpretabilityAutoregressive Language Modeling

    Faculty of Mathematics and Computer Science Technische Universität Bergakademie Freiberg, Freiberg, Germany

  16. ATMA: Length-Invariant Language Modeling via Polar Attention and Gated-Delta Compression Memory

    Jun 23, 2026Habibullah AkbarHybrid AttentionLong-Context Language Modeling

    Kreasof AI Jakarta, Indonesia

  17. Pretraining Recurrent Networks without Recurrence

    Jun 4, 2026Akarsh Kumar, Phillip IsolaRecurrent Neural NetworksRecurrent Language Models

    MIT

  18. TGFormer: Towards Temporal Graph Transformer with Auto-Correlation Mechanism

    May 24, 2026Hongjiang Chen, Pengfei Jiao, Ming Du +4Temporal GNNsLong-Range Dependency Modeling

    Hangzhou Dianzi University, School of Cyberspace, Hangzhou, 310018, China · Tianjin University, College of Intelligence and Computing, Tianjin, 300072, China · State Key Laboratory of Systems Medicine for Cancer, Shanghai Cancer Institute, Shanghai, 200127, China

  19. Sessa: Selective State Space Attention

    Apr 20, 2026Liubomyr HorbatkoState Space ModelsLong-Context Language Modeling

  20. A Queueing-Theoretic Framework for Dynamic Attack Surfaces: Data-Integrated Risk Analysis and Adaptive Defense

    Apr 12, 2026Jihyeon Yun, Abdullah Yasin Etcibasi, Ming Shi +1Long-Range Dependency ModelingQueueing Theory

    University at Buffalo (SUNY), USA.

  21. Optimal Decay Spectra for Linear Recurrences

    Apr 8, 2026Yang CaoLinear RNNsLong-Range Dependency Modeling

  22. On the Mirage of Long-Range Dependency, with an Application to Integer Multiplication

    Mar 30, 2026Zichao WeiLong-Range Dependency ModelingNeural Network Generalization

    Saarland University

  23. Entanglement as Memory: Mechanistic Interpretability of Quantum Language Models

    Mar 27, 2026Nathan RollLong-Range Dependency ModelingCircuits in Language Models

    Department of Linguistics, Stanford University

  24. LPC-SM: Local Predictive Coding and Sparse Memory for Long-Context Language Modeling

    Mar 12, 2026Keqin XieLong-Context Language ModelingAutoregressive Language Modeling

    Independent Researcher, Suzhou, China

  25. Small Object Detection in Complex Backgrounds with Multi-Scale Attention and Global Relation Modeling

    Mar 4, 2026Wenguang Tao, Xiaotian Wang, Tian Yan +2Long-Range Dependency ModelingSmall Object Detection

    Unmanned System Research Institute, Northwestern Polytechnical University, Xi’an, China · Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong, China

  26. Wave-Attractor-Tree: A Hierarchical Binary Tree Reduction Architecture for Efficient Sequence Modeling

    Feb 28, 2026Igor BerezkinLong-Range Dependency ModelingSequence Modeling

    Independent Researcher

  27. SegKAN: High-Resolution Medical Image Segmentation with Long-Distance Dependencies

    Dec 28, 2024Shengbo Tan, Rundong Xue, Shipeng Luo +7Image SegmentationLong-Range Dependency Modeling

    College of Computer Science and Artificial Intelligence, Southwest Minzu University, Chengdu 610225, China · Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an 710049, China · College of Mechanical and Electrical Engineering, Northeast Forestry University, Harbin 150040, China +4