Long Range
Long-range interactions and perception are a significant challenge across diverse scientific fields, aiming to accurately model and predict phenomena extending beyond immediate spatial or temporal proximity. Current research focuses on developing novel architectures and algorithms, such as transformers, spiking neural networks, and various message-passing methods, to effectively capture long-range dependencies in data, often incorporating techniques like attention mechanisms and memory modules to improve performance. These advancements have implications for various applications, including autonomous driving, remote sensing, human-robot interaction, and the analysis of complex systems, by enabling more accurate and efficient modeling of long-range effects. The development of robust and efficient long-range models is crucial for advancing these fields.
Papers
SMR: State Memory Replay for Long Sequence Modeling
Biqing Qi, Junqi Gao, Kaiyan Zhang, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou
Injecting Hamiltonian Architectural Bias into Deep Graph Networks for Long-Range Propagation
Simon Heilig, Alessio Gravina, Alessandro Trenta, Claudio Gallicchio, Davide Bacciu