Overview

Temporal attention studies how models select and combine information from different moments, helping them track change, use long-range context, and focus on relevant events. Common approaches include Transformer self- and cross-attention with temporal or relative-time encodings, local-window attention, and efficient variants that combine attention with recurrent or gated aggregation. These methods are used in video action recognition and grounding, video generation, time-series forecasting, and irregular clinical records, and are evaluated on task-specific video and forecasting benchmarks. A central challenge is balancing long-range context and computational cost, while attention weights may not reliably explain which moments drove a prediction.

Latest papers

CardsList

67 papers4 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.

  1. Efficient Temporal Modeling for Mobile Sleep Staging via Lightweight Random Attention

    May 31, 2026Guisong Liu, Pengfei Wei, Jainsong Zhang +1Sleep Stage ClassificationAttention Mechanisms

  2. ST-ColoNet: Spatio-Temporal Colon Segment Recognition via Hybrid Attention and Edge-Guided Feature Learning

    May 27, 2026Crystal Cai, Ziyi Wang, Zhengjie Zhang +3Temporal AttentionTemporal Video Understanding

  3. MLLMs Know When Before Speaking: Revealing and Recovering Temporal Grounding via Attention Cues

    May 21, 2026Dazhao Du, Liao Duan, Jian Liu +5Temporal Video GroundingMultimodal Large Language Models

  4. Fast 4D Mesh Generation by Spatio-Temporal Attention Chains

    May 19, 2026Dvir Samuel, Yuval Atzmon, Gal Chechik +13D Mesh Generation4D Reconstruction

  5. SeesawNet: Towards Non-stationary Time Series Forecasting with Balanced Modeling of Common and Specific Dependencies

    May 14, 2026Hao Li, Lu Zhang, Liu Chong +3Multivariate Time Series ForecastingNon-Stationary Time Series Forecasting

  6. TeDiO: Temporal Diagonal Optimization for Training-Free Coherent Video Diffusion

    May 13, 2026Nurislam Tursynbek, Zhiqiang Lao, Heather Yu +2Video Diffusion ModelsDiffusion Transformer

  7. Beyond Similarity: Temporal Operator Attention for Time Series Analysis

    May 11, 2026Jevon Twitty, Vinh Pham, Nitiwith Rotchanarak +4Time Series ClassificationTime Series Forecasting

  8. Hi-GaTA: Hierarchical Gated Temporal Aggregation Adapter for Surgical Video Report Generation

    May 11, 2026Kedi Sun, Chaohui Dang, Yue Feng +3Surgical Video UnderstandingVideo Representation Learning

  9. HELIX: Hybrid Encoding with Learnable Identity and Cross-dimensional Synthesis for Time Series Imputation

    May 4, 2026Fengming Zhang, Wenjie Du, Huan Zhang +2Time Series ImputationRepresentation Learning

  10. MSACT: Multistage Spatial Alignment for Stable Low-Latency Fine Manipulation

    May 1, 2026Xianbo Cai, Hideyuki Ichiwara, Masaki Yoshikawa +1Bimanual Robotic ManipulationVisuomotor Policy Learning

  11. TS-Attn: Temporal-wise Separable Attention for Multi-Event Video Generation

    Apr 21, 2026Hongyu Zhang, Yufan Deng, Zilin Pan +6Image-to-Video GenerationT2V Generation

  12. Emergence Transformer: Dynamical Temporal Attention Matters

    Apr 18, 2026Zihan Zhou, Bo-Wei Qin, Kai Du +1Dynamical SystemsTemporal Attention

  13. Beyond Monologue: Interactive Talking-Listening Avatar Generation with Conversational Audio Context-Aware Kernels

    Apr 11, 2026Yuzhe Weng, Haotian Wang, Xinyi Yu +4Audio-Video GenerationTalking Head Generation

  14. A Temporally Augmented Graph Attention Network for Affordance Classification

    Apr 11, 2026Ami Chopra, Supriya Bordoloi, Shyamanta M. HazarikaGraph Attention NetworksTemporal GNNs

  15. Insights from Visual Cognition: Understanding Human Action Dynamics with Overall Glance and Refined Gaze Transformer

    Apr 8, 2026Bohao Xing, Deng Li, Rong Gao +2Video Action RecognitionSpatiotemporal Transformers

  16. BiTA: Bidirectional Gated Recurrent Unit-Transformer Aggregator in a Temporal Graph Network Framework for Alert Prediction in Computer Networks

    Apr 3, 2026Zahra Makki Nayeri, Mohsen RezvaniHybrid Transformer ArchitecturesTemporal GNNs

  17. BEVPredFormer: Spatio-temporal Attention for BEV Instance Prediction in Autonomous Driving

    Apr 3, 2026Miguel Antunes-García, Santiago Montiel-Marín, Fabio Sánchez-García +3Autonomous Driving Perception3D ViTs

  18. MATA-Former & SIICU: Semantic Aware Temporal Alignment for High-Fidelity ICU Risk Prediction

    Apr 2, 2026Zhichong Zheng, Xiaohang Nie, Xueqi Wang +3Clinical Risk PredictionLongitudinal EHR Modeling

  19. WISTERIA: Weak Implicit Signal-based Temporal Relation Extraction with Attention

    Mar 24, 2026Duy Dao Do, Anaïs Halftermeyer, Thi-Bich-Hanh DaoRelation ExtractionTemporal Reasoning

  20. Learning Consistent Temporal Grounding between Related Tasks in Sports Coaching

    Mar 19, 2026Arushi Rai, Adriana KovashkaTemporal Video GroundingTemporal Attention

  21. Motion-Adaptive Temporal Attention for Lightweight Video Generation with Stable Diffusion

    Mar 18, 2026Rui Hong, Shuxue QuanVideo Diffusion ModelsTemporal Attention

  22. GATS: Gaussian Aware Temporal Scaling Transformer for Invariant 4D Spatio-Temporal Point Cloud Representation

    Mar 17, 2026Jiayi Tian, Jiaze WangPoint Cloud LearningInvariant Representation Learning

  23. Distributed Acoustic Sensing for Urban Traffic Monitoring: Spatio-Temporal Attention in Recurrent Neural Networks

    Mar 14, 2026Izhan Fakhruzi, Manuel Titos, Carmen Benítez +1Spatio-Temporal AttentionDistributed Acoustic Sensing

  24. FrameDiT: Diffusion Transformer with Matrix Attention for Efficient Video Generation

    Mar 10, 2026Minh Khoa Le, Kien Do, Duc Thanh Nguyen +1Efficient Video GenerationVideo Diffusion Models

  25. MMTA: Multi Membership Temporal Attention for Fine-Grained Stroke Rehabilitation Assessment

    Mar 1, 2026Halil Ismail Helvaci, Justin Huber, Jihye Bae +1Temporal Action SegmentationTemporal Attention