Spatiotemporal Transformers

Latest papers

20 papers2 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

OceanTensorCube and ST-MMT: A Multimodal Data and Transformer System for Seven-Day Forecasting of Pyropia Bleaching
Oct 19, 2026Gwangjin Kim, Cheolyoung Jang, Yosep JoTime Series Forecasting Spatiotemporal Forecasting
NCS Instructor, Smart Human Resources Development Institute, Republic of Korea · NH Networks LLC, Republic of Korea · DreamTech Co., Ltd., Republic of Korea
Spectral Adaptive Graph Transformer for Efficient and Scalable Traffic Forecasting
Oct 18, 2026Amirhossein Ghaffari, Susanna Pirttikangas, Ekaterina GilmanSpatiotemporal Forecasting Traffic Flow Estimation
Future Computing Group, University of Oulu, 90570 Oulu, Finland
Investigating Spatiotemporal Redundancy in Video Transformer for Collision Anticipation
Oct 3, 2026Xiaoshan ZhouSpatiotemporal Transformers Video Token Compression
School of Project Management, Faculty of Engineering, University of Sydney, NSW, Australia
Paths: Prompt-aware Spatio-temporal Transformer with Hierarchical Multi-modal Fusion for RGB-Event Video Person Re-Identification
Aug 13, 2026Yakun Huo, Yingquan Wang, Yangyang Liu +4Cross-Modal Representation Learning Transformer
Dalian University of Technology Dalian, China
Hybrid Artificial Potential Fields and Spatio-Temporal Transformers for Real-Time AUV Path Planning
Jul 27, 2026Khadija Rais, Abdelmadjid Benmachiche, Imene SoualmiaSpatiotemporal Transformers Underwater Robotics
Laboratory of Mathematics, Informatics and Systems (LAMIS), Echahid Cheikh Larbi Tebessi University, T´ebessa, Algeria · Department of Computer Science, LIMA Laboratory, Chadli Bendjedid University, El-Tarf, Algeria
Structure over Depth: A Single-Block Spatio-Temporal Transformer for Multi-Entity Reasoning
Jul 25, 2026Narthana Sivalingam, Santhirarajah Sivasthigan, Buddhi Wijenayake +3Spatiotemporal Reasoning Human Activity Recognition
Department of Electrical and Electronic Engineering University of Peradeniya Peradeniya, Sri Lanka
HyperGS: Fast and Generalizable Gaussian Video Representation
Jul 13, 2026Fatimah Zohra, Chen Zhao, Shuming Liu +23D Gaussian Splatting Spatiotemporal Transformers
1King Abdullah University of Science and Technology (KAUST) · 2Harbin Institute of Technology, Shenzhen
HandFlow: Fully Generative 4D Hand Recovery with Flow Matching
Jul 13, 2026Mingxi Xu, Bowen Duan, Yi Gu +3Articulated Object Reconstruction 4D Reconstruction
The Hong Kong University of Science and Technology (Guangzhou), China · Google, USA
A Unified Model for Highly Accurate ECG-Free Dynamic Coronary Roadmapping Using Spatio-Temporal Transformers
Jul 9, 2026Saahil Islam, Sebastian Piat, Venkatesh N. Murthy +4Point Tracking Medical Imaging
Pattern Recognition Lab, Friedrich Alexander University, Erlangen, Germany · Digital Technology and Innovation, Siemens Healthineers, Erlangen, Germany · Digital Technology and Innovation, Siemens Healthineers, Princeton, USA
Less Tokens, Better Forecasts: Sparse Residual Routing for Efficient Weather Prediction
Jul 2, 2026Janet Wang, Yunbei Zhang, Lin Zhao +3Efficient ViTs Dense Prediction
Tulane University · Northeastern University · University of Alabama at Birmingham +1
Illumination-Robust Camera-Based Heart-Rate Estimation for Physiological Sensing in Robots
Jun 10, 2026Zhi Wei Xu, Torbjörn E. M. NordlingRemote Photoplethysmography Distribution Shift Robustness
Department of Mechanical Engineering, National Cheng Kung University, Tainan, Taiwan.
TrajTok: Adaptive Spatial Tokenization for Trajectory Representation Learning
May 19, 2026Zhen Xiong, Shang-Ling Hsu, Cyrus ShahabiGeospatial Representation Learning Trajectory Representation Learning
University of Southern California
Automated Detection of Abnormalities in Zebrafish Development
May 11, 2026Sarath Sivaprasad, Hui-Po Wang, Anna-Lisa Jäckel +4Spatiotemporal Transformers Toxicity Detection
CISPA Helmholtz Center for Information Security, Saarbrücken, Germany · Helmholtz Institute for Pharmaceutical Research Saarland, Saarbrücken, Germany
LAMP: Localization Aware Multi-camera People Tracking in Metric 3D World
May 6, 2026Nan Yang, Julian Straub, Fan Zhang +3Spatiotemporal Transformers Egocentric Video Understanding
Meta Reality Labs Research
Exploring the Potential of Probabilistic Transformer for Time Series Modeling: A Report on the ST-PT Framework
Apr 29, 2026Zhangzhi Xiong, Haoyi Wu, You Wu +3Transformer Conditional Random Fields
School of Information Science and Technology, ShanghaiTech University
Insights from Visual Cognition: Understanding Human Action Dynamics with Overall Glance and Refined Gaze Transformer
Apr 8, 2026Bohao Xing, Deng Li, Rong Gao +2Video Action Recognition Spatiotemporal Transformers
Department of Computational Engineering, Lappeenranta-Lahti University of Technology LUT, Finland · Faculty of Information Technology, Brno University of Technology, Czech Republic
Long-Horizon Traffic Forecasting via Incident-Aware Conformal Spatio-Temporal Transformers
Mar 17, 2026Mayur Patil, Qadeer Ahmed, Shawn Midlam-Mohler +4Spatiotemporal Transformers Traffic Forecasting
Department of Mechanical and Aerospace Engineering and the Center for Automotive Research, The Ohio State University · Ohio Department of Transportation · Honda Research Institute USA, Inc.
SignNav: Leveraging Signage for Semantic Visual Navigation in Large-Scale Indoor Environments
Mar 17, 2026Jian Sun, Yuming Huang, He Li +6Spatiotemporal Transformers Visual Navigation
Faculty of Science and Technology, University of Macau · Department of Robotics, University of Michigan
End-to-End Spatial-Temporal Transformer for Real-time 4D HOI Reconstruction
Mar 15, 2026Haoyu Zhang, Wei Zhai, Yuhang Yang +2Spatiotemporal Transformers 4D Reconstruction
University of Science and Technology of China
Deep Generative Transformers for Probabilistic Time Series and Spatiotemporal Forecasting
Mar 12, 2026Rajdeep Pathak, Rahul Goswami, Madhurima Panja +2Probabilistic Time Series Forecasting Multivariate Time Series Forecasting
SAFIR, Sorbonne University Abu Dhabi, United Arab Emirates. · SCAI, Sorbonne Universit´e, Paris, France. · Indian Institute of Technology Guwahati, Assam, India.

Oct 19, 2026J/K move · Enter open · S save

OceanTensorCube and ST-MMT: A Multimodal Data and Transformer System for Seven-Day Forecasting of Pyropia Bleaching

Gwangjin Kim, Cheolyoung Jang, Yosep Jo

NCS Instructor, Smart Human Resources Development Institute, Republic of Korea · NH Networks LLC, Republic of Korea · DreamTech Co., Ltd., Republic of Korea

Time Series Forecasting Spatiotemporal Forecasting Aquaculture Multivariate Time Series Forecasting Spatiotemporal Transformers

Open paper AskPDF arXiv

Bleaching of cultured Pyropia (laver) causes losses in Korean seaweed farming. We present a system that forecasts bleaching seven days ahead for farm clusters. OceanTensorCube aligns 32 channels from public marine, meteorological, ocean-model and satellite sources on a 30 m grid, and ST-MMT, a 9.2-million-parameter spatiotemporal transformer with hub-style multi-head cross-attention between variable groups, maps a 14-day input window to a seven-day-ahead bleaching probability. On the validation set, a six-seed ensemble detects every reported positive at a false-alarm rate of at most 3.5%, an upper bound because the report-based labels are positive-unlabeled. A same-date control on separately trained models indicates that the architecture discriminates between clusters when the calendar is held fixed. We also report the system's weaknesses: skill falls steeply as the quarterly nutrient survey ages (ROC-AUC 0.94 at 30 days, 0.53 at 129 days), and a single LSTM on cluster-average series outperforms a single ST-MMT, with only the ensemble leading at the operating point. We describe the labeling procedure, the evaluation protocol and the operational gate that withholds forecasts when inputs are stale. The forecasting service is operated at https://oceantensor.ai.kr.