Graph Attention Networks

Also known as GAT

Follow this topic Ask about this topic

Momentum

4 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 41

All topics

Let the Heads Talk: Beyond Diagonal Graph Attention
Oct 1, 2026Riccardo Ali, Alessio Borgi, Mario Severino +4Graph Attention Networks Sheaf Neural Networks
Department of Computer Science and Technology, University of Cambridge · Department of Computer, Control and Management Engineering, Sapienza University of Rome · Department of Information Engineering, University of Padua +1
Diffusion-Induced Spatial Attention Overlapping Community Detection
Sep 22, 2026Kosti Koistinen, Vesa Kuikka, Joni Herttuainen +3Graph Attention Networks Graph Clustering
Aalto University School of Science Computer Science Department P.O.Box 11000, 00076 AALTO, Finland · Lockheed Martin USA
Graph Attention Design Choices Matter: A Controlled Study of LoRA-Adapted Audio Anti-Spoofing
Sep 14, 2026Haoyu Wang, Jing Yang, Chenyu Liu +7Graph Attention Networks ASVspoof
School of Computing and Artificial Intelligence, Southwestern University of Finance and Economics, Chengdu, China · MiLM Plus, Xiaomi Inc., Beijing, China · School of Electronic Information, Wuhan University, Wuhan, China +1
Predicting Spatiotemporal Mobile Sensing-Based PM2.5 Concentrations Using Low-Rank Adapted Spatially Attentive Graph Neural Network
Sep 7, 2026Om Chiddarwar, Priyanka Mandal, Praveen Kumar Chandaliya +1Graph Attention Networks Air Quality Prediction
IIITDM Kurnool, Kurnool, Andhra Pradesh 518002, India · Sardar Vallabhbhai National Institute of Technology Surat, Gujarat 394210, India
GARLIC: Graph Attention-based Relational Learning of Multivariate Time Series in Intensive Care
Aug 11, 2026Ruirui Wang, Yanke Li, Manuel Günther +1Irregular Time-Series Modeling Graph Attention Networks
Department of Informatics University of Zürich · SCAI Lab, D-HEST ETH Zürich & SPF
Power law graph attention: exact generalization of scaled dot-product attention, empirical collapse at inference
Aug 10, 2026Burc GokdenGraph Attention Networks LLM Inference
Fromthesky Research Labs LLC, Oregon, USA
When Should Graph Attention Be Sparse? Learning a Per-Edge Tsallis Index
Aug 3, 2026Kleyton da Costa, Bernardo ModenesiGraph Attention Networks Attention Mechanisms
University College London & Holistic AI · University of Utah
MDGAM-Based Cooperative Task Scheduling for Communication-Constrained Distributed Multi-Agent Systems
Aug 1, 2026Licheng Wang, Mingtao Huang, Yuan ShenGraph Attention Networks Multi-Agent Systems
Department of Electronic Engineering, and Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
How Much Does Message Passing Matter? A Drop-In Study of GNN Layers for Neural Network Graph Regression
Jul 29, 2026Keith G. Mills, Aedan J. DeFrates, Joong Ho KimGraph Attention Networks Graph Neural Networks
LSU ATHENA Lab
Integrating Factual and Normative Industrial Knowledge via Constraint-Aware Graph Attention for Process Plan Recommendation
Jul 27, 2026Yuntong Chen, Yingqi Li, Yingying Xiao +5Manufacturing Graph Attention Networks
School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, Shaanxi, 710072, China · State Key Laboratory of Complex Product Intelligent Manufacturing System Technology, Beijing Institute of Electronic System Engineering, Beijing, 100854, China
Learning to Optimize: Joint Routing and Flow Allocation on Sparse Non-Euclidean Networks
Jul 26, 2026Haomiao Sun, Fang He, Congyuan Ji +1Graph Attention Networks Learning to Optimize
Department of Industrial Engineering, Tsinghua University, Beijing 100084, P.R. China · School of Management Science and Engineering, Central University of Finance and Economics, Beijing 100081, P.R. China
Explainable graph attention network for stress recognition (StressGAT) via differential action units
Jul 23, 2026Thomas Kassiotis, Stefanos Gkikas, Nikolaos Smyrnis +1Graph Attention Networks Facial Expression Recognition
Department of Electronic Engineering Hellenic Mediterranean University Chania, Greece · Honda Research Institute Japan Wako City, Japan · University Mental Health, Neurosciences and Precision Medicine, Research Institute “COSTAS STEFANIS” 2nd Department of Psychiatry, Medical School, National and Kapodistrian University of Athens Athens, Greece +1
EMAGN: Efficient Multi-Attention Graph Network via Learned Clustering for Scalable Traffic Forecasting
Jul 14, 2026Mingxing Xu, Rakesh Chowdary Machineni, Ke Liu +7Efficient Neural Network Inference Graph Attention Networks
Shanghai Jiao Tong University · University of Michigan, Ann Arbor · University of California, Berkeley +5
Comparative Analysis of GAT and BERT for Human-Like Playtesting
Jul 13, 2026Kleio Fragkedaki, Theodoros Panagiotakopoulos, Matteo Biasielli +1Graph Attention Networks Graph Neural Networks
AI Center of Excellence King Stockholm, Sweden
SALT-GNN: Handling Dense Neighborhoods in Anti-Money Laundering Graphs via Statistics-Aware Attention
Jul 11, 2026Lidia Losavio, Francesco Sovrano, Dario Fenoglio +2Graph Attention Networks Graph Neural Networks
Università della Svizzera italiana (USI) Lugano, Switzerland
Graph Convolutional Attention: A Spectral Perspective on Graph Denoising and Diffusion
Jul 7, 2026Shervin Khalafi, Igor Krawczuk, Sergio Rozada +3Graph Attention Networks Graph Transformer
University of Pennsylvania · King Juan Carlos University · Stanford University
Beyond Isolated Objects: Relationship-aware Open Vocabulary Scene Understanding via 3D Scene Graph Analysis
Jul 6, 2026Xianhao Chen, Jiarui Hu, Yuanbo Yang +5Graph Attention Networks Open-Vocabulary 3D Segmentation
State Key Lab of CAD&CG, Zhejiang University, China · Zhejiang University, China
X-LogSMask: Expand Transformer for Graph-Structured Data
Jul 2, 2026Leyan Li, Rennong Yang, Zhenxing Zhang +1Graph Attention Networks Graph Representation Learning
Gated Multi-Graph Fusion via Graph Attention Networks for Alzheimer's Disease Detection
Jun 30, 2026Jinyu Li, Xiao Wei, Bin Wen +5Alzheimer's Disease Graph Attention Networks
School of Future Technology, Tianjin University, Tianjin, China · Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China · College of Computer and Data Science, Fuzhou University, Fuzhou, China +1
hia-gat: A Heterogeneous Interaction-Aware Graph Attention Network For Frame-Level Traffic Conflict Risk Prediction On Freeways
Jun 25, 2026Mahshid Malazizi, Seyedmehdi Khaleghian, Mina Sartipi +3Graph Attention Networks Intelligent Transportation Systems
Center for Urban Informatics and Progress University of Tennessee at Chattanooga Chattanooga, TN, USA, 37403 · DENSO International America, Inc. Southfield, MI, USA
SEAGAN: domain-Specific and Edge-Aware Graph Attention Network for Dynamic Plant Processes
Jun 17, 2026Antriksh Srivastava, Soumyashree KarGraph Attention Networks Graph Representation Learning
Center of Studies in Resources Engineering · Indian Institute of Technology Bombay · Mumbai, India 400076
On Efficient Scaling of GNNs via IO-Aware Layers Implementations
May 29, 2026Daria Fomina, Daniil Krasylnikov, Alexey Boykov +3Graph Attention Networks GPU Kernel Optimization
1Yandex · 2HSE University · 3ITMO University
Gated Graph Attention Networks with Learnable Temperature
May 28, 2026Zhongtian Ma, Hao Wu, Yexin Zhang +2Graph Attention Networks Graph Neural Networks
School of Cybersecurity, Northwestern Polytechnical University, Xi’an 710072, China · Shanghai Artificial Intelligence Laboratory, Shanghai 200232, China
Is an Image Also Worth 16x16=256 Superpixels? A Framework for Attentional Image Classification
May 26, 2026Pedro Henrique da Costa Avelar, Anderson R. Tavares, Luís C. LambGraph Attention Networks Vision Transformer
ufrgs · uom
TED: Related Party Transaction guided Tax Evasion Detection on Heterogeneous Graph
May 26, 2026Yiming Xu, Bin Shi, Bo Dong +3Graph Attention Networks Heterogeneous GNNs
School of Computer Science and Technology, Xi’an Jiaotong University, Shaanxi, China. · School of Distance Education, Xi’an Jiaotong University, Shaanxi, China. · School of Computing and Augmented Intelligence, Arizona State University, Phoenix, USA.
SCAFDS: Edge-Feature Graph Attention for Interbank Fraud Detection with Attribution-Grounded SAR Generation
May 17, 2026Mohammad Nasir UddinGraph Attention Networks Financial Fraud Detection
Taskimpetus Inc., Los Angeles, CA 90020, USA
Gaussian Relational Graph Transformer
May 15, 2026Zezhong Ding, Jin Li, Xugang Wang +1Graph Attention Networks Graph Representation Learning
School of Artificial Intelligence and Data Science, University of Science and Technology of China (USTC) · Data Darkness Lab, Suzhou Institute for Advanced Research, USTC · School of Biomedical Engineering, USTC +1
Rethinking Graph Convolution for 2D-to-3D Hand Pose Lifting
May 13, 2026Chanyoung Kim, Donghyun Kim, Dong-Hyun Sim +2Graph Attention Networks Graph Representation Learning
Emory University · Yonsei University · WHATs Lab
Hierarchical Attention-based Graph Neural Network with Relevance-driven Pruning
May 10, 2026Seungwoo KumGraph Attention Networks Heterogeneous GNNs
Korea Electronics Technology Institute (KETI) Seongnam, Republic of Korea
Attention-based graph neural networks: a survey
May 9, 2026Chengcheng Sun, Chenhao Li, Xiang Lin +4Graph Attention Networks Graph Neural Networks
School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, Jiangsu, 221116, China. · Mine Digitization Engineering Research Center, Ministry of Education of the People’s Republic of China, Xuzhou, Jiangsu, 221116, China.

Oct 1, 2026, cs.LGJ/K move · Enter open · S save

Let the Heads Talk: Beyond Diagonal Graph Attention

Riccardo Ali, Alessio Borgi, Mario Severino, Alessio Gravina+3

Department of Computer Science and Technology, University of Cambridge · Department of Computer, Control and Management Engineering, Sapienza University of Rome · Department of Information Engineering, University of Padua+1

Graph Attention Networks Sheaf Neural Networks Multi-Head Attention

Open paper AskPDF arXiv

Sheaf Neural Networks generalize scalar-weighted message passing by replacing scalar edge weights with linear transport maps between local feature spaces. Yet the role of this matrix-valued transport is entangled with the broader sheaf-diffusion construction. We isolate the transport primitive through quiver representations and establish a direct connection with multi-head attention. Treating attention heads as coordinates of a local transport space reveals that standard multi-head attention implements diagonal edge maps: along each directed interaction, a source head can contribute only to the corresponding receiver head. Allowing off-diagonal entries instead enables edge-conditioned communication across heads before neighborhood aggregation. We show that this operation cannot, in general, be absorbed into a single shared linear map applied after aggregation. Building on this characterization, we introduce Topological Attention (Top-A), a multi-head attention that learns edge-dependent off-diagonal routes while preserving the original same-head paths and exactly recovering vanilla attention when the additional routing vanishes. We evaluate Top-A on relational reasoning, heterogeneous graph learning, and algorithmic reasoning, including out-of-distribution generalization, with heterophilic node classification as a contrast setting. The results show that cross-head transport is most useful when the task benefits from interaction-dependent transformations, while heterophily alone provides no systematic advantage. These findings identify edge-conditioned cross-head communication as a distinct computational primitive of matrix-valued transport.

Momentum

Related topics

Latest papers 41