Attention Based Graph Neural Network

Attention-based Graph Neural Networks (GNNs) leverage the power of graph structures to represent data and incorporate attention mechanisms to weigh the importance of different connections within the graph, improving feature learning and representation. Current research focuses on enhancing GNN efficiency and expressiveness through novel attention architectures, addressing challenges like oversmoothing in deep networks and developing methods for handling large graphs and diverse data types, including tabular data and images. These advancements are significantly impacting various fields, enabling improved performance in tasks such as protein-protein interaction prediction, network localization, and graph classification, demonstrating the broad applicability of attention-based GNNs.

Papers

November 7, 2024

Financial Fraud Detection using Jump-Attentive Graph Neural Networks
Prashank Kadam
Graph Neural Network Fraud Detection Financial Fraud Detection Attention Based Graph Neural Network Graph Theoretic

October 9, 2024

Faithful Interpretation for Graph Neural Networks
Lijie Hu, Tianhao Huang, Lu Yu, Wanyu Lin, Tianhang Zheng, Di Wang
Graph Neural Network Graph Attention Network Attention Based Graph Neural Network Graph Analysis Attention Based Interpretation

June 26, 2024

ContactNet: Geometric-Based Deep Learning Model for Predicting Protein-Protein Interactions
Matan Halfon, Tomer Cohen, Raanan Fattal, Dina Schneidman-Duhovny
Deep Learning Model Molecular Docking Protein Structure Protein Protein Interaction Past Point Contact Attention Based Graph Neural Network Antibody Structure

February 26, 2024

Graph Learning with Distributional Edge Layouts
Xinjian Zhao, Chaolong Ying, Tianshu Yu
Graph Neural Network Graph Learning Boltzmann Distribution Attention Based Graph Neural Network

January 1, 2024

Saliency-Aware Regularized Graph Neural Network
Wenjie Pei, Weina Xu, Zongze Wu, Weichao Li, Jinfan Wang, Guangming Lu, Xiangrong Wang
Graph Representation Graph Classification Attention Based Graph Neural Network

November 28, 2023

Attentional Graph Neural Networks for Robust Massive Network Localization
Wenzhong Yan, Juntao Wang, Feng Yin, Yang Tian, Abdelhak M. Zoubir
Graph Neural Network Deep Convolutional Neural Network Attention Graph Localization System Attention Based Graph Neural Network

July 4, 2023

Learning Feature Matching via Matchable Keypoint-Assisted Graph Neural Network
Zizhuo Li, Jiayi Ma
Feature Matching Arbitrary Keypoints Attention Based Aggregation Attention Based Graph Neural Network Context Aggregation

June 11, 2023

Between-Sample Relationship in Learning Tabular Data Using Graph and Attention Networks
Shourav B. Rabbani, Manar D. Samad
Representation Learning Graph Drawing Attention Network Attention Model Table Representation Tabular Learning Attention Based Graph Neural Network Inter Sample

June 4, 2023

Towards Deep Attention in Graph Neural Networks: Problems and Remedies
Soo Yong Lee, Fanchen Bu, Jaemin Yoo, Kijung Shin
Graph Neural Network Graph Attention Related Problem Attention Based Graph Neural Network

May 25, 2023

Demystifying Oversmoothing in Attention-Based Graph Neural Networks
Xinyi Wu, Amir Ajorlou, Zihui Wu, Ali Jadbabaie
Graph Neural Network Graph Attention Network Graph Attention Mechanism Attention Based Graph Neural Network

May 12, 2023

Fisher Information Embedding for Node and Graph Learning
Dexiong Chen, Paolo Pellizzoni, Karsten Borgwardt
Graph Learning Graph Attention Network Graph Attention Fisher Information Attention Graph Attention Based Graph Neural Network

March 20, 2023

Positional Diffusion: Ordering Unordered Sets with Diffusion Probabilistic Models
Francesco Giuliari, Gianluca Scarpellini, Stuart James, Yiming Wang, Alessio Del Bue
Complex Reasoning Diffusion Probabilistic Model Attention Based Graph Neural Network Point Diffusion

June 10, 2022

Beyond the Gates of Euclidean Space: Temporal-Discrimination-Fusions and Attention-based Graph Neural Network for Human Activity Recognition
Nafees Ahmad, Savio Ho-Chit Chow, Ho-fung Leung
Graph Neural Network Activity Recognition Content Based Feature Graph Convolutional Neural Network Temporal Fusion Euclidean Space Graph Convolutional Attention Based Graph Neural Network

November 11, 2021

Sequential Aggregation and Rematerialization: Distributed Full-batch Training of Graph Neural Networks on Large Graphs
Hesham Mostafa
Graph Neural Network Full Batch Gradient Descent Attention Based Graph Neural Network Numerical Aggregation