Transformer

Follow this topic Ask about this topic

Momentum

26 papers in the last four weeks, up 44% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 351

All topics

Scalable Cross-Attention Transformer for Cooperative Multi-AP OFDM Uplink Reception
Feb 4, 2026Xavier Tardy, Grégoire Lefebvre, Apostolos Kountouris +2Transformer Cross-Attention
IETR - UMR CNRS 6164, CentraleSup´elec, avenue de la Boulaie - CS 47601 35576 CESSON-SEVIGNE Cedex, France · Orange Research, Grenoble, France
Plain Transformers are Surprisingly Powerful Link Predictors
Feb 2, 2026Quang Truong, Yu Song, Donald Loveland +4Transformer Graph Representation Learning
Department of Computer Science and Engineering, Michigan State University, East Lansing, MI, USA. · Snap Inc., Bellevue, WA, USA.
Semi-supervised CAPP Transformer Learning via Pseudo-labeling
Feb 1, 2026Dennis Gross, Helge Spieker, Arnaud Gotlieb +3Transformer Pseudo-Labeling
1- Simula Research Laboratory, Oslo Norway · 2- National Technical University of Athens, School of Mechanical Engineering, Manufacturing Technology Laboratory Greece
A Constrained Optimization Perspective of Unrolled Transformers
Jan 24, 2026Javier Porras-Valenzuela, Samar Hadou, Alejandro RibeiroDeep Learning Optimization Transformer
Department of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia, PA, United States of America.
Categorize Early, Integrate Late: Divergent Processing Strategies in Automatic Speech Recognition
Jan 11, 2026Nathan Roll, Pranav Bhalerao, Martijn Bartelds +7Audio Representation Learning Hybrid CNN-Transformer Architectures
Stanford University
Attention in Motion: Secure Platooning via Transformer-based Misbehavior Detection
Dec 17, 2025Konstantinos Kalogiannis, Ahmed Mohamed Hussain, Hexu Li +1Transformer Intelligent Transportation Systems
Networked Systems Security (NSS) Group, KTH Royal Institute of Technology, Stockholm, Sweden · Tech Validation – AI department at the Chief Technology Officer (CTO) Organization, Lenovo, Beijing, China
Equivalence of Context and Parameter Updates in Modern Transformer Blocks
Nov 22, 2025Adrian Goldwaser, Michael Munn, Javier Gonzalvo +1Transformer Interpretability Transformer FFNs
University of Cambridge, UK · Google Research
A Space-Time Transformer for Precipitation Nowcasting
Nov 14, 2025Levi Harris, Tianlong ChenPrecipitation Forecasting Transformer
UNC Chapel Hill
STAR-VAE: A Scalable Latent-Variable Transformer for Controllable Molecular Generation
Nov 4, 2025Bum Chul Kwon, Ben Shapira, Moshiko Raboh +7Molecular Optimization Transformer
IBM Research, Cambridge, MA, USA · IBM Research, Haifa, Israel · IBM Research, Yorktown Heights, NY, USA
Emergence of Minimal Circuits for Indirect Object Identification in Attention-Only Transformers
Oct 28, 2025Rabin AdhikariAttention Head Analysis Transformer
Saarland University 66123 Saarbrücken
Performance-Efficiency Tradeoffs in Transformers: An Approximation Theory Perspective
Oct 4, 2025Ruoxi Yu, Haotian Jiang, Jingpu Cheng +3Softmax Attention Attention Head Analysis
Center for Data Science, Peking University · Institute for Functional Intelligent Materials, National University of Singapore · Department of Mathematics, National University of Singapore +1
RheOFormer: A generative transformer model for simulation of complex fluids and flows
Oct 1, 2025Maedeh Saberi, Amir Barati Farimani, Safa JamaliNeural Surrogate Modeling Transformer
Department of Mechanical and Industrial Engineering, Northeastern University, Boston, MA 02115, USA · Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
Symmetry-Aware Transformer Training for Automated Planning
Aug 11, 2025Markus Fritzsche, Elliot Gestrin, Jendrik SeippContrastive Learning Transformer
Linköping University, Sweden
MetaTT: A Global Tensor-Train Adapter for Parameter-Efficient Fine-Tuning
Jun 10, 2025Javier Lopez-Piqueres, Pranav Deshpande, Archan Ray +3Transformer Tensor Decomposition
Global Technology Applied Research, JPMorgan Chase, New York, NY 10001, USA
SG-Blend: Learning an Interpolation Between Improved Swish and GELU for Robust Neural Representations
May 29, 2025Gaurav Sarkar, Syed Affan Daimi, Jay Gala +1Transformer FFNs Transformer
IIIT · Microsoft · Intel
Predicting Estimated Times of Restoration for Electrical Outages Using Longitudinal Tabular Transformers
May 1, 2025Bogireddy Sai Prasanna Teja, Valliappan Muthukaruppan, Carls BenjaminEvent Time Prediction Transformer
Exelon Corporation, Chicago, IL, USA
On Generalisation Error Bounds for Transformers
Oct 15, 2024Lan V. TruongTransformer Statistical Learning Theory
Faculty of Computer Science and Engineering, Ho Chi Minh City University of Technology (HCMUT), Vietnam
AdvMT: Adversarial Motion Transformer for Long-term Human Motion Prediction
Jan 10, 2024Sarmad Idrees, Seokman Sohn, Jongeun ChoiTransformer Human Motion Generation
School of Mechanical Engineering, Yonsei University, Seoul 03722, Korea · Power Generation Lab, Korea Power Research Institute, 105, Munji-Ro, Yuseong-Gu, Daejeon, 34056, South Korea
Introduction to Transformers: an NLP Perspective
Nov 29, 2023Tong Xiao, Jingbo ZhuTransformer Transformer Attention
NLP Lab., Northeastern University, Shenyang, China · NiuTrans Research, Shenyang, China
BiHDTrans: binary hyperdimensional transformer for efficient multivariate time series classification
Date pendingJingtao Zhang, Yi Liu, Qi Shen +1Efficient Neural Network Inference Transformer
School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University · College of Medicine and Biological Information Engineering, Northeastern University
Transformers as In-Context Samplers: From Closed-Form Diffusion to Estimation-Free Sampling
Date pendingArman Adibi, Alireza Jafari, Mohammad Ghavamzadeh +1Transformer Diffusion Sampling
School of Computer and Cyber Sciences, Augusta University · Department of Computer Science, University of Virginia · Qualcomm AI Research

Feb 4, 2026, eess.SPJ/K move · Enter open · S save

Scalable Cross-Attention Transformer for Cooperative Multi-AP OFDM Uplink Reception

Xavier Tardy, Grégoire Lefebvre, Apostolos Kountouris, Haïfa Fares+1

IETR - UMR CNRS 6164, CentraleSup´elec, avenue de la Boulaie - CS 47601 35576 CESSON-SEVIGNE Cedex, France · Orange Research, Grenoble, France

Transformer Cross-Attention Wireless Communications

Open paper AskPDF arXiv

We propose a cross-attention Transformer for joint decoding of uplink OFDM signals received by multiple coordinated access points. A shared per-receiver encoder learns the time-frequency structure of each grid, and a token-wise cross-attention module fuses the receivers to produce soft log-likelihood ratios for a standard channel decoder without explicit channel estimates. Trained with a bit-metric objective, the model adapts its fusion to per-receiver reliability and remains robust under degraded links, strong frequency selectivity, and sparse pilots. Over realistic Wi-Fi channels, it outperforms classical pipelines and strong neural baselines, often matching or surpassing a local perfect-CSI reference while remaining compact and computationally efficient on commodity hardware, making it suitable for next-generation coordinated Wi-Fi receivers.

Momentum

Related topics

Latest papers 351