Transformer

Ask about this topic

Momentum

26 papers in the last four weeks, up 44% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 351

All topics
CardsList

  1. SHIFT: Survival Prediction from Incomplete and Heterogeneous Genomic Data

    Jul 4, 2026Muhammet Sami Yavuz, Ayhan Can Erdur, Sabri Mustafa Kahya +2Cancer GenomicsCancer Survival Prediction

    AI for Image-Guided Diagnosis and Therapy, School of Medicine and Health, Technical University of Munich (TUM), Munich, Germany · Munich Center for Machine Learning (MCML) · Department of Radiation Oncology, TUM University Hospital +4

  2. Transformers with Physics-Informed Encodings and Simulation-Based Inference for Robust Detection of Eccentric Binary Black Holes in Pulsar Timing Array Data

    Jul 4, 2026Subhajit Dandapat, Alvin J. K. ChuaGravitational-Wave AstronomyTransformer

    Department of Physics, National University of Singapore, 21 Lower Kent Ridge Road, Singapore 119077 · Department of Mathematics, National University of Singapore, Singapore 119076

  3. A Fair Benchmarking of Deep Relational Database Learning Models

    Jul 4, 2026Kazi F. Akhter, Bharath Ajendla, Manar D. SamadTransformerGraph Representation Learning

    Department of Computer Science Tennessee State University Nashville, TN, USA · SAP AI Research and Innovation SAP Labs Palo Alto, CA, USA

  4. Individual Parameters in Weight-Sparse Transformers Appear Interpretable

    Jul 3, 2026Arnau Marin-Llobet, Stefan HeimersheimTransformer InterpretabilityTransformer

    School of Engineering and Applied Sciences, Harvard University, Cambridge, MA 02138

  5. Harmonic-Aware Transformer for Real-Time Catheter Localization in Interventional Procedures of Magnetic Particle Imaging

    Jul 3, 2026Abuobaida M. Khair, Wenjing Jiang, Xiaoli Yang +2Medical ImagingTransformer

    School of Control Science and Engineering, Shandong University, Jinan 250061, China · Department of Medical Physics, Al-Neelain University, Khartoum, Sudan · Weifang Xinli Superconducting Magnet Technology Co., Ltd, Weifang 261005, China +1

  6. BamiBERT: A New BERT-based Language Model for Vietnamese

    Jul 2, 2026Dat Quoc Nguyen, Thinh Pham, Chi Tran +1Language Model PretrainingTransformer

    Qualcomm AI Research · Virginia Tech

  7. The Wiola Architecture for Efficient Small Language Models

    Jul 1, 2026Aryuemaan Kumar Chowdhury, Afreen Shaik, Yaparla Bhargavi +1Rotary Positional EmbeddingsToken Merging

    Research and Development, Oscowl Ai IIT Hyderabad Hyderabad, India · Research and Development, Oscowl Ai Hyderabad, India

  8. The State-Prediction Separation Hypothesis

    Jul 1, 2026Giovanni Monea, Nathan Godey, Kianté Brantley +1Language Model PretrainingTransformer

    †Cornell University · ⋄Harvard University

  9. Review Residuals: Update-Conditioned Residual Gating for Transformers

    Jun 30, 2026Kyle KramerTransformerResidual Learning

    NeraTech LLC

  10. Low-dimensional topology of deep neural networks

    Jun 30, 2026Junyu Ren, Lek-Heng LimTransformerFeedforward Neural Networks

    University of Chicago, Chicago, IL, USA.

  11. Explicit Fuzzy Logic in the Feed-Forward Layer: Self-Forgetting Quantifiers Discover Legible Grammatical-Licensing Detectors

    Jun 30, 2026Mark OskinTransformer InterpretabilityTransformer FFNs

    School of Computer Science and Engineering University of Washington

  12. Mixture-of-Control: State-Aware Fine-Tuning for Transformer-based Models

    Jun 30, 2026Duc Anh Nguyen, Tien Ngoc Luu, Tung Pham +1Fine-TuningTransformer

    Qualcomm AI Research

  13. Dualformer: Efficient Feature Extractor for Complex-valued Blind Communication Signal Analysis

    Jun 30, 2026Yurui Zhao, Xiang Wang, Jingreng Lei +3TransformerAutomatic Modulation Classification

    College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China. · Department of Electrical and Computer Engineering, The University of Hong Kong

  14. Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planet

    Jun 30, 2026Zeyuan Hu, Akshay Subramaniam, Noel Keen +9AI for ScienceTransformer

    NVIDIA · LBNL · PNNL +1

  15. Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation

    Jun 30, 2026Jiachun Li, David Simchi-LeviCausal Effect EstimationTransformer

    Laboratory for Information and Decision Systems, MIT

  16. Transformer Architectures as Complete Bayes Processes: A Formal Proof in the Measure-Theoretic Kernel Framework

    Jun 29, 2026Haobo YangTransformerBayesian Inference

    Department of Computer Science and Engineering, SUSTech University

  17. Transformer-Based Active Learning for Data-Efficient Vaccine Epitope Selection in PRRS

    Jun 27, 2026Aspen Erlandsson Brisebois, Zahed Khatooni, Connor Burbridge +5TransformerActive Learning

    Vaccine and Infectious Disease Organization (VIDO), University of Saskatchewan, Saskatoon, SK, Canada · Engineering Science, Faculty of Applied Science, University of Toronto, Toronto, ON, Canada · Department of Mathematics and Statistics, University of Saskatchewan, Saskatoon, SK, Canada +4

  18. Legal Domain Adaptation of Modern BERT Models

    Jun 26, 2026Dominik Stammbach, Peter HendersonLegal NLPTransformer

    Princeton University Princeton, New Jersey, USA

  19. Multi-Modal Conditioned High-Resolution Transformer for Urban Electromagnetic Field Map Prediction Download PDF

    Jun 26, 2026Do-Eon Kim, Dongryul Park, Seungyoung Ahn +3TransformerWireless Communications

    Soongsil University, Seoul 06978, Republic of Korea · Cho Chun Shik Graduate School of Mobility, Korea Advanced Institute of Science and Technology, Daejeon 34051, Republic of Korea · Department of Intelligent Semiconductors, Soongsil University, Seoul 06978, Republic of Korea

  20. TruEye: Fine-Grained Detection of AI-Generated Human Subjects in Images

    Jun 25, 2026Jay Barot, Dan LinTransformerImage Forgery Localization

    Vanderbilt University, Nashville TN, USA

  21. Transformer-Based Classification of Bacterial Raman Spectra with LOOCV

    Jun 25, 2026Jamile Mohammad Jafari, Thomas BocklitzTransformerRaman Spectroscopy

    Institute of Physical Chemistry (IPC) and Abbe Center of Photonics (ACP), Friedrich Schiller University Jena, Member of the Leibniz Centre for Photonics in Infection Research (LPI), Helmholtzweg 4, 07743, Jena, Germany

  22. SubdivAR: Autoregressive Next-Scale Prediction for Neural Mesh Subdivision

    Jun 25, 2026Huipeng Guo, Zikai Song, Hang Long +73D Mesh GenerationNeural Representation Geometry

    Huazhong University of Science and Technology

  23. CascadeFormer: Depth-Tapered Transformers Motivated by Gradient Fan-in Asymmetry

    Jun 25, 2026Huzama Ahmad, Cao Viet Hai Nam, Se-Young YunEfficient Transformer InferenceTransformer

    KAIST

  24. Matilda: Engine-Agnostic Search with Human Policy Guidance

    Jun 23, 2026Jason CarlsonGame-Playing AgentsTransformer

  25. An iterative energy-based multimodal transformer for joint retrieval of wheat soil moisture, leaf area index, and plant height from Sentinel-1 and Sentinel-2 time series

    Jun 23, 2026Shubham Kumar Singh, Peilei Fan, Suraj A. Yadav +2Agricultural Remote SensingTransformer

    Department of Urban and Environmental Policy and Program, Tufts University, 503 Boston Ave., Medford, MA 02155 · Electrical and Computer Engineering Department, Mississippi State University, Mississippi, USA, 39762 · Department of Physics, Indian Institute of Technology (BHU), Varanasi, India 221005 +1

  26. Multi-Stream Temporal Fusion for Financial Fraud Detection

    Jun 23, 2026Mohammadamin Dashti Moghaddam, Nick SciarrilliTransformerFinancial Fraud Detection

    Amazon Web Services

  27. Towards Scalable Multi-Task Reinforcement Learning with Large Decision Models

    Jun 23, 2026Thibaut KulakReinforcement LearningTransformer

    NeoInstinct SA

  28. Transformer-Based Language Models Across Domain Verticals: Architectures, Applications and Critical Assessment

    Jun 23, 2026Guruprakash J, Krithika L. BLLM EvaluationLLM Alignment

    SCOPE, VIT-AP University, Amaravathi, Andhra Pradesh, 522241, India · SCORE, VIT, Katpadi, Tamil Nadu, 632014, India

  29. Learning the Koopman Operator using Attention Free Transformers

    Jun 22, 2026Mohammed Nagdi, Evangelos-Marios Nikolados, Alexey Yermakov +3Long-Term Time Series ForecastingKoopman Operator Learning

    Institute for Bioengineering, School of Engineering and Centre for Engineering Biology, University of Edinburgh, Edinburgh, United Kingdom · Electrical and Computer Engineering and Applied Mathematics, University of Washington, Seattle, WA, USA · Electrical and Computer Engineering and Computer Science & Engineering, University of Washington, Seattle, WA, USA

  30. Scaling Linear Mode Connectivity and Merging to Billion Parameter Pretrained Transformers

    Jun 22, 2026Tianyi Li, Zhiqiang ShenTransformerLanguage Model Merging

    MBZUAI