Dynamic Attention

Ask about this topic

Momentum

6 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 38

All topics
CardsList

  1. From Rules to Neural Graphs: Scalable Structured Prediction for Patent Prior Art Search

    Oct 1, 2026Nikolai Zenovkin, Sebastian BjörkqvistPatentGraph-Based Retrieval

    IPRally Technologies Oy, Helsinki, Finland

  2. Sequential Functional Structured Tucker Compression for Large Language Model Attentions

    Sep 30, 2026Jiangfeng Chen, Xinyu Wang, Tianshuo Yan +4Large Language Model CompressionTask-Aware Compression

    University of Manitoba · McGill University · Simpleway +2

  3. Attention Function as an Intrinsic Inductive Bias: How Models' Behavior Diverges in Novel Contexts

    Sep 30, 2026Dong Gyun Kang, Megha Thukral, Kwangsoo KimTransformer AttentionDynamic Attention

    College of Computing, Georgia Institute of Technology · Department of Transdisciplinary Medicine, Seoul National University Hospital

  4. Similar Choices, Different Attention: Cross-Modal Associations in Humans and Vision-Language Models

    Sep 29, 2026Sumin Hong, Katsumi Ibaraki, Renee Shi +2Cross-ModalDynamic Attention

    University of Notre Dame

  5. Mind the RefGAP: Correcting Reference Attention in Diffusion-Based Visual Editing

    Sep 28, 2026Yanan Wang, Shengcai Liao, Guangyi Liu +1Diffusion-Based Image EditingScale Gap

    Mohamed bin Zayed University of Artificial Intelligence · Institute of Foundation Models · United Arab Emirates University

  6. From Attention Sensitivity to Layer Role: Revisiting Mixed-Precision Quantization of Transformers

    Sep 28, 2026Nafiseh HosseinpourFardi, Negar Alihadi, Mahmoudreza Babaei +2Post-Training QuantizationMixed-Precision Quantization

    Sharif University of Technology, Tehran, Iran · GISMA University of Applied Sciences, Potsdam, Germany · BRAINS, Brandenburg Research Center for Applied Intelligent Systems, Potsdam, Germany +3

  7. WorldAttention: An Efficient Attention Architecture for Interactive Video World Models

    Sep 28, 2026Zeyu Zhang, Jinyuan Mao, Dakai An +6Video World ModelsDynamic Sparse Attention

    DAMO Academy, Alibaba Group · Zhejiang University · Hong Kong University of Science and Technology +2

  8. BridgeMem: Causal Dyadic Transition Residuals for Temporal Knowledge Graph Forecasting

    Sep 24, 2026Zeyan Li, Libing Chen, Shengda Zhuo +2Temporal Knowledge GraphsGraph-Structured Memories

    Shanghai Jiao Tong University · University of Chicago · Jinan University

  9. On-Demand Attention: Language Models Know When to Recall

    Sep 17, 2026Haibo Feng, Ruiqi Liang, Hanyang Peng +1Efficient Long-Context InferenceDynamic Attention

    Southern University of Science and Technology · Peking University · Peng Cheng Laboratory

  10. How Calibration Content Shapes Attention-Based Reranking

    Sep 15, 2026Petros Karypis, Hossein Rajaby Faghihi, Peter Chen +4Cross-Encoder RerankingRelevance

    UC San Diego · Google · Google DeepMind

  11. Attention Quantization for Tabular Foundation Models

    Sep 14, 2026Jonas M. Kübler, Benjamin Jäger, Klemens Flöge +2Tabular Foundation ModelsKey-Value Cache Quantization

    Prior Labs

  12. DeepTable: Structural Attention Biases and Tree Path Encoding for Hierarchical Table Understanding

    Sep 7, 2026Jyun-Ying Yen, Cheng-Kuan Lin, Yu-Chee TsengTabular DataDynamic Attention

    Department of Computer Science National Yang Ming Chiao Tung University, Taiwan

  13. Text Capability Loss in Vision-Language Adaptation: An Attention-Sink Diagnosis

    Sep 1, 2026Minsik Choi, Geewook Kim, Young Geun KimVision-Language Model AdaptationDynamic Attention

    Korea University · NAVER Cloud AI

  14. FLARE++: Low-rank attention with dynamic attention routing

    Aug 12, 2026Vedant Puri, Yongjie Jessica Zhang, Levent Burak KaraDynamic Attention

    Department of Mechanical Engineering Carnegie Mellon University Pittsburgh, Pennsylvania, USA

  15. ConceptADapt: Concept-guided Adaptive Feature Reconstruction with Dynamic Attention for Few-Shot Industrial Anomaly Detection

    Aug 6, 2026Yufei Li, Yicheng Ruan, Long Tian +2Dynamic Attention

    School of Computer Science and Technology, Xidian University, Xi’an, China

  16. Learning to Generate Multiple Objects from Dense and Occluded Layouts

    Jul 3, 2026Bach-Hoang Ngo, Si-Tri Ngo, Hieu Le +1Diverse Occlusion-And-Revelation ScenariosScene Reasoning

    University of Science, Ho Chi Minh City, Vietnam · 2Vietnam National University, Ho Chi Minh City, Vietnam · 3UNC Charlotte, North Carolina, United States

  17. Timage: A Generative Text-in-Image Paradigm for Fine-Tuning Vision-Language Models

    Jun 18, 2026Yifeng Wu, Huimin Huang, Ruiluo Wu +5Recent Vision-Language ModelsText-To-Image

    Fudan University · Shenzhen University of Advanced Technology · Tencent Jarvis Lab +1

  18. Mixtures of Subspaces for Bandwidth Efficient Context Parallel Training

    Jun 15, 2026Sameera Ramasinghe, Ajanthan Thalaiyasingam, Hadi Mohaghegh Dolatabadi +5Large Language Model CompressionEfficient Long-Context Inference

    Pluralis Research

  19. Communication-Efficient Verifiable Attention for LLM Inference

    Jun 15, 2026Ziqun Chen, Ming Wu, Michael Heinrich +4LLM Inference OptimizationNvidia

    Nanyang Technological University · Singapore · Zero Gravity Labs +1

  20. Rethinking the Role of Efficient Attention in Hybrid Architectures

    Jun 13, 2026Ziqing Qiao, Yinuo Xu, Chaojun Xiao +6Efficient Long-Context InferenceDynamic Attention

    1Tsinghua University · 2OpenBMB

  21. HorusEye: Language as Dynamic Attention for Emergency Visual Analysis

    Jun 2, 2026Armel YaraDynamic AttentionDouble-Edged Sword

  22. Functional Attention: From Pairwise Affinities to Functional Correspondences

    May 29, 2026Jiefang Xiao, Maolin Gao, Simon Weber +2Transformer AttentionDynamic Attention

    Technical University of Munich, Germany · Munich Center for Machine Learning (MCML), Germany · PIXL, Department of Computer Science, University of Oxford, United Kingdom +1

  23. Generic Interpretation Approach for Transformer Models Incorporating Heterogenous Attention Structures

    May 25, 2026Yongjin Cui, Xiaohui Fan, Huajun ChenTransformer AttentionTransformer Architectures

    Zhejiang University

  24. Approaching I/O-optimality for Approximate Attention

    May 22, 2026Pál András Papp, Aleksandros Sobczyk, Anastasios ZouziasKimi Delta AttentionMatrix Multiplication

    Computing Systems Lab, Huawei Technologies, Zurich, Switzerland

  25. Runtime-Certified Bounded-Error Quantized Attention

    May 20, 2026Dean CalverKey-Value Cache QuantizationMatched Fp16 Intermediate

    Independent Researcher

  26. Most Transformer Modifications Still Do Not Transfer at 1-3B: A 2020-2026 Update to Narang et al. (2021) with Downstream Evaluation and a Noise Floor

    May 20, 2026Yang Zhao, Jiahao Lu, Bin Huang +2Transformer ArchitecturesDynamic Attention

    Tencent

  27. FlexDraft: Flexible Speculative Decoding via Attention Tuning and Bonus-Guided Calibration

    May 19, 2026Yaojie Zhang, Jianuo Huang, Junlong Ke +5Speculative DecodingBlock-Diffusion Drafter

    EPIC Lab, SJTU · School of Software Engineering, HUST · UESTC +3

  28. CompactAttention: Accelerating Chunked Prefill with Block-Union KV Selection

    May 16, 2026Jiwon Song, Dongwon Jo, Beomseok Kang +1PrefillLinear Attention

    Seoul National University

  29. Representative Attention For Vision Transformers

    May 14, 2026Yuntong Li, Hainuo Wang, Hengxing Liu +2Self-Supervised Vision TransformersVision Transformer

    College of Intelligence and Computing, Tianjin University, Tianjin 300350, China

  30. TurboVGGT: Fast Visual Geometry Reconstruction with Adaptive Alternating Attention

    May 14, 2026David Huang, Guile Wu, Chengjie Huang +2Visual Geometry Grounded Transformer3D Reconstruction

    Huawei Noah’s Ark Lab · University of Toronto · Foundation Model Department, Huawei

  31. Stable Attention Response for Reliable Precipitation Nowcasting

    May 13, 2026Penghui Wen, Zexin Hu, Sen Zhang +6Precipitation NowcastingAtmospheric Dynamics

    School of Computer Science, The University of Sydney Australia · Independent Researcher Australia · School of Life and Environmental Science, The University of Sydney Australia +3

  32. Simply Stabilizing the Loop via Fully Looped Transformer

    May 11, 2026Rao Fu, Zixuan Yang, Jiankun Zhang +4Transformer ArchitecturesLoop

    Hong Kong Baptist University · Jilin University

  33. DAPE: Dynamic Non-uniform Alignment and Progressive Detail Enhancement Techniques for Improving the Performance of Efficient Visual Language Models

    May 9, 2026Mengyuan Tian, Qiyan Zhao, Yanan Wang +1Cross-Modal AlignmentRecent Vision-Language Models

    The Wang Yanan Institute for Studies in Economics, Xiamen University, Xiamen 361005, China · Fujian Key Laboratory of Pattern Recognition and Image Understanding, School of Computer and Information Engineering, Xiamen University of Technology, Xiamen 361024, China

  34. MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonality

    May 7, 2026Panqi Yang, Haodong Jing, Jiahao Chao +5Visual TokenizersSelf-Supervised Vision Transformers

    State Key Laboratory of Human-Machine Hybrid Augmented Intelligence,National Engineering Research Center of Visual Information and Applications,and Institute of Artificial Intelligence and Robotics, Xi’an Jiao Tong University · Xiaohongshu Inc.

  35. The Structural Attention Tax: How Retrieval Format Hijacks In-Context Learning Independent of Content

    Apr 21, 2026Yuqi Zhang, Di ZhangDynamic AttentionKnowledge Graphs

    Xi’an Jiaotong-Liverpool University

  36. Efficient Video Diffusion Models: Advancements and Challenges

    Apr 17, 2026Shitong Shao, Lichen Bai, Pengfei Wan +2Video Diffusion ModelsDiffusion Models

    The Hong Kong University of Science and Technology (Guangzhou), China · Kling Team, Kuaishou Technology, China · The Hong Kong University of Science and Technology, Hong Kong

  37. Improving Sparse Autoencoder with Dynamic Attention

    Apr 16, 2026Dongsheng Wang, Jinsen Zhang, Dawei Su +1Improving Sparse AutoencodersDynamic Sparse Attention

    College of Computer Science and Software Engineering, Shenzhen University, China

  38. Accelerating Attention with Basis Decomposition

    Oct 2, 2025Jialin ZhaoDynamic AttentionDeepseek

    Department of Computer Science Tsinghua University