Sparsity

Ask about this topic

Momentum

38 papers in the last four weeks, up 245% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 222

All topics
CardsList

  1. SparseCraft: Agentic Hardware-Software Co-Optimization for Sparse Computing

    Oct 4, 2026Rajatabha Chakraborty, M P Samartha, Vedant Pahariya +1Sparsity

    International Institute of Information Technology, Hyderabad, India

  2. TopK-Guided: Adaptive, Budget-Aware Activation Sparsity for Efficient LLM Inference

    Oct 1, 2026Mukund Agarwalla, Chih-Jen LinLLM Inference OptimizationSparsity

    MBZUAI · National Taiwan University

  3. Polylogarithmic Sparsity of Randomly Reweighted NPMLEs for Gaussian Mixtures

    Oct 1, 2026Hansheng JiangMaximum LikelihoodGaussian Mixture Models

    University of Toronto

  4. Scaling Laws for Looped Mixture of Experts

    Sep 30, 2026Yanbei Chen, Anirudh Goyal, Raghuraman KrishnamoorthiMixture-Of-ExpertsScaling Laws

    Meta AI

  5. Importance-Aware Feature Sparsification for Wireless Split Learning

    Sep 30, 2026Bumjun Kim, Yoon Huh, Wan ChoiSparsityBalanced Learning

    Department of Electrical and Computer Engineering, Seoul National University (SNU), and the Institute of New Media and Communications, SNU, Seoul 08826, Korea

  6. SparLeak: Privacy Leakage from Sparse Attention in LLM Inference on Shared GPUs

    Sep 30, 2026Fahao Chen, Linkang Du, Jinhao Zhou +2Dynamic Sparse AttentionLLM Inference Optimization

    Shandong University China · Xi’an Jiaotong University China · Waseda University Japan

  7. Robust LassoNet: Enhancing Feature Selection in Neural Networks via Robust Loss Functions

    Sep 29, 2026Daniela De Canditiis, Italia De Feis, Paola StolfiFeature SelectionLoss Function

    Istituto per le Applicazioni del Calcolo “Mauro Picone”, Consiglio Nazionale delle Ricerche, Via dei Taurini, 19, Roma, 00185, Italia · Istituto per le Applicazioni del Calcolo “Mauro Picone”, Consiglio Nazionale delle Ricerche, Via Pietro Castellino, 111, Napoli, 80131, Italia

  8. Inspection-SPARS: Task-Oriented Sparse Roadmaps for Inspection Planning

    Sep 28, 2026Adir Morgan, Oren Salzman, Kiril SoloveyPath PlanningCollision-Free Trajectories

    The authors are with the Technion–Israel Institute of Technology, Haifa, Israel.

  9. Privacy-Preserving Full-Body Meshing from mmWave Radar via Mesh Foundation Model Supervision

    Sep 28, 2026Shuxing Zhang, Yongquan Ni, Zhenyu Ding +1Human Mesh RecoveryRadar

    AI Value Center, Incaier (Haier), Qingdao, China

  10. CASS: Contribution-Aware Structured Sparsity for Model Merging

    Sep 28, 2026Yan Li, Guiping Cao, Meng Xu +5Continual Model MergingSoft-Token Representations

    Pengcheng Laboratory, Shenzhen, China · City University of Hong Kong, Hong Kong, China · Southern University of Science and Technology, Shenzhen, China +2

  11. GroupMask: Layer-Adaptive Group-wise Sparsity for Semi-Structured LLM Pruning

    Sep 27, 2026Zhengao Li, Shuoqiu Li, Xiaofang Zhang +7Unstructured PruningLarge Language Model Compression

    Florida State University · University of Connecticut · College of William & Mary +1

  12. SymNetPro: LOS-Aware Directional Multi-Transmitter Localization from Sparse Radio Observations

    Sep 27, 2026Lyuzhou Ye, Heng Fan, Yan HuangRadio Map EstimationIndoor Localization

    University of North Texas Denton, Texas, USA

  13. Where Activation Sparsity and KV-Cache Sparsity Cross in LLM Decoding

    Sep 27, 2026Jungseob Lee, Seungyoon Lee, Seongtae Hong +2Dynamic Sparse AttentionLarge Language Model Decoding

    Korea University · Yonsei University Mirae Campus

  14. Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selection

    Sep 27, 2026Jia CaiGaussian ProcessSparsity

    Department of Statistics, George Mason University, Fairfax, Virginia/USA

  15. StarBOA: Real-Time Mamba State-Space Unrolling for Sparse Radar Micro-Doppler in ISAC Networks

    Sep 27, 2026Mustafa Bora Çelik, Ceren Çelik, Orhan GaziIntegrated Sensing And CommunicationRadar

  16. Towards Identifiable Representations under Misspecified Structure

    Sep 27, 2026Yuke Li, Yujia Zheng, Ziyi Chen +2IdentifiabilityLatent Variable

    University of Maryland College Park, College Park, MD, USA · Carnegie Mellon University, Pittsburgh PA, USA

  17. LLM Judge Validation Under Sparse Overlap: From Inference to Design

    Sep 25, 2026Junxuan Li, Arko Mukherjee, Soumyabrata PalLarge Language Model JudgesToken Budget Allocation

    Adobe · Adobe Research

  18. Graph Learning with Spectral Connectivity Priors for Scarce Data

    Sep 23, 2026Mingxiao Liu, Bahar Oveisgharan, Bingyan Zou +3Graph Edge SparsificationGraph Laplacians

    Tsinghua University, China · York University, Canada

  19. On Basis Function Selection for Sparse Gaussian Process Regression

    Sep 22, 2026Marnix Van Soom, Ivan De BoiGaussian ProcessBasis Functions

    AI Lab Vrije Universiteit Brussel · InViLab University of Antwerp

  20. GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compression

    Sep 22, 2026Baher Mohammad, Ammar Ali, Stamatios LefkimmiatisTransformer ArchitecturesCross-Layer Interactions

    MWS AI, ITMO University · MWS AI

  21. SPARSER: Sparse Variable Projection by Exploiting Separable Structure in Robotic Perception

    Sep 21, 2026Nikolas R. Sanderson, Andrew Fishberg, Haoyu Han +5Robotic PerceptionSimultaneous Localization And Mapping

    Department of Naval Architecture and Marine Engineering, University of Michigan, Ann Arbor, MI, USA · Institute of Experiential Robotics, Northeastern University, Boston, MA, USA · Aerospace Controls Lab, Massachusetts Institute of Technology, Cambridge, MA, USA +1

  22. Taking a Second Look: Correcting Sea Ice Forecasts with Sparse Observations

    Sep 21, 2026Tianshuo Zhang, Xianglei Xing, Aowen Yang +4Sea-Surface Temperature DataForecast

    College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin 150001, China

  23. Dual-GNN Multilevel Coarsening for Maximum Independent Set

    Sep 21, 2026Tianfeng Chen, Xianyue LiSalesman ProblemGraph Edge Sparsification

    School of Mathematics and Statistics Lanzhou University

  24. Confidence-Aware Teacher-Student Distillation for 3D Medical Segmentation

    Sep 20, 2026Georgios Triantafyllou, Dimitris K. Iakovidis3D Medical Image SegmentationTeacher-Student Distillation

    Department of Computer Science and Biomedical Informatics, University of Thessaly, 2-4 Papasiopoulou st. 35131, Lamia, Greece

  25. Local Sparsity Enables Unsupervised LLM Safety Detection

    Sep 17, 2026Xin Chen, Gil Kur, Alexander Shevchenko +1Large Language Model SafetySparsity

    ETH Zürich

  26. FCA-Guided Counterfactual Explanations for Multi-Modal Breast Cancer Diagnosis: A Framework Achieving Perfect Validity with Emergent Sparsity

    Sep 17, 2026Abdullahi Isa, Souley Boukari, Muhammad AliyuCancer DetectionCounterfactual Explanation

    Department of Computer Science, Faculty of Computing, Abubakar Tafawa Balewa University, Bauchi, Nigeria.

  27. Understanding and Exploiting Diagonal Attention Sparsity in Autoregressive Image Generation

    Sep 17, 2026Daeun Kim, Junwha Hong, Changhun Oh +3Autoregressive Image GenerationDynamic Sparse Attention

    KAIST · Agency for Defense Development · Seoul National University

  28. Training-Adaptive Convolutional Sparse Coding via Information Bottleneck for Robust Visual Representation

    Sep 16, 2026Meng'en Qin, Yinchen Liu, Mingxuan Cui +1Information BottleneckSparsity

    Faculty of Computer Science and Artificial Intelligence, Shenzhen University of Advanced Technology, Shenzhen, China · School of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu, China · School of Mathematics, Shandong University, Jinan, China

  29. Probabilistic Linear Explanations

    Sep 16, 2026Frederic Koriche, Jean-Marie Lagniez, Chi TranExplainabilityExplainable AI Methods

    Computer science Research Institute of Lens (CRIL), UMR CNRS 8188, University of Artois, Rue Jean Souvraz SP 18, Lens, F-62307, France

  30. CLARE: Scalable Class-Incremental Continual Learning via a Sparsity-Based Framework

    Sep 15, 2026Yunxiang Fu, Meng Lou, Zicheng Liao +1Replay-Based Continual LearningClass-Incremental Learning

    School of Computing and Data Science, The University of Hong Kong · Hong Kong Generative AI Research and Development Center

  31. SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking

    Sep 14, 2026Zhiwei Li, Lei Zhu, Hao Gu +6Dynamic Sparse AttentionBlock Sparse Flash Attention

    Tencent HY LLM Frontier · Hong Kong University of Science and Technology (Guangzhou) · Hong Kong University of Science and Technology

  32. Sparsity Regularized and Robust Mean Variance Portfolio Selection Under Ellipsoidal Uncertainty

    Sep 11, 2026Deniz Akkaya, Emre Can Yayla, Buse Şen +1Portfolio OptimizationSparsity

    Department of Industrial Engineering, Bilkent University, Ankara, Türkiye · Risk Analytics and Optimization Chair, EPFL, Lausanne, Switzerland

  33. Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data

    Sep 10, 2026Atindra Jha, Margaret Li, Jure Leskovec +2Mixture-Of-ExpertsOverfitting

    Stanford University · Paul G. Allen School of Computer Science, University of Washington

  34. Nearly Tight Rademacher Bounds for Sparsely Activated Neural Networks

    Sep 8, 2026Xiaoyu Li, Zhizhou Sha, Jiaojiao Jiang +2Rectified Linear Unit NetworksConcentration Bounds

    University of New South Wales · University of Texas at Austin · University of Sydney

  35. High-Magnetization Sampling at Low Temperatures: Ising Models and Bayesian Sparse Linear Regression

    Sep 8, 2026Syamantak Kumar, Purnamrita Sarkar, Kevin Tian +1Spatial Photonic Ising MachinesMarkovian Sampling

    University of Texas at Austin

  36. Hyperparameter Scaling Laws Across MoE Sparsity

    Sep 8, 2026Changxin Tian, Kunlong Chen, Jia Liu +3HyperparameterMixture-Of-Experts Architectures

    Ling Team, Ant Group

  37. Hyperspectral Anomaly Detection via Group Sparse Low-Rank Tensor Factorization With Automatic Anomaly Grouping

    Sep 8, 2026Quan Yu, Yu-Hong Dai, Xiongjun ZhangHyperspectral ImageGraph Anomaly Detection

    School of Mathematics and Statistics, Central China Normal University, Wuhan 430079, China, and also with the Key Laboratory of Nonlinear Analysis and Applications (Ministry of Education), Central China Normal University · State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, China, and also with the School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing 100049, China

  38. Understanding the Impact of Model Pruning on Long-Tail Forgetting and Explanation Reliability in Medical Imaging

    Sep 7, 2026Nazish Khalid, Tausifa Jan Saleem, Amal Saqib +2ExplainabilityMedical Imaging Datasets

    Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, MO 65409 USA · Computing and Mathematical Sciences Division, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates

  39. Learning Sparse Decision Trees via Transformer Variational Auto-Encoders

    Sep 1, 2026Giacomo Fidone, Alessio Cascione, Riccardo GuidottiDecision TreesSparsity

    University of Pisa · ISTI-CNR

  40. Faster Than Flash: Exploiting Attention Sparsity for Efficient Long-Context Decoding

    Aug 31, 2026Zhigeng Liu, Zhiyuan Ning, Ruixiao Li +5Efficient Long-Context InferenceLarge Language Model Decoding

    Fudan University, Shanghai, China · Shanghai Innovation Institute, Shanghai, China · Harbin Institute of Technology, Harbin, China

  41. Exact Recovery Thresholds for Weighted Data Selection in Vector-Valued Linear Regression

    Aug 31, 2026Guangjian ZhangAlignment-Aware SelectionSpectral Norm

  42. Selection, Representation, and Execution in Sparse Fourier Neural Operators

    Aug 30, 2026Abdul Qadir Ibrahim, Martin BurgerFourier Neural OperatorsSparsity

    Deutsches Elektronen-Synchrotron DESY, Notkestraße 85, 22607 Hamburg, Germany

  43. Towards an Expressivity-Normalized Energy-Demand Comparison of ANNs and SNNs

    Aug 30, 2026Miriam Kranzlmüller, Pascal Esser, Gitta KutyniokSpiking Neural NetworksNeural Network

    Department of Mathematics LMU Munich, Germany · *Munich Center for Machine Learning (MCML) · †Department of Physics and Technology, University of Tromsø, Norway, DLR-German Aerospace Center, Germany

  44. Low-Latency Activation-Regularized Sparse Neural Operators with Distillation Assistance Towards Real-Time Neuromorphic Virtual Sensing

    Aug 25, 2026William Howes, Farid Ahmed, Syed Bahauddin AlamNeuromorphic ComputingBrain-Inspired Synergistic Framework

    Grainger College of Engineering, Nuclear, Plasma & Radiological Engineering Department, University of Illinois Urbana-Champaign, Urbana, IL, USA · National Center for Supercomputing Applications, Urbana, IL, USA

  45. Algorithmic Information Dynamics of Learning: A Certified, Differentiable Complexity Controller for Grokking

    Aug 14, 2026Luan Ozelim, Abicumaran Uthamacumaran, Hector ZenilLearning DynamicsGradient-Based Optimization

    Oxford Immune Algorithmics, Oxford University Innovation & London Institute for Healthcare Engineering, U.K · Department of Biomedical Computing, School of Biomedical Engineering and Imaging Sciences & King’s Institute for AI, King’s College London, U.K

  46. CABS+: Efficient and Scalable Model Merging via Conflict-Aware Sparsification and Adaptive Weight Allocation

    Aug 13, 2026Yuchen Liu, Zongzhen Yang, Binhang Qi +2Continual Model MergingMulti--Task Learning

    State Key Laboratory of Complex & Critical Software Environment (CCSE), Beihang University, Beijing, China · Hangzhou Innovation Institute of Beihang University, Hangzhou, China · National University of Singapore, Singapore

  47. LoSA: Near-Lossless Sparse Attention for Training-Free Video Diffusion Acceleration

    Aug 12, 2026Enhuai Liu, Yunke Wang, Yutong Wang +2Dynamic Sparse AttentionSpatio-Temporal Attention

    1The University of Sydney · 2CSIRO

  48. Compute-Optimal Is Not Cluster-Optimal: Systems-Aware Scaling for Sparse Mixture-of-Experts

    Aug 11, 2026Soumajyoti Sarkar, Yuxin Tang, Sheng ZhaMixture-Of-Experts ArchitecturesSparsity

    Amazon AGI Foundations

  49. Improving TensorSketch Using Complex Random Variables

    Aug 11, 2026Amit Sharma, Mohammad Azhar Khan, Rameshwar Pratap +1Optimal Sample ComplexityKernel Method

    Department of Computer Science and Engineering, IIT Hyderabad, India · Department of Mathematics and Statistics, Bucknell University, USA

  50. Domain-Aware Pruning: Sparsity and Domain Generalization via Regularized Probabilistic Masking

    Aug 9, 2026Parham Sazdar, Mostafa Tavassolipour, Reshad HosseiniMultimodal Domain GeneralizationSparsity

    Department of Electrical and Computer Engineering, University of Tehran, Tehran, Iran

  51. Prune Once: Retraining-Free Task-Agnostic Pruning for Vision-Language Models

    Aug 7, 2026Minseok Kang, Hyunwoo Kim, Chanyoung Kim +3Visual Token PruningLarge Language Model Compression

    Department of Artificial Intelligence, Chung-Ang University, Seoul, Korea · School of Computer Science and Engineering, Soongsil University, Seoul, Korea · Department of Computer Science, Kookmin University, Seoul, Korea

  52. Explore or Converge? Stage-Guided Per-Step Optimization for Diffusion Models

    Aug 7, 2026Renye Yan, Jikang Cheng, You Wu +4Diffusion ModelsPreference Alignment

    Peking University Beijing, China · Stanford University Stanford, California, USA

  53. The Sparsity Whisperer

    Aug 6, 2026Linghao Kong, Inimai Subramanian, Micah Adler +3SparsityStructured Pruning

    MIT · IST Austria · IBM +1

  54. Reward Structure Shapes the Interaction Between Episodic Exploration and Neural Memory in Reinforcement Learning

    Aug 5, 2026Jai Malegaonkar, Rohan Patil, Henrik I. ChristensenStochastic ExplorationSparsity

    Department of Computer Science and Engineering, UC San Diego, United States

  55. SparseDitto: An Agentic Sparse Compilation Framework through Architecture-Aware Synthesis on GPUs

    Aug 5, 2026Shiyang Li, Guangyan Sun, Jinwei Tang +3Graphics Processing Unit KernelsCuda

    University of Minnesota Minneapolis, MN, USA · Northeastern University Boston, MA, USA

  56. Evaluation Pitfalls and Sparsity Limitations in LLM-based Confidence Estimates for Classification

    Aug 5, 2026Elena Merdjanovska, Omar Zaidan, Andreas RückléConfidence EstimationVerbalization

    Humboldt-Universität zu Berlin Science of Intelligence · Amazon

  57. Deltoris: Enabling Real-time VLA Inference in Embodied AI via Bit-level Sparsity and Speculative Inference

    Aug 5, 2026Zheng Liu, Zeyu Guo, Zihan Liu +9Diffusion-Based Vision-Language-ActionsEmbodied Artificial Intelligence

    Shanghai Jiao Tong University Shanghai, China · Shanghai Jiao Tong University, Shanghai Qi Zhi Institute Shanghai, China · ICT, Chinese Academy of Sciences Beijing, China

  58. LaPrune: Controllable Differentiable Sparsity at Million Scale

    Aug 4, 2026Jakub Antczak, Joanna Wojciechowicz, Łukasz Struski +1SparsityDifferentiable Optimization

    Wrocław University of Science and Technology, Wrocław, Poland · Faculty of Mathematics and Computer Science, Jagiellonian University, Kraków, Poland

  59. SPADE: An Input-Adaptive Sparse Attention Engine for Fast Video Diffusion Models Inference

    Aug 4, 2026Shanghao Liu, Renze Chen, Size Zheng +4Dynamic Sparse AttentionSparsity

    Eric · Beihang University · Peking University

  60. Understanding Sparse Attention Selectivity in Long-Context Foundation Models via Counterfactual Evaluation

    Aug 3, 2026Xingyu Ren, Youran Sun, Chugang Yi +1Dynamic Sparse AttentionBlock Sparse Flash Attention

    The Chinese University of Hong Kong, Hong Kong, China · University of Maryland, College Park, MD, USA