Sparsity

Ask about this topic

Recent momentum

-38%

16 papers in the last 28 days · 0.4% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

9 new papers

A weekly snapshot of new work published in Sparsity.

Period ending 2026-09-07

4 new papers

A weekly snapshot of new work published in Sparsity.

198 papers

Latest in Sparsity

Open your feed →
CardsList

  1. Sparsity Regularized and Robust Mean Variance Portfolio Selection Under Ellipsoidal Uncertainty

    Sep 11, 2026Deniz Akkaya, Emre Can Yayla, Buse Şen +1Portfolio OptimizationSparsity

  2. Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data

    Sep 10, 2026Atindra Jha, Margaret Li, Jure Leskovec +2Cold Mixture-Of-Expert ModelsOverfitting

  3. SymbolicLight V2: Hybrid Neuromorphic Architecture and Sparse Execution for Low-Energy Language Inference

    Sep 9, 2026Ting LiuField-Programmable Gate ArraysNeuromorphic Hardware

  4. Nearly Tight Rademacher Bounds for Sparsely Activated Neural Networks

    Sep 8, 2026Xiaoyu Li, Zhizhou Sha, Jiaojiao Jiang +2Rectified Linear Unit NetworksConcentration Inequalities

  5. High-Magnetization Sampling at Low Temperatures: Ising Models and Bayesian Sparse Linear Regression

    Sep 8, 2026Syamantak Kumar, Purnamrita Sarkar, Kevin Tian +1Two-Dimensional Ising ModelSparse Observations

  6. Hyperparameter Scaling Laws Across MoE Sparsity

    Sep 8, 2026Changxin Tian, Kunlong Chen, Jia Liu +3Cold Mixture-Of-Expert ModelsHyperparameter

  7. Hyperspectral Anomaly Detection via Group Sparse Low-Rank Tensor Factorization With Automatic Anomaly Grouping

    Sep 8, 2026Quan Yu, Yu-Hong Dai, Xiongjun ZhangHyperspectral Image ClassificationHyperspectral Imaging

  8. Understanding the Impact of Model Pruning on Long-Tail Forgetting and Explanation Reliability in Medical Imaging

    Sep 7, 2026Nazish Khalid, Tausifa Jan Saleem, Amal Saqib +2Medical Imaging DatasetsSparsity

  9. Decomposition-Guided Diffusion Language Models for Inertial Confinement Fusion Prediction

    Sep 7, 2026Xiang Zhang, Varchas Gopalaswamy, Rahman Ejaz +2Diffusion Language ModelsSparsity

  10. Learning Sparse Decision Trees via Transformer Variational Auto-Encoders

    Sep 1, 2026Giacomo Fidone, Alessio Cascione, Riccardo GuidottiDecision TreesSparsity

  11. Residual Sparsification via Output Importance for Compressing Mixture-of-Experts LLMs

    Sep 1, 2026Seungwoo Jung, Dohyeok Kwon, Seungmin Cha +4Large Language Model CompressionSparsity

  12. Faster Than Flash: Exploiting Attention Sparsity for Efficient Long-Context Decoding

    Aug 31, 2026Zhigeng Liu, Zhiyuan Ning, Ruixiao Li +5Efficient Long-Context InferenceDynamic Sparse Attention

  13. Exact Recovery Thresholds for Weighted Data Selection in Vector-Valued Linear Regression

    Aug 31, 2026Guangjian ZhangEfficient Data SelectionRegression

  14. Selection, Representation, and Execution in Sparse Fourier Neural Operators

    Aug 30, 2026Abdul Qadir Ibrahim, Martin BurgerFourier Neural OperatorsSparsity

  15. Towards an Expressivity-Normalized Energy-Demand Comparison of ANNs and SNNs

    Aug 30, 2026Miriam Kranzlmüller, Pascal Esser, Gitta KutyniokSpiking Neural NetworksEnergy Based Models

  16. Feature Priming in Online Linear Regression: Sparse-Regret Lower Bounds and Tight Coordinatewise Rates

    Aug 18, 2026Huibo Xu, Shi Fu, Qixin Zhang +1Sublinear RegretLower Bounds

  17. CABS+: Efficient and Scalable Model Merging via Conflict-Aware Sparsification and Adaptive Weight Allocation

    Aug 13, 2026Yuchen Liu, Zongzhen Yang, Binhang Qi +2Continual Model MergingMulti--Task Learning

  18. LoSA: Near-Lossless Sparse Attention for Training-Free Video Diffusion Acceleration

    Aug 12, 2026Enhuai Liu, Yunke Wang, Yutong Wang +2Video Diffusion ModelsDynamic Sparse Attention

  19. Compute-Optimal Is Not Cluster-Optimal: Systems-Aware Scaling for Sparse Mixture-of-Experts

    Aug 11, 2026Soumajyoti Sarkar, Yuxin Tang, Sheng ZhaCold Mixture-Of-Expert ModelsSparsity

  20. Improving TensorSketch Using Complex Random Variables

    Aug 11, 2026Amit Sharma, Mohammad Azhar Khan, Rameshwar Pratap +1Optimal Sample ComplexityLabel Skew

  21. Domain-Aware Pruning: Sparsity and Domain Generalization via Regularized Probabilistic Masking

    Aug 9, 2026Parham Sazdar, Mostafa Tavassolipour, Reshad HosseiniMultimodal Domain GeneralizationMagnitude-Based Pruning

  22. Fast LapSum: Exact Differentiable Top-k at Million Scale

    Aug 7, 2026Łukasz Struski, Joanna Wojciechowicz, Jakub Antczak +3Top-KSparsity

  23. Prune Once: Retraining-Free Task-Agnostic Pruning for Vision-Language Models

    Aug 7, 2026Minseok Kang, Hyunwoo Kim, Chanyoung Kim +3Large Language Model CompressionSparsity

  24. Explore or Converge? Stage-Guided Per-Step Optimization for Diffusion Models

    Aug 7, 2026Renye Yan, Jikang Cheng, You Wu +4Diffusion ModelsPreference Alignment

  25. The Sparsity Whisperer

    Aug 6, 2026Linghao Kong, Inimai Subramanian, Micah Adler +3SparsityInference Cost

  26. Reward Structure Shapes the Interaction Between Episodic Exploration and Neural Memory in Reinforcement Learning

    Aug 5, 2026Jai Malegaonkar, Rohan Patil, Henrik I. ChristensenEfficient ExplorationStochastic Exploration

  27. SparseDitto: An Agentic Sparse Compilation Framework through Architecture-Aware Synthesis on GPUs

    Aug 5, 2026Shiyang Li, Guangyan Sun, Jinwei Tang +3Graphics Processing Unit KernelsSparsity

  28. Evaluation Pitfalls and Sparsity Limitations in LLM-based Confidence Estimates for Classification

    Aug 5, 2026Elena Merdjanovska, Omar Zaidan, Andreas RückléConfidence EstimationVerbalization

  29. EndoVLM: An Endoscopy Vision-Language Pre-training Model via Anatomy-Guided Sparsity and Progressive Alignment

    Aug 5, 2026Zhenyu Yi, Jianwei Xu, Yue Hu +6Colonoscopy3D Masked Autoencoders

  30. Deltoris: Enabling Real-time VLA Inference in Embodied AI via Bit-level Sparsity and Speculative Inference

    Aug 5, 2026Zheng Liu, Zeyu Guo, Zihan Liu +9Faster InferenceDiffusion-Based Vision-Language-Actions

  31. LaPrune: Controllable Differentiable Sparsity at Million Scale

    Aug 4, 2026Jakub Antczak, Joanna Wojciechowicz, Łukasz Struski +1SparsityTop-K

  32. SPADE: An Input-Adaptive Sparse Attention Engine for Fast Video Diffusion Models Inference

    Aug 4, 2026Shanghao Liu, Renze Chen, Size Zheng +4Video Diffusion ModelsDynamic Sparse Attention

  33. SparseKAN: Compressing Kolmogorov--Arnold Networks Across Basis Functions, Neurons, and Bits

    Aug 1, 2026Kazi Ahmed Asif Fuad, Lizhong ChenKolmogorov-Arnold NetworksConvolutional Neural Network Compression

  34. WIDE: Boosting Adaptive LLM Inference via Token-level Dynamic Width Pruning

    Jul 30, 2026Haozhe Hu, Hao Wu, Peiran Yin +3Magnitude-Based PruningLLM Inference Efficiency

  35. Information Bottleneck Learning for Faithful Time Series Forecasting Explanations

    Jul 30, 2026Xu Zheng, Wei Cheng, Zhuomin Chen +3Time Series ForecastingInformation Bottleneck

  36. Sparsity Induced Identifiability in Matrix Tri-Factorisation

    Jul 29, 2026Tingting MuCompact Matrix FactorizationSparsity

  37. Breaking the Curse with BAND: Nonparametric Distribution Estimation in High Dimensions

    Jul 29, 2026Shuo-Chieh Huang, Chien-Ming Chi, Jau-er ChenExponential FamilyBayesian Networks

  38. The Sparsity Ceiling: Where Spiking Networks Can and Cannot Trade Activity for Energy

    Jul 29, 2026Zeyu WangSpiking Neural NetworksNeuromorphic Hardware

  39. Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsification

    Jul 27, 2026Haopeng Li, Yitong Li, Junsong Chen +8Video Diffusion ModelsDynamic Sparse Attention

  40. Does Graph Compression Preserve Signal Propagation?

    Jul 25, 2026Kawshik Banerjee, Khaled Mohammed SaifuddinGraph LearningModel and Context Compression

  41. Graph-Based Correlation Matrix Generation: A Convex Optimization Approach

    Jul 24, 2026Ali Fakhar, K{é}vin Polisano, Ir{è}ne Gannaz +1Tensor CompletionExponential Random Graph Models

  42. Neural Feature Governance: Extending Atom Prevalence

    Jul 23, 2026Idris Karel Seunda Ekwe, Patrick Tenga Shako, Ernest Parfait FokouéBayesian Neural NetworksModel Interpretability Methods

  43. MIDiff: Tackling Sparsity and Imbalance in Mobile Usage Generation via Multivariate-Imaging Diffusion

    Jul 15, 2026Yilai Liu, Shiyuan Zhang, Hongyang DuGenerative ModelsCapture Protocol

  44. SpikeDS: Dual Sparsity Spikformer for Perineural Invasion Prediction in 3D MRI

    Jul 13, 2026Induk Um, Youngung Han, Kyeonghun Kim +14Binary SpikesSparsity

  45. Event-based Neural Decoding for Neuroprosthetic Motor Control

    Jul 13, 2026Khaleelulla Khan Nazeer, Sirine Arfa, Matthias Jobst +2LeggedSparsity

  46. Scalable Optimal Transport Algorithm for Network Alignment

    Jul 11, 2026Elaheh Hassani, Durga Mandarapu, Qi Yu +2Feature AlignmentComplex Networks

  47. SLORR: Simple and Efficient In-Training Low-Rank Regularization

    Jul 9, 2026David González-Martínez, Shiwei LiuLow-Rank FactorizationConvolutional Neural Network Compression

  48. PALS: Percentile-Aware Layerwise Sparsity for LLM Pruning

    Jul 8, 2026Yazdan Jamshidi, Alexey ShvetsMagnitude-Based PruningStructured Pruning

  49. Sparse Delta Memory: Scaling the State of Linear RNNs through Sparsity

    Jul 8, 2026Loïc Cabannes, Pierre-Emmanuel Mazaré, Gergely Szilvasy +6Dynamic Sparse AttentionEfficient Long-Context Inference

  50. Dynamic-in-Few-Step: Unifying Dynamic Computation and Few-Step Distillation for Efficient Video Generation

    Jul 7, 2026Yu Cheng, Siyue Yao, Zhongang Qi +3Video Diffusion ModelsFew-Step Generation

  51. Adversarial LassoNet: Robust Feature Selection via Stability-Driven Sparse Learning

    Jul 4, 2026Zhen Huang, Peicheng Xu, Junbiao Pang +1Feature SelectionAdversarial Transferability

  52. MUTE: Return-Preserving Communication Unlearning for Efficient Multi-Agent Coordination

    Jul 3, 2026Rui Zuo, Qinwei Huang, Mingyang Li +3Multi-Agent Reinforcement LearningMachine Unlearning

  53. RT-Tango: Real-Time Distributed Binaural Speech Enhancement for Low-Power Hearing Aid Devices

    Jul 2, 2026Z. Benslimane, P. Chouteau, M. Poreba +4Speech EnhancementBeamforming

  54. SCAPE: Accurate and Efficient LLM Training with Extreme Sparse Communication

    Jul 2, 2026Mingkai Zheng, Junlin Chen, Haotian Xie +1Large Language Model TrainingSparsity

  55. Deep Multitask Learning for Mixed-Type Outcomes with Shared Sparsity

    Jul 1, 2026Huichao Li, Tong Wang, Sanguo Zhang +1Multi--Task LearningPredictors

  56. Post-Training Pruning for Diffusion Transformers

    Jul 1, 2026Chengzhi Hu, Xuewen Liu, Jing Zhang +3Diffusion TransformersDataset Distillation

  57. Entropy-Regularized Probabilistic Gates for Sparse Model Discovery in Scarce-Data Federated Learning

    Jun 30, 2026Krishna Harsha Kovelakuntla Huthasana, Alireza Olama, Andreas LundellRobust Federated LearningKullback-Leibler Regularization

  58. Sparsity-Inducing Divergence Losses for Biometric Verification

    Jun 30, 2026Dimitrios Koutsianos, Ladislav Mošner, Yannis Panagakis +1Bregman DivergencesSparsity

  59. KbSD: Knowledge Boundary aware Self-Distillation for Behavioral Calibration in Agentic Search

    Jun 29, 2026Tao Feng, Xinke Jiang, Chao WuAgentic Reinforcement LearningHeterogeneous Knowledge Distillation

  60. On the Policy Gradient Foundations of Group Relative Policy Optimization: Credit Assignment, Gradient Sparsity, and Rank Collapse

    Jun 28, 2026Amritansh Mishra, Supriyo Chakraborty, Berkcan KapusuzogluGroup Relative Policy Optimization GradientsPolicy Gradient