Sparse Expert Activation

Ask about this topic

Recent momentum

-67%

2 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

47 papers

Latest in Sparse Expert Activation

Open your feed →
CardsList

  1. NeuroFlex: Lossless Element-Level ANN-SNN Co-Execution for Efficient Sparse Inference

    Sep 12, 2026Varun Manjunath, Pranav Ramesh, Gopalakrishnan SrinivasanSparse Deep Neural Network AcceleratorsSpiking Neural Networks

  2. Event-Driven Language Models with Sparse Neural Activity for Neuromorphic Hardware

    Aug 31, 2026Simon Richter, Ruhai Lin, Jason Yik +4Sparse Expert ActivationNeuromorphic Hardware

  3. SparSEEty: Extracting Tokens from Sparsity-Exploiting LLM Serving Systems via Deterministic Side Channels

    Aug 4, 2026Yongwan Jo, Jinyoung Park, Euihyun Lee +1Language Model Evasion AttacksSide-Channel Analysis

  4. SMM Transformer: Leveraging Spiking Neural Networks for Multimodal Tasks

    Aug 3, 2026Xiubo Liang, Jinxing Han, Yuke Li +3Spiking Neural NetworksMultimodal Transformers

  5. Celty: SpMspV GPU Kernel and SIMT Co-Design for Efficient Dual-Sparse LLM Inference

    Aug 2, 2026Ruokai Yin, Priyadarshini PandaLLM Inference EfficiencySparse Expert Activation

  6. Parameter-Efficient Fine-Tuning for Spiking Point Cloud Models

    Jul 31, 2026Zihao Guo, Jihua Zhu, Yiding Sun +2Spiking Neural NetworksBinary Spikes

  7. Prox: Training-Free FFN Activation Sparsity via Approximate Intermediate-Channel Salience in LLMs

    Jul 30, 2026Jinyi Liu, Wei Chen, Pengyu Chen +4Sparse Expert ActivationLLM Inference Efficiency

  8. The Sparsity Ceiling: Where Spiking Networks Can and Cannot Trade Activity for Energy

    Jul 29, 2026Zeyu WangSpiking Neural NetworksNeuromorphic Hardware

  9. Seeing the End at Step Zero: Accelerating Diffusion MLLMs via MLP Sparsity-Aware Truncation

    Jul 16, 2026Qicheng Zhao, Qi Sun, Zheyu YanDiffusion Language ModelsLLM Inference Efficiency

  10. CARE-LoRA: Compressed Activation REconstruction for Memory-Efficient LoRA

    Jul 11, 2026Gengyu Zhang, Haiyin Ran, Zhengbao He +4Low-Rank AdaptationLarge Language Model Compression

  11. Sensitivity-Aware Thresholding and Token Routing for Activation Sparsification in Large Language Models

    Jul 9, 2026Bishmoy Paul, Youngmin Yi, Hoeseok YangSparse Expert ActivationToken-Level Uncertainty

  12. Localized LoRA-MoE: Block-wise Low-Rank Experts With Adaptive Routing

    Jul 6, 2026Babak Barazandeh, Subhabrata Majumdar, Vinay Prithyani +1Low-Rank AdaptationSparse Expert Activation

  13. FaceMoE: Mixture of Experts for Low-Resolution Face Recognition

    Jun 30, 2026Kartik Narayan, Vishal M. PatelFacial RecognitionLow-Resolution

  14. DAIN: Dynamic Agent-Based Interaction Network for Efficient and Collaborative Multimodal Reasoning

    Jun 29, 2026Xinxin Chen, Yuchen Li, Zihan Wang +3Multimodal FusionMultimodal Agents

  15. SharQ: Bridging Activation Sparsity and FP4 Quantization for LLM Inference

    Jun 25, 2026Haoqian Meng, Yilun Luo, Yafei Zhao +4W4A4 QuantizationSparse Expert Activation

  16. GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models

    Jun 24, 2026Chaoxiang Cai, Minghe Weng, Jie Li +4Mixture-Of-Expert Language ModelsAdaptive Routing

  17. How to Score Experts for One-Shot MoE Expert Pruning: A Unified Formulation and Selection Principle

    Jun 14, 2026Zongfang Liu, Jinghui Zhang, Zijian Ma +2ExpertsSparse Expert Activation

  18. AQ4SViT: An Automated Quantization Framework with Search Gating Policy for Compressing Spiking Vision Transformers

    Jun 14, 2026Rachmad Vidya Wicaksana Putra, Saad Iftikhar, Muhammad ShafiqueExtreme Low-Bit QuantizationSelf-Supervised Vision Transformers

  19. DBHN-Net: Dual-Branch Hybrid Neural Network For Low-Complexity Monaural Speech Enhancement

    Jun 4, 2026Cunhang Fan, Enrui Liu, Jing Zhou +6Spiking Neural NetworksSpeech Enhancement

  20. Mechanistic Insights into Functional Sparsity in Multimodal LLMs via CoRe Heads

    Jun 4, 2026Ruoxi Sun, Quantong Qiu, Juntao Li +3Multi-Modal Large Language ModelsCross-Modal Attention

  21. Learned Subspace Compression for Communication-Efficient Pipeline Parallelism

    Jun 3, 2026Paul Janson, Edouard Oyallon, Eugene BelilovskyLarge Language Model CompressionLow-Rank Factorization

  22. Spike-Aware INT8 Execution for Spiking Language Models on Commodity CPUs

    Jun 2, 2026Ting LiuLLM Inference EfficiencySparse Expert Activation

  23. Spiking and Event-driven Neuromorphic Mamba Models for Efficient Speech Recognition

    May 31, 2026Tauseef Ahmed, Tao Sun, Jeronimo Castrillon +2Neuromorphic HardwareSparse Expert Activation

  24. RT-Lynx: Putting the GEMM Sparsity In a Right Way for Diffusion Models

    May 26, 2026Xing Cong, Hanlin Tang, Kan Liu +3Multimodal Diffusion TransformersSparse Expert Activation

  25. Towards the Connection between Activation Sparsity and Flat Minima

    May 25, 2026Ze Peng, Jian Zhang, Lei Qi +2Sparse Expert ActivationModern Deep Networks

  26. SpikingMoE: SDPrompt-Guided Dynamic Expert Fusion in Spiking Neural Networks

    May 22, 2026Yukai Yang, Chenxi Qin, Jungang Li +3Spiking Neural NetworksBinary Spikes

  27. SymbolicLight V1: Spike-Gated Dual-Path Language Modeling at High Encoder Spike Sparsity

    May 20, 2026Ting LiuSparse Expert ActivationBinary Spikes

  28. Post-Trained MoE Can Skip Half Experts via Self-Distillation

    May 18, 2026Xingtai Lv, Li Sheng, Kaiyan Zhang +12Mixture-of-Experts ModelsSparse Expert Activation

  29. Spiker-LL: An Energy-Efficient FPGA Accelerator Enabling Adaptive Local Learning in Spiking Neural Networks

    May 18, 2026Alessio Caviglia, Filippo Marostica, Alessandro Savino +1Spiking Neural NetworksSparse Deep Neural Network Accelerators

  30. Dense vs Sparse Pretraining at Tiny Scale: Active-Parameter vs Total-Parameter Matching

    May 13, 2026Abdalrahman WaelSparse Expert ActivationMixture-of-Experts Models

  31. Uncovering Intra-expert Activation Sparsity for Efficient Mixture-of-Expert Model Execution

    May 9, 2026Jongseok Park, Sunga Kim, Zhenyu Gu +2Sparse Expert ActivationMixture-of-Experts Models

  32. Direct-to-Event Spiking Neural Network Transfer

    May 8, 2026Nhan Trong Luu, Duong Trung Luu, Pham Ngoc Nam +1Spiking Neural NetworksNeuromorphic Hardware

  33. SAFformer:Improving Spiking Transformer via Active Predictive Filtering

    May 8, 2026Zequan Xie, Weiming Zeng, Yunhua Chen +3Spiking Neural NetworksHybrid Transformer

  34. Elastic Spiking Transformers for Efficient Gesture Understanding

    May 4, 2026Alberto Ancilotto, Gianluca Amprimo, Stefano Di Carlo +1Spiking Neural NetworksNeuromorphic Hardware

  35. ShiftLIF: Efficient Multi-Level Spiking Neurons with Power-of-Two Quantization

    May 3, 2026Kaiwen Tang, Di Yu, Jiaqi Zheng +4Spiking Neural NetworksBinary Spikes

  36. Congestion-Aware Dynamic Axonal Delay for Spiking Neural Networks

    May 2, 2026Dewei Bai, Hongxiang Peng, Yunyun Zeng +2Spiking Neural NetworksBinary Spikes

  37. QB-LIF: Learnable-Scale Quantized Burst Neurons for Efficient SNNs

    Apr 28, 2026Dewei Bai, Hongxiang Peng, Jiajun Mei +4Spiking Neural NetworksBinary Spikes

  38. AQPIM: Breaking the PIM Capacity Wall for LLMs with In-Memory Activation Quantization

    Apr 20, 2026Kosuke Matsushima, Yasuyuki Okoshi, Masato Motomura +1Graphics Processing Unit MemoryLLM Inference Efficiency

  39. LASER: Low-Rank Activation SVD for Efficient Recursion

    Apr 19, 2026Ege Çakar, Ketan Ali Raghu, Lia ZhengSparse Expert ActivationLow-Rank Factorization

  40. Latency Coding for Efficient and Low-Latency Deep Spiking Neural Networks

    Mar 24, 2026Yi Lu, Jianhao Ding, Zhaofei YuSpiking Neural NetworksBinary Spikes

  41. When Does Sparsity Mitigate the Curse of Depth in LLMs

    Mar 16, 2026Dilxat Muhtar, Xinyuan Song, Sebastian Pokutta +4Sparse Expert ActivationSparsity

  42. Low-latency Event-based Object Detection with Spatially-Sparse Linear Attention

    Mar 6, 2026Haiqing Hao, Zhipeng Sui, Rong Zou +4Object DetectionSpatial Attention

  43. HiSAC: Hierarchical Sparse Activation Compression for Ultra-long Sequence Modeling in Recommenders

    Feb 24, 2026Kun Yuan, Junyu Bi, Daixuan Cheng +5RecommendationSequence Modeling

  44. Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models

    Jan 12, 2026Xin Cheng, Rui Tian, Wangding Zeng +18Sparse Expert ActivationMixture-of-Experts Models

  45. NeuroFlex: Lossless Element-Level ANN-SNN Co-Execution for Efficient Sparse Inference

    Nov 7, 2025Varun Manjunath, Pranav Ramesh, Gopalakrishnan SrinivasanSparse Deep Neural Network AcceleratorsSpiking Neural Networks

  46. BALF: Budgeted Activation-Aware Low-Rank Factorization for Fine-Tuning-Free Model Compression

    Sep 29, 2025David González-MartínezLow-Rank FactorizationSparse Expert Activation

  47. Subspace Networks: Scaling Decentralized Training with Communication-Efficient Model Parallelism

    Jun 2, 2025Sameera Ramasinghe, Thalaiyasingam Ajanthan, Gil Avraham +2Large Language Model CompressionBillion-Parameter Models