Preemption

Ask about this topic

Momentum

7 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 27

All topics
CardsList

  1. Dynamic Flow, Static Graph: KV Cache Reuse for Efficient LLM Serving on Mobile NPUs

    Sep 28, 2026Zhengxiang Huang, Shengheng Chen, Chaoyue Niu +6Kv-Cache ManagementNeural Processing Units

    Shanghai Jiao Tong University Shanghai, China · Alibaba Group Hangzhou, China · Alibaba Group Hangzhou, Zhejiang, China

  2. OLED-MoE: Accelerating MoE-Based dLLM Inference via Inter-Iteration Locality-Aware Expert Offloading

    Sep 27, 2026Jingyuan Xiao, Jiayue Wang, Yitao Hu +7Mixture-Of-Expert InferenceOffloading

    Tianjin University, Tianjin, China · Tianjin University Tianjin, China

  3. Hard Stop: Kernel-Level Preemption and Containment for Rogue Agentic Execution

    Sep 24, 2026José Luis PinoIncident ResponseCyberattacks

    Independent Researcher Westlake Village, CA, USA

  4. ClashBench: Conflicts Leading Agents to Seize and Harm

    Sep 17, 2026Yuejin Xie, Yu Li, Dadi Guo +6Runtime Safety FilteringPreemption

    Tsinghua University · Shanghai AI Lab · Fudan University +2

  5. SeqMoE: Toward Full-Load Performance via Predictive and Graph-Compatible MoE Offloading

    Sep 14, 2026Zihan Wang, Yuqi Wang, Lei Gong +5Mixture-Of-Expert InferenceOffloading

    University of Science and Technology of China Hefei, China · Suzhou Institute for Advanced Research, University of Science and Technology of China Suzhou, China

  6. Building py-kvcache: A Performance Characterization of External KV Caching for vLLM with NVMe SSDs

    Sep 11, 2026Joseph Kanichai, Tiziano De Matteis, Animesh TrivediKv-Cache ManagementKey-Value Cache

    Vrije Universiteit Amsterdam Amsterdam, the Netherlands · IBM Research Zurich Zurich, Switzerland

  7. Deadline-Aware Adaptive Prefill Chunking for Efficient Large Language Model Serving

    Sep 7, 2026Siyu Song, Qi Bai, Jinbo Hao +3Large Language Model ServingPrefill

    School of Computer Science and Technology, Beijing Institute of Technology · School of Computer Science and Engineering, Sun Yat-sen University · School of Computer Engineering, Jiangsu Ocean University

  8. Disentangling Statistical Preemption from Entrenchment in Language Models' Avoidance of Overgeneralization

    Sep 1, 2026Yixuan Wang, Freda Shi, Kanishka MisraPreemptionWar

    University of Waterloo Vector Institute · Department of Linguistics University of Texas at Austin

  9. TEMPO: Makespan-Aware Expert-Parallel Load Balancing Across Memory- and Compute-Bound Regimes

    Aug 13, 2026Jie Li, Chenxin Jia, Jinliang Shen +5Load BalancingCpu-Gpu Hybrid Designs

    KlingAI Research

  10. APEX: Adaptive Expert Prefetching for Memory-Efficient Edge MoE Inference

    Aug 12, 2026Alish Kanani, Layan Badawi, Umit Y. OgrasMixture-Of-Expert InferenceMixture-Of-Experts

    University of Wisconsin–Madison

  11. ArchAgent v2: A Case Study with the Data Prefetching Championship

    Aug 10, 2026Abraham Gonzalez, Raghav Gupta, Akanksha Jain +12Hardware EfficiencyPreemption

    Google · University of California, Berkeley · Google DeepMind

  12. Does a Toehold Make a Bidder Bolder? Preemption and Multiplicity in Multi-Round Takeover Auctions

    Aug 9, 2026Zain NaboulsiFirst-Price AuctionsBidding

    Principal AI Competency Lead, Sparq

  13. DraftExpert: Expansion-Aware Self-Speculative Decoding for End-Device MoE Inference

    Jul 27, 2026Dengke HanMixture-Of-Expert InferenceMixture-Of-Experts

  14. TF-Engram: A Train-Free Engram with SSD-Backed Memory for Large Language Models

    Jul 8, 2026Yutang Ma, Kecheng Huang, Xikun Jiang +1Large Language Model MemoryLLM Inference Optimization

    The Chinese University of Hong Kong · Beijing Institute of Technology, Zhuhai

  15. Beyond Prediction: Tail-Aware Scheduling for LLM Inference

    Jun 16, 2026Yueying Li, Yuanfan Chen, Jiayang Chen +6Large Language Model ServingPreemption

    Cornell University, Computer Science Department, NY, USA · Microsoft Azure System Research, WA, USA · Cornell University, Electrical and Computer Engineering Department, NY, USA +2

  16. A Spatio-Temporal Expert Prefetching Framework for Efficient MoE-based LLM Inference

    Jun 13, 2026Yingnan Zhao, Razvan Bunescu, Ahmed Louri +2Mixture-Of-Expert InferenceLLM Inference Optimization

    George Washington University Washington, DC, USA · University of North Carolina at Charlotte Charlotte, NC, USA · Ohio University Athens, OH, USA

  17. SparDA: Sparse Decoupled Attention for Efficient Long-Context LLM Inference

    Jun 3, 2026Yaosheng Fu, Guangxuan Xiao, Xin Dong +2Dynamic Sparse AttentionLLM Inference Optimization

    1NVIDIA · 2Thinking Machines Lab · 3ByteDance Seed +1

  18. LearnedCache: An eBPF-Integrated Perceptron-Based Eviction Policy for the Linux Page Cache

    May 25, 2026Zejia QiEvictionCache

  19. Learning-Augmented Online Scheduling with Parsimonious Preemption

    May 22, 2026Mugen Blue, Sungjin Im, Alexander LindermayrSchedulersPreemption

    University of California, Santa Cruz, US. · Institut für Mathematik, Technische Universität Berlin, Germany.

  20. Do Language Models Know What Not to Say? Causal Evidence for Statistical Preemption in LLMs

    May 21, 2026Dongxin Guo, Jikun Wu, Siu Ming YiuLarge Language Models FailLinguistics

    The University of Hong Kong · Hong Kong, China · Stellaris AI Limited

  21. Towards Multi-Model LLM Schedulers: Empirical Insights into Offloading and Preemption

    May 19, 2026Mert Yildiz, Pietro Spadaccino, Alexey Rolich +2PreemptionOffloading

    Sapienza University of Rome, Rome, Italy

  22. Predictive Prefetching for Retrieval-Augmented Generation

    May 18, 2026Wuyang Zhang, Shichao PeiPreemptionAsynchronous Execution

    Department of Computer Science, University of Massachusetts Boston, Boston, United States of America.

  23. Fast MoE Inference via Predictive Prefetching and Expert Replication

    May 12, 2026Ankit Jyothish, Ali Jannesari, Aishwarya Sarkar +1Mixture-Of-Expert InferenceLLM Inference Optimization

    Iowa State University Ames, USA

  24. ChunkFlow: Communication-Aware Chunked Prefetching for Layerwise Offloading in Distributed Diffusion Transformer Inference

    May 11, 2026Han Meng, Danny Willow Liu, Dong LiOffloadingPreemption

    University of California, Merced · University of Chicago · University of California, Merced and Yotta Labs +1

  25. PEEK: Predictive Queue-Informed KV Cache Management for LLM Serving

    May 10, 2026Bing Xie, Zhipeng Wang, Masahiro Tanaka +1Kv-Cache ManagementEviction

    †Corresponding author.

  26. Asymptotically Robust Learning-Augmented Algorithms for Preemptive FIFO Buffer Management

    Apr 29, 2026Wen-Han Hsieh, Ya-Chun LiangLearning-Augmented AlgorithmsQueue Control

    Department of Computer Science, National Tsing Hua University, Hsinchu, Taiwan

  27. Scheduling Analysis of UAV Flight Control Workloads on PREEMPT_RT Linux Using a Raspberry Pi 5

    Apr 21, 2026Luiz Giacomossi, Håkan Forsberg, Ivan Tomasic +2SchedulersPreemption

    Mälardalen University Västerås, Sweden · ReTiS Lab, Scuola Superiore Sant’Anna Pisa, Italy