language model inference caching

Latest papers

CardsList

8 papers0 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. Can a Cacheable Decision Model Follow Rules?

    Sep 29, 2026Dushyant Rajput, Nirdesh Chauhan, Siddharth Kosarajulanguage model inference cachingLLM Inference Acceleration

  2. DynBranch: Speculative Subgraph Reuse for Dynamic Agentic LLM Serving

    Sep 25, 2026Junyi Shen, Noppanat Wadlom, Zhengyuan Su +1language model inference cachingLLM Agent Workflow Optimization

  3. Efficient LLM Serving for Agentic Workflows: A Data Systems Perspective

    Mar 17, 2026Noppanat Wadlom, Junyi Shen, Yao Lulanguage model inference cachingLLM Serving

  4. FlashEvaluator: Expanding Search Space with Parallel Sequence-Level Evaluation

    Mar 3, 2026Chao Feng, Yuanhao Pu, Chenghao Zhang +5language model inference cachingEfficient Inference