Cost-Aware Inference

Latest papers 183

All topics
CardsList
  1. Performance at What Cost? A Sustainability-Aware Performance Index for Cell and Nucleus Instance Segmentation

    Oct 7, 2026Eiram Mahera Sheikh, Alaa Tharwat, Wolfram SchenckInstance SegmentationCost-Aware Inference

  2. From Pareto to Preference: Personalized Test-Time Scaling via Amortized Agentic Policy Discovery

    Oct 7, 2026Xinglin Wang, Zishen Liu, Tong Zheng +9Test-Time ScalingCost-Aware Inference

  3. Evaluating Inference Compute for Generative AI: A Framework for Enterprise Workloads

    Oct 5, 2026Abbas Raza Ali, Muhammad Ajmal Siddiqui, Moona ZahidLLM Inference EfficiencyDisaggregated LLM Serving

  4. From Token-Max to Outcome-Max: How You Use AI Determines Its Productivity

    Oct 5, 2026Chen Xu, Mengqiao Liu, Beibei Li +1Cost-Aware InferenceHuman-AI Collaboration

  5. SCOPE-AD: Sequential cost-aware ordinal-belief planning with energy-based models for diagnostic agents

    Oct 1, 2026Ziwen Yu, Ivan Koychev, Elizabeth Coulthard +7Cost-Aware InferenceModel-Based Planning

  6. Denoising Surface: Modeling and Predicting Inference Cost for Diffusion LLM Serving

    Sep 30, 2026Haoyu Zheng, Fangcheng Fu, Binhang Yuan +6Cost-Aware InferenceDiffusion Model Serving

  7. Metacognitive Reasoning in Energy Based Models using Instance Based Learning Theory

    Sep 30, 2026Tailia Malloy, Prateek Kumar Rajput, Serge Lionel Nikiema +2Cost-Aware InferenceEnergy-Based Models

  8. You Cannot Pick a Provider From the Price List: Market-Aware Routing for Open-Weight LLM Inference

    Sep 29, 2026Liang He, Jingbo Wen, Yixiong Chen +4LLM ServingCost-Aware Inference

  9. Routing Should Pay for Itself: Sparse Supervision for Economical LLM Routing

    Sep 29, 2026Guannan Lai, Gelin Bian, Hao-Xuan Ma +5LLM ServingCost-Aware Inference

  10. When Should Agents Check External State? Budgeting Observations for Stored Intentions

    Sep 29, 2026Zhengkun Di, Bin Shi, Kai Sun +2Cost-Aware InferenceAgent Memory Management

  11. CADOC: Cache-Aware Dynamic Object Context for Long-Horizon Agents

    Sep 29, 2026Junjie Yao, Zhangchen Zhou, Zhi-Qin John XuCost-Aware InferencePrefix Caching

  12. LoopICL: Looping a single transformer block to solve tabular tasks

    Sep 28, 2026Amir Rezaei Balef, Katharina EggenspergerTabular Foundation ModelsCost-Aware Inference

  13. TokenCast: Forecasting Token Consumption During LLM Agent Execution

    Sep 28, 2026Chaoqian Ouyang, Ling Yue, Libin Zheng +7Cost-Aware InferenceEfficient Language Model Inference

  14. Long-Horizon Scaling: How Model Capabilities Shape the Returns to Computation

    Sep 28, 2026Haoyu Zheng, Zhengyu Chen, Huaisheng Zhu +5Cost-Aware InferenceInference-Time Scaling

  15. RSI-Router: Evolving Subtask-Level LLM Routing and Skills for Cost-Efficient Agents

    Sep 28, 2026Hao Li, Hangfan Zhang, Zhiyao Cui +5Cost-Aware InferenceLLM Agent Workflow Optimization

  16. The Decision Value of Perception Compute

    Sep 28, 2026Hoang Pham Cong, Ho Viet Duc LuongCost-Aware InferenceAutonomous Driving Perception

  17. Test-Time Scaling via Budgeted Multi-Attribute Verification

    Sep 28, 2026Bo Xue, Ji Cheng, Shen-Huan Lyu +2Multi-Armed BanditsLLM Answer Verification

  18. Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agents

    Sep 25, 2026Yiran Hu, Nan Jiang, Shanchao Liang +3Coding AgentsCost-Aware Inference

  19. Human-AI-Powered Hypothesis Testing: Cost-Aware Selective AI Scoring and Sequential Human Escalation

    Sep 24, 2026Dae Woong, Ham, Xuejun Zhao +2Cost-Aware InferenceHuman-in-the-Loop Evaluation

  20. Learning the Cost of Reliable Inference

    Sep 23, 2026Dimitrios Rontogiannis, Ander Artola Velasco, Manuel Gomez RodriguezCost-Aware InferenceLLM Routing

  21. Total Cost of Agency: Exact Attribution of Memory Injection Cost in Multi-Agent LLM Workflows

    Sep 20, 2026Vivek Kumar Singh, Preeti Priyam, Gautam BhowmickLLM Agent MemoryCost-Aware Inference

  22. Designing Agentic AI Workflow Portfolios under Imperfect Selection and Compute Cost

    Sep 16, 2026Mojtaba Abdolmaleki, Stefanus Jasin, Boyu WangCost-Aware InferenceAgentic Workflows

  23. Explanations-Driven Active Feature Acquisition for Algorithmic Recourse

    Sep 14, 2026Vinura Galwaduge, Jagath SamarabanduCounterfactual ExplanationsCost-Aware Inference

  24. Calibration-Aware Uncertainty Cascades for Efficient Heterogeneous Model Collaboration

    Sep 12, 2026Yilin Zhang, Han Jiang, Cai Xu +2Selective PredictionCost-Aware Inference

  25. A Cost-Aware Agentic Architecture for NL-to-SQL over Nested Enterprise Schemas, with a New Benchmark

    Sep 7, 2026Yoga Sri Varshan Varadharajan, Ajay Yadav, Ritesh Goru +5Cost-Aware InferenceText-to-SQL

  26. Task-Aware QUBO Allocation for Mixed-Precision Quantization

    Sep 4, 2026Osama Orabi, Artur Zagitov, Hadi Salloum +2Mixed-Precision QuantizationCost-Aware Inference

  27. CaRL-EM: Cost-Aware Reinforcement Learning for Entity Matching with LLMs

    Sep 1, 2026Chaohui Guo, Michel Klein, Zhisheng HuangReinforcement LearningLLM Inference Scheduling