Cost-Aware Inference

Latest papers 185

All topics
CardsList
  1. ARES: Adaptive Reasoning-Effort Steering for PPA- and Cost-Aware RTL Optimization with LLM Agents

    Jul 30, 2026Stef Cuyckens, Mihaela Jivanescu, Jun Yin +2Inference-Time OptimizationLarge Language Model-Guided Optimization

  2. Budget-Aware LLM Discovery via Cost-Calibrated Frontier Utility

    Jul 29, 2026Yansen Zhang, Yilu Liu, Tianyu Liu +6Inference-Time SearchAutomated Algorithm Discovery

  3. RAG-HAR+: Towards Cost-Efficient LLM-Based Human Activity Recognition for Edge Deployment

    Jul 29, 2026Hansi Karunarathna, Nirhoshan Sivaroopan, Chamara Madarasingha +2Human Activity RecognitionCost-Aware Inference

  4. Safety-Aware Cascaded Inference for Crop Damage Assessment with Controlled Error Trade-offs

    Jul 28, 2026José Thiéry Messigbédé Hagbe, Gani Kawsar Gounou, Songbian Karim ZiméAgricultural Image AnalysisAgricultural Remote Sensing

  5. Agent-UCT: Upper Confidence Bounds Applied to Trees for Agentic Workflow Optimization with Cost-Awareness

    Jul 27, 2026Yang Li, Hai Liu, Dian Shao +8Retrieval-Augmented GenerationCost-Aware Inference

  6. When Should Active RAG Retrieve? A Budget-Aware Evaluation of Utility, Calibration, and Cost

    Jul 27, 2026Pin Qian, Su Wang, Chong Peng +5Cost-Aware InferenceAgentic RAG

  7. Exploring Budgeted Image Classification with Content-Sensitive Resource Allocation

    Jul 27, 2026Athanasios G. PapadopoulosCost-Aware InferenceClassification

  8. CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents

    Jul 21, 2026Qijia He, Jiayi Cheng, Chenqian Le +8AI Coding AgentsCost-Aware Inference

  9. Supervised Fine-Tuning vs. In-Context Learning: An Equilibrium Analysis of LLM Personalization under Congestion

    Jul 15, 2026Fengzhuo Zhang, Zhuoran Yang, Dirk BergemannSupervised Fine-TuningLLM Serving

  10. The Cost and Network Limits of Space-Based AI Compute

    Jul 15, 2026Kees van BerkelLLM InferenceCost-Aware Inference

  11. Cost-Optimal Foundation Model Deployment Portfolio for Transportation Management

    Jul 14, 2026Xi Cheng, Ke Liu, Siyuan Feng +2Cost-Aware Inference

  12. Token Reduction Is Not Cost Reduction

    Jul 13, 2026Sarel Weinberger, Amir HozezAI Coding AgentsCost-Aware Inference

  13. Inference Economics of Enterprise Coding Agents: A Case Study of Cloud vs. On-Premise LLMs

    Jul 13, 2026Sheng-Wei Peng, Yi-Hsun Lin, Yi-Pei LeeLLM ServingSoftware Engineering Agents

  14. InfluMatch: Frontier-Quality KOL Search at 4B-Model Cost

    Jul 7, 2026Krittanon Kaewtawee, Petmongkon Pornpichitsuwan, Natchaya Temyingyong +4Learning to RankCost-Aware Inference

  15. A Workflow-Aware Serving Layer for Agentic Applications

    Jul 3, 2026Jiayi Qian, Zishen Wan, Hanchen Yang +3Cost-Aware InferenceAgentic Workflows

  16. When Does Learning to Stop Help? A Cost-Aware Study of Early Exits in Reasoning Models

    Jun 29, 2026Zhe Dong, Fang Qin, Manish ShahEarly StoppingCost-Aware Inference

  17. SemJoin: Semantic Join Optimization

    Jun 28, 2026Christopher Gou, Aditya Banerjee, Jiaxuan Wang +1Large Language Model-Guided OptimizationCost-Aware Inference

  18. EntroRouter: Learning Efficient Model Routing via Entropy Regulation

    Jun 28, 2026Kaiyi Zhang, Xueliang Zhao, Zhuocheng Gong +2Adaptive Model RoutingCost-Aware Inference

  19. Uncertainty-Aware Sequential Decision Rules for Event-Triggered LLM Invocation in Streaming Systems

    Jun 27, 2026Zhaohui WangSequential Decision MakingCost-Aware Inference