Inference Cost

Ask about this topic

Recent momentum

-57%

9 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

2 new papers

A weekly snapshot of new work published in Inference Cost.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Inference Cost.

Period ending 2026-09-07

4 new papers

A weekly snapshot of new work published in Inference Cost.

114 papers

Latest in Inference Cost

Open your feed →
CardsList

  1. Dependency-Aware Trajectory Refinement for Efficient Multi-Turn Agent Fine-Tuning

    Sep 16, 2026Zhuo Chen, Zhen Zhang, Xinyu Wang +1Multi-Turn Tool-Use AgentInference Cost

  2. Technical Report: One-Step Drifting Action Heads for GR00T N1.7

    Sep 16, 2026Xihe ShaoVision-Language-Action ModelsTechnical Report

  3. EConv-TasNet: Efficient Conv-TasNet for Effective Speech Separation

    Sep 11, 2026Pei-Chun Chang, Chuan-Yi LiuSpeech SeparationResnet-18

  4. From Fixed Keys to Readable Schemas: Small Language Models for Vehicle Agent Function Calls

    Sep 10, 2026Hamed Jafarzadeh Asl, Yuanhao Yu, Vahid Partovi NiaSmall Language ModelsSchema

  5. Stable Answers, Unfinished Reasoning: Why Self-Consensus Is Not a Safe Early-Exit Signal

    Sep 9, 2026Yunxiang Mo, Donghao Zhao, Hejia GengConsensusEarly Stopping

  6. CaRL-EM: Cost-Aware Reinforcement Learning for Entity Matching with LLMs

    Sep 1, 2026Chaohui Guo, Michel Klein, Zhisheng HuangInference Cost

  7. MEOM: Multi-View Expected-OKS Maximization for Human Pose Triangulation

    Aug 31, 2026Ziliang Xiong, Henglin Shi, Per-Erik Forssen3D Pose EstimatorKeypoint Detection

  8. Rethinking Language's Role in Efficient VLA for Autonomous Vehicles: Toward Smarter, Trustworthy Driving

    Aug 31, 2026Tongfei Guo, Lili SuEfficient Vision-Language-Action ModelsVision-Language-Action Models

  9. Selection, Representation, and Execution in Sparse Fourier Neural Operators

    Aug 30, 2026Abdul Qadir Ibrahim, Martin BurgerFourier Neural OperatorsSparsity

  10. Towards Efficient Reasoning in LLM-Based Recommender Systems via Model Merging

    Aug 11, 2026Linh Dieu Le, Tong Chen, Shazia Sadiq +3Continual Model MergingRecommender Systems

  11. MERA: Model Evolution and Routing with Skill Adaptation for Agentic Systems at Scale

    Aug 11, 2026Yuhang Yao, Zeyu Wang, Wanyi Chen +8Large Language Model AdaptationLow-Rank Adaptation Adapters

  12. BDH-CQ: In-Context Learning with Recurrent Latent Reasoning

    Aug 10, 2026Björn Engdahl, Adrian Kosowski, Jan Chorowski +6Large Reasoning ModelsIn-Context Learning

  13. Test-Time Augmentation for LLMs: When Input Diversity Beats Output Diversity at Matched Compute

    Aug 10, 2026Nikita Kozodoi, Zainab Afolabi, Jack ButlerSynthetic Data AugmentationInference Cost

  14. LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers

    Aug 7, 2026Tao Feng, Fangxu Yu, Haozhen Zhang +9Large Language Model RoutingAdaptive Routing

  15. The Sparsity Whisperer

    Aug 6, 2026Linghao Kong, Inimai Subramanian, Micah Adler +3SparsityInference Cost

  16. Does Out-of-Sight Equal Out-of-Mind in CoT Monitorability?

    Aug 5, 2026Pedro Ferreira, Wilker Aziz, Ivan TitovReasoning TracesChain-of-Thought Reasoning

  17. Fewer Tokens, Smaller Cache: Reward-Coordinated Efficient Reasoning

    Aug 5, 2026Qiyuan Zhu, Dezhi Li, Pengyu Cheng +8Large Reasoning ModelsKey-Value Cache Compression

  18. Agreement Before Diversity: Verification-First Complementarity for Heterogeneous Language-Model Coordination

    Aug 5, 2026Ruitong Li, Binjie Guo, Aisheng Mo +3DiversityAgreement

  19. Relevant but Incomplete: Referential Dangling as a Paradigm-Level Failure Mode in Hard Prompt Compression

    Aug 5, 2026Zhengpei Hu, Kai Li, Dapeng Fu +5LongbenchContext Compression

  20. Shared Prefixes, Better Credit: Adaptive Routing for Multi-Agent Reasoning

    Aug 3, 2026Yiqing Liu, Zihao Wang, Hantao Yao +2Multi-Agent ReasoningCredit Assignment

  21. ET-Prune: Evidence-Aware Dynamic Budgeting for Visual Token Pruning in Text-Rich MLLMs

    Aug 3, 2026Zizhong Ding, Junxian Li, Kai Liu +4Visual Token PruningPruning

  22. DAVET: Denoising-Aware Visual Evidence Trajectory Allocation for Diffusion Vision-Language Models

    Aug 3, 2026Yongkang Zhou, Xiang Xia, Cheng Yan +2Visual EvidenceRelation-Conditioned Evidence Encoder

  23. Stop When Memory Suffices: Evidence-Conditioned Progressive Execution for LLM Agents

    Aug 2, 2026Yidan Lin, Kaixiang Wang, Jiong Lou +1Agent MemoryLong-Horizon Agents

  24. MonitorVLM-v2: A Deployed Vision-Language Framework for Real-Time Safety Violation Detection

    Aug 2, 2026Jiang Wu, Sichao Wu, Yinsong Ma +2Vision-LanguageMultimodal Reasoning

  25. When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty

    Aug 1, 2026Nicolas Leins, Nico Pelleriti, Jana Gonnermann-Müller +1Inference CostOrchestration

  26. Dual-Flow Transformers: Decoupling the Primary Prefill Path from Additional Decode Computation

    Jul 31, 2026Liming Liu, Mingze Wang, Tuo ZhaoPrefillLLM Inference Efficiency

  27. Every Time I Hire a Linguist, Inference Costs Go Down: On Linguistic Rules as Effective Prompt Compressors

    Jul 28, 2026Jianfei Ma, Zhaoxin Feng, Emmanuele Chersoni +1Large Language Model CompressionContext Compression

  28. Lilith: Backdoor Generalization under Training-Inference Trigger Shift

    Jul 28, 2026Zhou Feng, Jiahao Chen, Chunyi Zhou +6Backdoor AttacksTrigger

  29. When LLM Defenses Backfire: Characterizing Safety, Performance, and Cost Trade-offs

    Jul 27, 2026Tong Zhang, Zexin Li, Simin Chen +1Large Language Model PerformanceInference Cost

  30. Understanding Tone-Dependent Inference Cost in Large Language Models

    Jul 27, 2026Akhil Kumar, Om DobariyaLarge Language Model ResponsesInference Cost

  31. ATLAS: Automated Approximation of Transformers for Efficient Homomorphic Inference in One Hour

    Jul 26, 2026Jianhang Xie, Sicheng Tan, Vishnu Naresh Boddeti +1Homomorphic EncryptionTransformer Architectures

  32. Hierarchical Grading in Large Language Models

    Jul 23, 2026T. ShaskaGradingLarge Models

  33. PyroDash: Cost-Efficient Token-Level Small-Large Language Model Collaborative Inference

    Jul 22, 2026Niqi Lyu, Pengtao Shi, Wei Qiu +4LLM Inference EfficiencyInference Cost

  34. Efficient Tracking and Understanding Object Transformations

    Jul 22, 2026Yihong Sun, Bharath HariharanMulti-Object TrackingSpatio-Temporal Transformers

  35. Efficient Clustering with Provable Guardrails for LLM Inference at Scale

    Jul 22, 2026Longshaokan Wang, Wai Tsang Keung, Punit Ghodasara +3Image ClusteringLLM Inference Efficiency

  36. Human Grounded Evaluation of Large Language Models for Optical Network Automation

    Jul 20, 2026Kiarash Rezaei, Omran Ayoub, Paolo Monti +1Large Language Model EvaluationHuman Grounded Evaluation

  37. Retain or Consolidate? Budget-Dependent Operator Selection for Language Agent Memory

    Jul 20, 2026Qingcan Kang, Mingyang Liu, Shixiong Kai +5Long-Term Conversational MemoryMultilingual Agents

  38. Constrained Path Reasoning: Measuring When Committed Stages Earn Their Cost

    Jul 19, 2026Honglin LiReasoning PathsInference Cost

  39. Agentic Calibration of Grey-Box Simulation Models: An LLM-Driven Alternative

    Jul 17, 2026David Gómez-Guillén, Mireia Diaz, Josep Lluis Arcos +1Multicalibration and CalibrationBayesian Optimization

  40. The Energy Society: A Simulation Environment for Studying Agent Cooperation under Survival Pressure

    Jul 16, 2026Lucas Bergholdt Hansen, Federico Torrielli, Filippo Tonini +1CooperationMulti-Agent Simulations

  41. UMoE:Unlocking Every Expert in Domain-Specific Training

    Jul 13, 2026Xuefeng Li, Pengfei LiuMixture-Of-Expert Language ModelsExperts

  42. Desc++: Efficient Descriptor Enhancement for Data Association in Existing Visual SLAM Systems

    Jul 13, 2026Ting-Wei Ou, Huang-Ting Lin, Kuu-Young YoungOrb-Slam2Simultaneous Localization And Mapping

  43. Route, Communicate, and Reason: Gated Routing and Adaptive Depth for Efficient Multi-Agent Reasoning

    Jul 12, 2026Sudipto Ghosh, Tanmoy ChakrabortyMulti-Agent ReasoningMulti-Agent Systems

  44. When Thinking Hurts: Epistemic Signals in the Reasoning Chains of Visual Language Models

    Jul 9, 2026Mayank SingalQwen3-Embedding-8BVisual Reasoning

  45. Does Bielik Know What It Doesn't Know? Activation Dispersion Separates Entity Familiarity from Factual Reliability Across Model Scale

    Jul 8, 2026Grzegorz BrzezinkaLarge Language Model ReliabilityInference Cost

  46. Bridging Diffusion Pruning and Step Distillation with Teacher-Aligned Repair

    Jul 7, 2026Jincheng Ying, Li Wenlin, Minghui Xu +1TeacherInference Cost

  47. CARD: Cross-component Audio Representation Distillation for Encoder-Free Audio Captioning

    Jul 6, 2026Ganesh Pavan Kartikeya Bharadwaj Kolluri, Yuchen Zhang, Michael Kampouridis +1Audio LatentAudio Encoders

  48. Amortising Bayesian Experimental Design for Sequential Information Gathering in LLMs

    Jul 3, 2026Jakob Hartmann, James Harvey, Jhonathan Navott +5Inference CostBayesian Experimental Design

  49. CoACT: Action-Preserving Observation Compression for Coding Agents

    Jul 3, 2026Haorui Chen, Yuancheng Zhu, Yitong Zhang +1Coding AgentsContext Compression

  50. Accuracy and Cost Claims Do Not Survive Re-Execution in Agentic VideoQA

    Jul 1, 2026Rama AlHamidi, Aseel Mohamed, Rasul Khanbayov +3Agentic Video GenerationVideo Question Answering

  51. Scaling Up Thermodynamic AI Models

    Jun 30, 2026Andrew G. MooreArtificial Intelligence ModelsTwo-Dimensional Ising Model

  52. MirrorCode: AI can rebuild entire programs from behavior alone

    Jun 29, 2026Tom Adamczewski, David Owen, David Rein +4Coding AgentsAi-Ran

  53. TF-MoE: Time-Frequency Mixture-of-Experts for Efficient Speech Separation

    Jun 28, 2026Qinzhe Hu, Chenda Li, Wangyou Zhang +3Speech SeparationTime-Frequency

  54. Quantization Inflates Reasoning: Token Inflation as a Hidden Cost of Low-Bit Reasoning Models

    Jun 24, 2026Xinyu Lian, Walid Krichene, Beichen Huang +4Large Language Model QuantizationQuantization

  55. CAVEWOMAN: How Large Language Models Behave Under Linguistic Input and Output Compression

    Jun 23, 2026Morayo Danielle Adeyemi, Ryan A. Rossi, Franck DernoncourtLarge Language Model CompressionContext Compression

  56. You Don't Need to Run Every Eval

    Jun 22, 2026Yuchen Zeng, Dimitris PapailiopoulosModel EvaluationScoring

  57. The Score Granularity Gap in Black-Box LLM Classification: A Comparative Study of Confidence Constructions

    Jun 20, 2026Ao Sun, Tian Sun, Jiaxing GengLarge Language Model UncertaintyInference Cost

  58. Learning the ARTS of Search for Automated Discovery

    Jun 20, 2026Gurusha Juneja, Arnav Kumar Jain, Deepak Nathani +2Tree SearchAgentic Reasoning

  59. A Transport-Based Geometry of Belief-Cost

    Jun 19, 2026Laurent CaraffaOptimal TransportInference Cost

  60. Does Mixture-of-Experts Actually Help Inference on Consumer and Edge Hardware? An Empirical Study

    Jun 19, 2026Alfarizy Alfarizy, Hung Truong Thanh Nguyen, René Richard +2Mixture-Of-Expert InferenceMixture-of-Experts Models