Energy-Aware LLM Inference

LLM: Large Language Model

Ask about this topic

Latest papers

CardsList

25 papers4 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.

  1. Tandem: Serving Hybrid Linear-Attention GUI Agents on Mobile NPUs

    Oct 19, 2026Zhuomin Chen, Jingchao Ni, Xu Zheng +4On-Device Language Model InferenceMobile GUI Agents

    Florida International University, Miami, FL, USA · University of Houston, Houston, TX, USA · Independent Researcher +2

  2. ATEST: Adaptive Resource-Aware Test-Time Scaling for LLM Inference

    Oct 18, 2026Mobina Kashaniyan, Ali JannesariTest-Time ScalingEnergy-Aware LLM Inference

    Department of Computer Science Iowa State University, USA

  3. Energy Consumption Analysis of Discrete Diffusion and Autoregressive Language Models

    Oct 14, 2026Boris Ruf, Marcin DetynieckiLLM InferenceEnergy-Aware LLM Inference

    AXA, AI Research Paris, France

  4. Measuring the Inference Energy Efficiency of Open-Weight LLMs across Benchmarks, Reasoning Modes, and Hardware

    Oct 9, 2026Zeyu Yang, Wes ArmourEnergy-Aware LLM InferenceLLM Inference Efficiency

    Department of Engineering Science, University of Oxford

  5. Greenpixie's AI Token Methodology: Assessing the Energy, Water and CO2-eq Impact of AI Tokens for Open and Closed Weight Models

    Sep 27, 2026Joshua Horswill, Ross Hunter, Matt Clifford +1LLM Inference EfficiencyLLM Inference

    Greenpixie Ltd., London, UK.

  6. Measured Joules, Learned Routes: Learning to Route for Energy-Efficient LLM Serving

    Sep 19, 2026Muhammad Abdur Rab Siddiqui, Daniela Rojas, Chen Yang +3Energy-Aware LLM InferenceLLM Routing

    University of Alberta Edmonton, Alberta, Canada · University of California San Diego La Jolla, California, USA · Hong Kong University of Science and Technology (Guangzhou) Guangzhou, China +1

  7. Where Should Agents Live? Energy-Memory Characterization of Agentic AI for the Edge-Cloud Continuum

    Sep 16, 2026Carolina Fortuna, Vid Hanžel, Tim Strnad +1LLM Inference EfficiencyEnergy-Efficient ML

    Department of Communication Systems, Jožef Stefan Institute, Jamova cesta 39, 1000 Ljubljana, Slovenia

  8. Toward Sustainable Distributed LLM Inference: A Systems Synthesis and Research Agenda for an Energy-, Carbon-, and Cache-Aware llm-d Control Plane

    Sep 3, 2026Twinkll SisodiaEnergy-Aware LLM InferenceLLM Inference

  9. How Do Prompt Variations Affect Energy Consumption in On-Device LLMs?

    Sep 1, 2026Wei Hu, Xiaolong Tu, Dawei Chen +3LLM Inference EfficiencyOn-Device Language Model Inference

    Georgia State University · Toyota Motor North America

  10. Characterization of Request and Token Energy Costs for LLM Inference Workloads on GPU Platforms

    Aug 28, 2026Prabhu Vellaisamy, Vanessa Lam, Shawn Blanton +1Energy-Aware LLM InferenceLLM Inference

    Electrical and Computer Engineering Department Carnegie Mellon University Pittsburgh, PA, USA

  11. Understanding the Energy Scaling of Large Language Model Inference Across Context Lengths and Attention Architectures

    Aug 25, 2026Molka Chkir, Syed Muhammad Danish, Jos Höll +1Energy-Aware LLM InferenceLLM Inference Efficiency

    Algoma University, Brampton, Canada · School of Informatics, Reutlingen University, Reutlingen

  12. Multi-Level Modeling of Large Language Model Inference Latency and Energy via Hybrid Analytical--Machine-Learning Predictors

    Aug 7, 2026Saeid Shokoufa, Mohammad Erfan Sadeghi, Mehdi Kamal +1LLM InferenceEnergy-Aware LLM Inference

    University of Southern California Los Angeles, California, USA

  13. From Tokens to Watt-hours: Analytical Energy Estimation for LLM Inference on Modern GPUs

    Jul 29, 2026Tina Vartziotis, Rodopi Kosteli, Elli Vartziotis +5LLM Inference EfficiencyEnergy-Efficient ML

    1National Technical University of Athens, Patission Complex 42, 10682 Athens, Greece · 2Harvard University, 1350 Massachusetts Avenue, 02138 Cambridge, MA, USA · 3TWT GmbH Science & Innovation, Industriestraße 6, 70565 Stuttgart, DE +4

  14. Profiling Lightweight Large Language Models

    Jul 23, 2026Tomohiro Harada, Enrique Alba, Gabriel LuqueLLM Inference EfficiencyLLM Evaluation

    Graduate School of Science and Engineering, Saitama University, Saitama, Japan

  15. Attention to Detail: Evaluating Energy, Performance, and Accuracy Trade-offs Across vLLM Configurations

    Jul 10, 2026Nada Zine, Tristan Coignion, Vincenzo Stoico +3LLM Inference EfficiencyLLM Evaluation

    Univ. Lille, CNRS, Inria · Univ. Bordeaux, CNRS, LaBRI · Vrije Universiteit Amsterdam +1

  16. EnerInfer: Energy-Aware On-Device LLM Inference

    Jun 22, 2026Bohua Zou, Nian Liu, Binqi Sun +6On-Device Language Model InferenceLLM Inference Acceleration

    Technical University of Munich · Shanghai Jiao Tong University · Huawei Hilbert Research Center (Dresden) +1

  17. ModeSwitch-LLM: A Lightweight Phase-Aware Controller for Cross-Mode LLM Inference on a Single GPU

    May 21, 2026Aman Sunesh, Ali Alshehhi, Hivansh DhakneLLM InferenceLLM Serving

    Department of Computer Engineering NYU Abu Dhabi Abu Dhabi, United Arab Emirates · Courant Institute of Mathematical Sciences New York University New York, United States · Department of Computer Engineering New York University New York, United States

  18. EnergyLens: Predictive Energy-Aware Exploration for Multi-GPU LLM Inference Optimization

    May 14, 2026Zhiye Song, Kyungmi Lee, Eun Kyung Lee +3LLM Inference EfficiencyEnergy-Efficient ML

    Massachusetts Institute of Technology Cambridge, MA 02139 · IBM Research Yorktown Heights, NY 10598

  19. MARLIN: Multi-Agent Game-Theoretic Reinforcement Learning for Sustainable LLM Inference in Cloud Datacenters

    May 13, 2026H. Moore, S. Qi, D. Milojicic +2LLM ServingLLM Inference

    Colorado State University Fort Collins, CO, USA · Hewlett Packard Labs Milpitas, CA, USA

  20. EnergyLens: Interpretable Closed-Form Energy Models for Multimodal LLM Inference Serving

    May 11, 2026Vittorio Palladino, Gianluca Palermo, Michael E. Papka +1Efficient Multimodal InferenceLLM Inference

    Politecnico di Milano & UIC · Politecnico di Milano · University of Illinois Chicago

  21. LLM-Guided Runtime Parameter Optimization for Energy-Efficient Model Inference

    Apr 29, 2026Katelyn Crumpacker, Dimitrios NikolopoulosLLM Inference EfficiencyEnergy-Efficient ML

    Virginia Polytechnic and State University

  22. Watt Counts: Energy-Aware Benchmark for Sustainable LLM Inference on Heterogeneous GPU Architectures

    Apr 10, 2026Mauricio Fadel Argerich, Jonathan Fürst, Marta Patiño-MartínezEnergy-Aware LLM InferenceLLM Inference Efficiency

    Universidad Politécnica de Madrid, C. de los Ciruelos, Boadilla del Monte, 28660, Madrid, Spain · Zurich University of Applied Sciences, Switzerland, Gertrudstrasse 15, Winterthur, 8400, Zurich, Switzerland

  23. This Is Taking Too Long -- Investigating Time as a Proxy for Energy Consumption of LLMs

    Mar 16, 2026Lars Krupp, Daniel Geißler, Francisco M. Calatrava-Nicolas +3Energy-Aware LLM InferenceLLM Inference

    Embedded Intelligence DFKI and RPTU Kaiserslautern, Germany · Centre for Applied Autonomous Sensor Systems (AASS) Örebro University Örebro, Sweden

  24. The Compression Paradox in LLM Inference: Provider-Dependent Energy Effects of Prompt Compression

    Mar 6, 2026Warren JohnsonLLM Inference EfficiencyEnergy-Aware LLM Inference

    Plexor Labs Principal Researcher

  25. Beyond Test-Time Compute Strategies: Advocating Energy-per-Token in LLM Inference

    Mar 4, 2026Patrick Wilhelm, Thorsten Wittkopp, Odej KaoEnergy-Aware LLM InferenceLLM Inference Efficiency

    BIFOLD, Technische Universität Berlin, Berlin, Germany