Energy-Aware LLM Inference

LLM: Large Language Model

Ask about this topic

Latest papers

CardsList

37 papers12 papers in the last four weeks, up 300% on the four weeks before. 0.1% of all new papers.

  1. Creating Power Flexibility in Datacenters via Query Routing

    Nov 3, 2026Shivam Patel, Bingqing Chen, Jared Fernandez +2Data Center Energy ManagementEnergy-Aware LLM Inference

    Carnegie Mellon University · Bosch Center for AI · Cornell University

  2. Workload-Static Optical Circuit Switching For Scalable LLM Inference Decode

    Nov 3, 2026Maximilian Thürmer, Nicolas Scotto di Perto, Eloise Stein +6LLM Inference AccelerationParallel LLM Inference

    Salience Labs Ltd, 100 Park Drive, Oxfordshire, OX14 4RY, United Kingdom · NVIDIA Corporation, Santa Clara, CA, USA · Hardware and Artificial Intelligence Lab, Heidelberg University, Germany

  3. The SIMPLE Law for Energy Cost of LLM Inference

    Nov 2, 2026Hiari Pizzini Cavagna, Andrea Proia, Daniele Cesarini +2LLM InferenceEnergy-Aware LLM Inference

    DEI - University of Bologna, Bologna, Italy · DISI - University of Bologna, Bologna, Italy · CINECA, Casalecchio di Reno, Italy

  4. Tug of Watts: A study on the Energy - Accuracy Trade-off of Large Language Models on Medical Question Answering Tasks

    Nov 2, 2026Viju Sudhi, Giulio Billi, Andreea Scrob +2Energy-Aware LLM InferenceLLM Evaluation

    Cluster of Excellence Cognitive Interaction Technology (CITEC), Bielefeld, Germany · Bielefeld University, Bielefeld, Germany · University of Bologna, Bologna, Italy

  5. MedPsy: State-of-the-Art Small Medical Language Models for Efficient Edge Deployment

    Nov 1, 2026Davide Vitabile, Alexandro Buffa, Akshay Nambiar +1Medical LLMsSmall Language Models

    Tether Data, S.A. de C.V. d.b.a. Tether AI Research

  6. LanG 2.0: Energy-Efficient Agentic AI for Semi-Automated Security Operations at Scale

    Oct 29, 2026Anes Abdennebi, Nadjia Kara, Laaziz Lahlou +1CybersecurityLLMs for Cybersecurity

    Department of Software Engineering and IT, École de technologie supérieure (ÉTS), Montreal, QC, Canada · Department of Mathematics and Computer Science, Université du Québec à Trois-Rivières (UQTR), Trois-Rivières, QC, Canada

  7. Only Accepted Tokens Count: An Energy Accounting of Speculative Decoding Under Latency Targets

    Oct 29, 2026Bole Ma, Ayesha Afzal, Jan Eitzinger +2Speculative DecodingEnergy-Aware LLM Inference

    Erlangen National High Performance Computing Center, Erlangen, Germany

  8. The Real Cost of Context: Predicting Compute Time and Energy Consumption in LLM Prefill and Decode Phases

    Oct 29, 2026Lars Krupp, Daniel Geißler, Francisco M. Calatrava-Nicolas +3LLM InferenceEnergy-Aware LLM Inference

    RPTU Kaiserslautern-Landau, DFKI · Örebro University · RPTU Kaiserslautern-Landau

  9. Green Code or Costly Code? Evaluating the Energy Costs of Iterative LLM-Based Code Optimizations

    Oct 23, 2026Sadra Emami, Benjamin Weigell, Mohammad Reza Mousavi +3Large Language Model-Guided OptimizationCode Generation

    University of Augsburg, Augsburg, Germany · King’s College London, London, United Kingdom

  10. Low-Latency MoE Inference in Space Data Centers: A Wireless-Power-Transfer Perspective

    Oct 22, 2026Haotian Zheng, Zhanwei Wang, Kaibin HuangEnergy-Aware LLM InferenceLLM Inference

    Department of Electrical and Computer Engineering, The University of Hong Kong, Hong Kong SAR, China

  11. Joules-to-GDP: How Much Economic Value Do AI Systems Produce per Unit of Energy?

    Oct 22, 2026Amirreza Zeinali, Jon Saad-Falcon, Avanika Narayan +5AI and LaborEnergy-Aware LLM Inference

    Stanford University · University of California, Berkeley · The University of Texas at Austin

  12. The Token-Energy Law of LLM Decode: Active Bytes and Realized Time Account for Joules per Token

    Oct 20, 2026Chenxu Niu, Batuhan Sencer, Wei Zhang +1Energy-Aware LLM InferenceLLM Inference

    NVIDIA Corporation, USA · Texas Tech University, USA · Texas Advanced Computing Center, USA

  13. Tandem: Serving Hybrid Linear-Attention GUI Agents on Mobile NPUs

    Oct 19, 2026Zhuomin Chen, Jingchao Ni, Xu Zheng +4On-Device Language Model InferenceMobile GUI Agents

    Florida International University, Miami, FL, USA · University of Houston, Houston, TX, USA · Independent Researcher +2

  14. ATEST: Adaptive Resource-Aware Test-Time Scaling for LLM Inference

    Oct 18, 2026Mobina Kashaniyan, Ali JannesariTest-Time ScalingEnergy-Aware LLM Inference

    Department of Computer Science Iowa State University, USA

  15. Energy Consumption Analysis of Discrete Diffusion and Autoregressive Language Models

    Oct 14, 2026Boris Ruf, Marcin DetynieckiLLM InferenceEnergy-Aware LLM Inference

    AXA, AI Research Paris, France

  16. Measuring the Inference Energy Efficiency of Open-Weight LLMs across Benchmarks, Reasoning Modes, and Hardware

    Oct 9, 2026Zeyu Yang, Wes ArmourEnergy-Aware LLM InferenceLLM Inference Efficiency

    Department of Engineering Science, University of Oxford

  17. Greenpixie's AI Token Methodology: Assessing the Energy, Water and CO2-eq Impact of AI Tokens for Open and Closed Weight Models

    Sep 27, 2026Joshua Horswill, Ross Hunter, Matt Clifford +1LLM Inference EfficiencyLLM Inference

    Greenpixie Ltd., London, UK.

  18. Measured Joules, Learned Routes: Learning to Route for Energy-Efficient LLM Serving

    Sep 19, 2026Muhammad Abdur Rab Siddiqui, Daniela Rojas, Chen Yang +3Energy-Aware LLM InferenceLLM Routing

    University of Alberta Edmonton, Alberta, Canada · University of California San Diego La Jolla, California, USA · Hong Kong University of Science and Technology (Guangzhou) Guangzhou, China +1

  19. Where Should Agents Live? Energy-Memory Characterization of Agentic AI for the Edge-Cloud Continuum

    Sep 16, 2026Carolina Fortuna, Vid Hanžel, Tim Strnad +1LLM Inference EfficiencyEnergy-Efficient ML

    Department of Communication Systems, Jožef Stefan Institute, Jamova cesta 39, 1000 Ljubljana, Slovenia

  20. Toward Sustainable Distributed LLM Inference: A Systems Synthesis and Research Agenda for an Energy-, Carbon-, and Cache-Aware llm-d Control Plane

    Sep 3, 2026Twinkll SisodiaEnergy-Aware LLM InferenceLLM Inference

  21. How Do Prompt Variations Affect Energy Consumption in On-Device LLMs?

    Sep 1, 2026Wei Hu, Xiaolong Tu, Dawei Chen +3LLM Inference EfficiencyOn-Device Language Model Inference

    Georgia State University · Toyota Motor North America

  22. Characterization of Request and Token Energy Costs for LLM Inference Workloads on GPU Platforms

    Aug 28, 2026Prabhu Vellaisamy, Vanessa Lam, Shawn Blanton +1Energy-Aware LLM InferenceLLM Inference

    Electrical and Computer Engineering Department Carnegie Mellon University Pittsburgh, PA, USA

  23. Understanding the Energy Scaling of Large Language Model Inference Across Context Lengths and Attention Architectures

    Aug 25, 2026Molka Chkir, Syed Muhammad Danish, Jos Höll +1Energy-Aware LLM InferenceLLM Inference Efficiency

    Algoma University, Brampton, Canada · School of Informatics, Reutlingen University, Reutlingen

  24. Multi-Level Modeling of Large Language Model Inference Latency and Energy via Hybrid Analytical--Machine-Learning Predictors

    Aug 7, 2026Saeid Shokoufa, Mohammad Erfan Sadeghi, Mehdi Kamal +1LLM InferenceEnergy-Aware LLM Inference

    University of Southern California Los Angeles, California, USA

  25. From Tokens to Watt-hours: Analytical Energy Estimation for LLM Inference on Modern GPUs

    Jul 29, 2026Tina Vartziotis, Rodopi Kosteli, Elli Vartziotis +5LLM Inference EfficiencyEnergy-Efficient ML

    1National Technical University of Athens, Patission Complex 42, 10682 Athens, Greece · 2Harvard University, 1350 Massachusetts Avenue, 02138 Cambridge, MA, USA · 3TWT GmbH Science & Innovation, Industriestraße 6, 70565 Stuttgart, DE +4

  26. Profiling Lightweight Large Language Models

    Jul 23, 2026Tomohiro Harada, Enrique Alba, Gabriel LuqueLLM Inference EfficiencyLLM Evaluation

    Graduate School of Science and Engineering, Saitama University, Saitama, Japan

  27. Attention to Detail: Evaluating Energy, Performance, and Accuracy Trade-offs Across vLLM Configurations

    Jul 10, 2026Nada Zine, Tristan Coignion, Vincenzo Stoico +3LLM Inference EfficiencyLLM Evaluation

    Univ. Lille, CNRS, Inria · Univ. Bordeaux, CNRS, LaBRI · Vrije Universiteit Amsterdam +1

  28. EnerInfer: Energy-Aware On-Device LLM Inference

    Jun 22, 2026Bohua Zou, Nian Liu, Binqi Sun +6On-Device Language Model InferenceLLM Inference Acceleration

    Technical University of Munich · Shanghai Jiao Tong University · Huawei Hilbert Research Center (Dresden) +1

  29. ModeSwitch-LLM: A Lightweight Phase-Aware Controller for Cross-Mode LLM Inference on a Single GPU

    May 21, 2026Aman Sunesh, Ali Alshehhi, Hivansh DhakneLLM InferenceLLM Serving

    Department of Computer Engineering NYU Abu Dhabi Abu Dhabi, United Arab Emirates · Courant Institute of Mathematical Sciences New York University New York, United States · Department of Computer Engineering New York University New York, United States

  30. EnergyLens: Predictive Energy-Aware Exploration for Multi-GPU LLM Inference Optimization

    May 14, 2026Zhiye Song, Kyungmi Lee, Eun Kyung Lee +3LLM Inference EfficiencyEnergy-Efficient ML

    Massachusetts Institute of Technology Cambridge, MA 02139 · IBM Research Yorktown Heights, NY 10598