Energy-Aware LLM Inference

LLM: Large Language Model

Ask about this topic

Latest papers

CardsList

39 papers16 papers in the last four weeks, up 300% on the four weeks before. 0.1% of all new papers.

  1. ModeSwitch-LLM: A Lightweight Phase-Aware Controller for Cross-Mode LLM Inference on a Single GPU

    May 21, 2026Aman Sunesh, Ali Alshehhi, Hivansh DhakneLLM InferenceLLM Serving

    Department of Computer Engineering NYU Abu Dhabi Abu Dhabi, United Arab Emirates · Courant Institute of Mathematical Sciences New York University New York, United States · Department of Computer Engineering New York University New York, United States

  2. EnergyLens: Predictive Energy-Aware Exploration for Multi-GPU LLM Inference Optimization

    May 14, 2026Zhiye Song, Kyungmi Lee, Eun Kyung Lee +3LLM Inference EfficiencyEnergy-Efficient ML

    Massachusetts Institute of Technology Cambridge, MA 02139 · IBM Research Yorktown Heights, NY 10598

  3. MARLIN: Multi-Agent Game-Theoretic Reinforcement Learning for Sustainable LLM Inference in Cloud Datacenters

    May 13, 2026H. Moore, S. Qi, D. Milojicic +2LLM ServingLLM Inference

    Colorado State University Fort Collins, CO, USA · Hewlett Packard Labs Milpitas, CA, USA

  4. EnergyLens: Interpretable Closed-Form Energy Models for Multimodal LLM Inference Serving

    May 11, 2026Vittorio Palladino, Gianluca Palermo, Michael E. Papka +1Efficient Multimodal InferenceLLM Inference

    Politecnico di Milano & UIC · Politecnico di Milano · University of Illinois Chicago

  5. LLM-Guided Runtime Parameter Optimization for Energy-Efficient Model Inference

    Apr 29, 2026Katelyn Crumpacker, Dimitrios NikolopoulosLLM Inference EfficiencyEnergy-Efficient ML

    Virginia Polytechnic and State University

  6. Watt Counts: Energy-Aware Benchmark for Sustainable LLM Inference on Heterogeneous GPU Architectures

    Apr 10, 2026Mauricio Fadel Argerich, Jonathan Fürst, Marta Patiño-MartínezEnergy-Aware LLM InferenceLLM Inference Efficiency

    Universidad Politécnica de Madrid, C. de los Ciruelos, Boadilla del Monte, 28660, Madrid, Spain · Zurich University of Applied Sciences, Switzerland, Gertrudstrasse 15, Winterthur, 8400, Zurich, Switzerland

  7. This Is Taking Too Long -- Investigating Time as a Proxy for Energy Consumption of LLMs

    Mar 16, 2026Lars Krupp, Daniel Geißler, Francisco M. Calatrava-Nicolas +3Energy-Aware LLM InferenceLLM Inference

    Embedded Intelligence DFKI and RPTU Kaiserslautern, Germany · Centre for Applied Autonomous Sensor Systems (AASS) Örebro University Örebro, Sweden

  8. The Compression Paradox in LLM Inference: Provider-Dependent Energy Effects of Prompt Compression

    Mar 6, 2026Warren JohnsonLLM Inference EfficiencyEnergy-Aware LLM Inference

    Plexor Labs Principal Researcher

  9. Beyond Test-Time Compute Strategies: Advocating Energy-per-Token in LLM Inference

    Mar 4, 2026Patrick Wilhelm, Thorsten Wittkopp, Odej KaoEnergy-Aware LLM InferenceLLM Inference Efficiency

    BIFOLD, Technische Universität Berlin, Berlin, Germany