Energy Measurement and Optimization of TinyML in Resource-Constrained Embedded Systems: A Systematic Mapping Study
Organizations: Federal Rural University of Pernambuco (UFRPE), Recife, Pernambuco, Brazil . · Federal University of Alagoas (UFAL), Maceió, Alagoas, Brazil . · Western Sydney University, Sydney, New South Wales, Australia .
Abstract
The rapid expansion of the Internet of Things (IoT) has increased the volume of data generated at the network edge, where many devices operate under severe memory, processing, and energy constraints. In this context, Tiny Machine Learning (TinyML) enables machine learning (ML) tasks to be executed on microcontrollers, smart sensors, and other resource-constrained platforms. However, the literature remains heterogeneous regarding the algorithms evaluated, energy-measurement methods, reported metrics, influencing factors, and optimization strategies. This study presents a systematic mapping of energy-aware TinyML research. It identifies the main models and learning approaches, classifies energy-evaluation methodologies and metrics, examines the technical factors affecting energy consumption, and organizes the reported optimization techniques into a structured taxonomy. The findings highlight the frequent use of convolutional and lightweight architectures, direct measurements and analytical estimations, and factors related to model architecture, hardware, communication, numerical precision, and input characteristics. The optimization strategies were grouped into model compression, hardware-aware design, system and communication optimization, and data and processing optimization. The results also reveal limited standardization in experimental platforms, measurement procedures, and reporting practices, limiting reproducibility and direct comparison across studies. This mapping provides an updated overview of the field and guidance for developing and evaluating more energy-efficient TinyML solutions.
Figures & tables
| Year | Study | Focus | Main characteristics |
|---|---|---|---|
| 2024 | Capogrosso et al. Capogrosso et al. (2024) | TinyML learning techniques | Learning techniques, hardware platforms, optimization strategies, applications, and challenges. |
| 2025 | Silva and Prazeres da Silva and Prazeres (2025) | Tiny Federated Learning | TinyFL on constrained devices, aggregation algorithms, compression methods, frameworks, and low-power platforms. |
| 2021 | Dutta and Bharali Dutta and Bharali (2021) | TinyML for IoT | Local processing, reduced cloud dependence, latency, privacy, cost, energy savings, and model compression. |
| 2025 | Arif and Rashid Arif and Rashid (2025) | EdgeML and TinyML | Model conversion, inference mechanisms, learning strategies, latency, energy consumption, and accuracy. |
| 2023 | Abadade et al. Abadade et al. (2023) | TinyML applications | Applications in healthcare, agriculture, environment, and anomaly detection; energy efficiency as a secondary aspect. |
| 2024 | Kallimani et al. Kallimani et al. (2024) | TinyML tools and challenges | Foundations, frameworks, platforms, applications, challenges, and metrics such as accuracy, latency, memory, and energy. |
| Exclusion Criteria | Articles Excluded |
|---|---|
| Proceedings volumes/editorial records | 74 |
| Articles Missing TinyML and/or Energy Consumption Analysis | 54 |
| Articles that are Surveys | 53 |
| Books or book chapters | 12 |
| Published outside the 2020–2025 period | 6 |
| Duplicated | 3 |
| Database | Original | After Criteria |
|---|---|---|
| ACM Digital Library | 84 | 2 |
| IEEE Digital Library | 2 | 0 |
| IEEE Digital Library (supplementary search) 1 1 1 Search without the term “measurement”. Two additional records were duplicates of studies already included. | 19 | 2 |
| ScienceDirect | 63 | 11 |
| Scopus | 25 | 8 |
| Springer Link | 35 | 2 |
| Study | Application / Task | Algorithm / Family | Deployment Aspect |
|---|---|---|---|
| Amin et al. (2023) | Robotic hardness classification | CNN , SVM , SLFNN / CNN , classical ML , neural network | Input-size reduction, memory-aware implementation, and inference optimization |
| Nooruddin et al. (2023) | Video-based HAR ( HAR ) | Two-stream multi-resolution CNN / CNN | PTQ ( PTQ ) and QAT ( QAT ) for deployment on tiny edge devices |
| Sabovic et al. (2023) | Battery-less person detection | MobileNet V1 for local and cloud inference / lightweight CNN and edge-cloud ML | Energy-aware local/remote inference selection |
| Raza et al. (2023) | Glass fill-level estimation | CNN / convolutional neural network | Edge inference to reduce NBIoT ( NBIoT ) traffic and sensor energy consumption |
| Arratia et al. (2024) | Ephemeral stream monitoring | TinyML vision model / CNN image classifier | Adaptive edge retraining to reduce energy and retraining time |
| Arratia et al. (2025) | Streamflow monitoring | TinyML image classifiers / CNN -based classifiers | Model selection based on accuracy, memory, and inference cost |
| Measurement Methodology | Representative Studies | Reported Energy / Resource Metrics | Main Characteristics and Limitations |
|---|---|---|---|
| Direct measurement | Nooruddin et al. (2023) ; Alwaisi et al. (2024) ; Hammad et al. (2023) ; Al-Ameen et al. (2023) ; Cortesi et al. (2024) ; Sabovic et al. (2023) ; Gamazo-Real et al. (2023) ; Mnif et al. (2024a) ; Arratia et al. (2024) ; Lenka and Chakraborty (2025) ; Piechocki et al. (2022) ; Villegas-Ch et al. (2024) | Current, voltage, power, energy consumption, energy per inference, energy per work cycle, memory usage, execution time | Provides the most realistic assessment because it captures device-level consumption during execution. However, it requires measurement instruments, careful experimental setup, and hardware-specific procedures. |
| Analytical estimation | Amin et al. (2023) ; Zheng et al. (2024) ; Arratia et al. (2025) ; Alshuhail et al. (2025) ; Alshuhail et al. (2025) | Estimated energy, power-time product, computation cost, communication cost, training or inference time | Easier to apply and useful when direct instrumentation is unavailable. However, accuracy depends on the assumptions, equations, and reliability of current, voltage, and timing estimates. |
| Inference-time-based estimation | Bian et al. (2022) ; Wang et al. (2020) ; Nooruddin et al. (2023) ; Mnif et al. (2024b) ; Raza et al. (2023) | Inference time, latency, energy per inference, power consumption | Useful for comparing deployment efficiency across algorithms and platforms. However, it may oversimplify energy behavior when power varies dynamically during execution. |
| Simulation and modeling | Giordano et al. (2024) ; Raha et al. (2025) | Energy per inference, latency, area, forward progress, energy benefits | Enables design-space exploration before physical deployment. However, results depend on modeling assumptions and may differ from real-world measurements. |
| Not reported or unclear | Giordano et al. (2023) ; Sanlı (2025) | N/R | Limits reproducibility and makes comparison with other TinyML deployments difficult. |
| Metric Group | Metrics | Purpose in TinyML Evaluation | Interpretation for Resource-Constrained Devices |
|---|---|---|---|
| Energy and power metrics | Energy consumption, power consumption, energy per inference | Measure the energy cost of executing a model or system task | Essential for estimating battery lifetime, feasibility of deployment, and suitability for energy-harvesting or low-power devices |
| Timing metrics | Inference time, latency, execution time, training time, response time | Measure how long the model takes to process data or complete training/inference | Important for real-time applications, where delayed inference can compromise responsiveness or safety |
| Predictive performance metrics | Accuracy, F1-score, precision, recall, Kappa score | Measure the predictive quality of the model | Necessary to evaluate whether energy savings are achieved without unacceptable degradation in model performance |
| Memory and model footprint metrics | Memory usage, RAM ( RAM ), flash, model size | Measure the storage and runtime memory requirements of the model | Critical for deployment on MCU and edge devices with limited RAM , flash, and computational capacity |
| Regression and error metrics | MAE , mean squared error, RMSE | Measure numerical prediction or estimation errors | Relevant for sensing, imputation, density estimation, and environmental estimation tasks where outputs are continuous values rather than classes |
| System-level efficiency metrics | Speedup, forward progress, communication cost | Measure broader execution efficiency beyond model accuracy | Useful for comparing hardware acceleration, distributed execution, intermittent computing, and edge-cloud trade-offs |
| Technical Factor | Examples Identified in the Studies | Energy-Related Impact | Representative Studies |
|---|---|---|---|
| Hardware architecture | MCU type, processor architecture, accelerators, memory hierarchy, heterogeneous or parallel platforms | Determines how efficiently operations are executed and how much energy is spent on computation and memory access | Giordano et al. (2024) ; Bian et al. (2022) ; Wang et al. (2020) ; Raha et al. (2025) ; Lenka and Chakraborty (2025) ; Piechocki et al. (2022) |
| Model architecture | Model type, number of parameters, number of operations, model size, inference runs, layer organization | More complex models can increase computation, memory access, latency, and energy per inference | Amin et al. (2023) ; Nooruddin et al. (2023) ; Mnif et al. (2024a) ; Al-Ameen et al. (2023) ; Arratia et al. (2025) ; Raha et al. (2025) |
| Communication method | BLE , NBIoT , Wi-Fi, LoRa, edge-cloud transmission, federated updates, UAV communication | Communication can dominate energy consumption, especially when raw data or model updates are transmitted frequently | Cortesi et al. (2024) ; Sabovic et al. (2023) ; Zheng et al. (2024) ; Sanlı (2025) ; Raza et al. (2023) ; Villegas-Ch et al. (2024) |
| Frequency and timing parameters | Processor clock, sampling frequency, CPU timing, inference latency, task execution time, duty-cycle duration | Higher frequency may reduce latency but can increase instantaneous power consumption and total energy depending on workload duration | Bian et al. (2022) ; Giordano et al. (2024) ; Raha et al. (2025) ; Alshuhail et al. (2025) ; Arratia et al. (2025) ; Piechocki et al. (2022) |
| Quantization and precision | 8-bit arithmetic, binary precision, quantized neural networks, PTQ , QAT , and quantized TensorFlow Lite models | Reduces memory footprint, arithmetic cost, and data movement, often lowering inference energy with limited accuracy loss | Nooruddin et al. (2023) ; Mnif et al. (2024b) ; Raha et al. (2025) ; Lenka and Chakraborty (2025) ; Hammad et al. (2023) ; Villegas-Ch et al. (2024) |
| Input data characteristics | Image resolution, input size, sensor sampling, window size, data dimensionality | Larger inputs increase memory access, processing time, and number of operations, while reduced inputs can lower energy consumption | Amin et al. (2023) ; Nooruddin et al. (2023) ; Gamazo-Real et al. (2023) ; Arratia et al. (2025) ; Arratia et al. (2024) |
| Category | Subcategory | Key Techniques | Representative Studies |
| Model Compression | Quantization | PTQ, QAT, integer quantization, and binary quantization | Nooruddin et al. (2023) ; Bian et al. (2022) ; Mnif et al. (2024a) ; Mnif et al. (2024b) ; Raha et al. (2025) ; Alshuhail et al. (2025) ; Hammad et al. (2023) ; Lenka and Chakraborty (2025) ; Piechocki et al. (2022) ; Villegas-Ch et al. (2024) |
| Pruning | Structured and unstructured pruning | Mnif et al. (2024a) ; Alshuhail et al. (2025) ; Lenka and Chakraborty (2025) ; Villegas-Ch et al. (2024) | |
| Knowledge Distillation | Teacher–student frameworks | Mnif et al. (2024a) | |
| Weight Clustering | Weight sharing and pruning–clustering combinations | Lenka and Chakraborty (2025) | |
| Hardware-Aware Design | Architecture and Memory Design | Memory configurations, compute-in-memory, and Pareto-optimal design | Giordano et al. (2024) ; Raha et al. (2025) |
| Parallel and Hardware-Aware Execution | Parallel execution, specialized processors, and hardware acceleration | Bian et al. (2022) ; Mnif et al. (2024b) ; Wang et al. (2020) |
| Challenge area | Current limitations | Future research directions |
|---|---|---|
| Standardized energy measurement and benchmarking | Lack of common datasets, workloads, measurement setups, hardware configurations, and reporting protocols, which hinders reproducibility and comparison across studies. | Define benchmark suites and reporting guidelines that jointly capture energy consumption, latency, memory usage, accuracy, hardware configuration, and measurement conditions. |
| Energy–accuracy–latency trade-offs | More complex models may improve accuracy but usually increase computational cost, latency, memory footprint, and energy consumption. | Develop multi-objective optimization methods that explicitly balance energy per inference, accuracy, latency, and memory usage across devices and applications. |
| Model compression and integrated optimization pipelines | Quantization, pruning, knowledge distillation, and architectural simplification are often evaluated separately, making their combined energy impact unclear. | Investigate integrated optimization pipelines and quantify how each optimization step affects energy consumption, accuracy, latency, and hardware behavior. |
| Hardware-dependent behavior and portability | Energy consumption varies across MCU architectures, accelerators, memory hierarchies, clock frequencies, sensors, and communication interfaces. | Develop hardware-aware and hardware-adaptive deployment methods that improve portability across heterogeneous platforms and reduce manual tuning. |
| Automation in model selection and energy-aware tuning | TinyML models often require manual design, compression, and parameter tuning to satisfy device-specific constraints. | Extend TinyML AutoML and hardware-aware neural architecture search methods to include energy, memory, and latency constraints during model selection. |
| Communication-aware TinyML deployment | Communication for event reporting, cloud interaction, model updates, federated learning, or IoT coordination may dominate energy consumption. | Jointly optimize sensing, inference, transmission, duty cycling, and sleep scheduling in TinyML - IoT deployments. |
Tiny ML
Tiny machine learning (TinyML) brings machine-learning inference and learning to low-power devices with limited memory and compute.
See all 56 papers