YOLOF-MLD: A Multi-Level Distillation Framework for Efficient Object Detection
Organizations: The Chinese University of Hong Kong (Shenzhen), Shenzhen, Guangdong, 518172, P.R. China · The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong SAR, China
Abstract
Efficient object detection on resource-constrained edge devices is essential for safety-critical applications such as fire-smoke monitoring. However, current lightweight frameworks, such as YOLO26, still rely on the parameter-dense multi-branch Feature Pyramid Network (FPN), preventing full exploitation of their lightweight advantage. Replacing FPN with YOLOF's single-input-single-output (SiSo) neck is a promising solution but causes substantial accuracy loss. To alleviate this, we propose YOLOF-MLD, a CPU-efficient multi-level distillation (MLD) framework that combines a YOLO26n backbone, a SiSo neck, and MLD. It aligns features at the backbone via sliced-semantics matching, neck with receptive-field matching, and response levels. On D-Fire and Annotated Fire-Smoke (AFS) datasets, YOLOF-MLD reduces the parameter count of YOLO26n by 35.7% and achieves a 62.3% speedup on Raspberry Pi 5, attaining 71.6% and 59.9% mAP@50, respectively, compared with 75.5% and 60.0% for YOLO26n. These results demonstrate a competitive accuracy--latency trade-off for edge deployment. Our code is available at https://github.com/XiaolongWU111/YOLOF---MLD/blob/main/README.md.
Figures & tables
| Model | Param. | FPS (Avg) | D-Fire [14] | AFS [16] | |||
| Raspberry Pi | Intel CPU | mAP50 | mAP50-95 | mAP50 | mAP50-95 | ||
| TN-YOLOv3 [ 4 ] | 12.13M | 3.79 | 15.81 | 71.5 | 37.1 | 54.7 | 28.3 |
| NanoDet-m-0.5x [ 2 ] | 0.26M | 26.23 | 97.67 | 70.8 | 33.5 | 56.2 | 27.2 |
| NanoDet-plus-m [ 2 ] | 1.17M | 9.60 | 40.67 | 77.8 | 43.9 | 56.4 | 32.1 |
| YOLOX-nano [ 11 ] | 0.90M | 10.06 | 49.58 | 72.2 | 41.1 | 57.8 | 32.0 |
| YOLO26n [ 9 ] | 2.38M | 7.86 | 33.92 | 75.5 | 43.4 | 60.0 | 33.5 |
| Method | D-Fire [ 14 ] | AFS [ 15 ] | ||
| mAP50 | mAP50-95 | mAP50 | mAP50-95 | |
| Baseline 1 | 69.8 | 37.8 | 58.8 | 31.6 |
| GID [ 5 ] | 70.0 (+0.2) | 37.8 (+0.0) | 58.2 (-0.6) | 31.7 (+0.1) |
| SKD [ 6 ] | 70.3 (+0.5) | 37.3 (-0.5) | 60.3 (+1.5) | 32.4 (+0.8) |
| GKD [ 12 ] | 69.5 (-0.3) | 36.4 (-1.4) | 55.8 (-3.0) | 29.5 (-2.1) |
| CrossKD [ 7 ] | 70.2 (+0.4) | 38.0 (+0.2) | 59.2 (+0.4) | 31.7 (+0.1) |
Efficient Object Detection
Efficient object detection reduces the computation, latency, memory, and energy needed to find and locate objects in images and video.
See all 99 papers