A Comparative Study of Modern Object Detectors for Robust Apple Detection in Orchard Imagery
Organizations: Dept. of Electronics and Communications Engineering, Delhi Technological University, New Delhi, India
Abstract
Accurate apple detection in orchard images is important for yield prediction, fruit counting, robotic harvesting, and crop monitoring. However, changing illumination, leaf clutter, dense fruit clusters, and partial occlusion make detection difficult. To provide a fair and reproducible comparison, this study establishes a controlled benchmark for single-class apple detection on the public AppleBBCH81 dataset using one deterministic train, validation, and test split and a unified evaluation protocol across six representative detectors: YOLOv10n, YOLO11n, RT-DETR-L, Faster R-CNN (ResNet50-FPN), FCOS (ResNet50-FPN), and SSDLite320 (MobileNetV3-Large). Performance is evaluated primarily using COCO-style [email protected] and [email protected]:0.95, and threshold-dependent behavior is further analyzed using precision-recall curves and fixed-threshold precision, recall, and F1-score at IoU = 0.5. On the validation split, YOLO11n achieves the best strict localization performance with [email protected]:0.95 = 0.6065 and [email protected] = 0.9620, followed closely by RT-DETR-L and YOLOv10n. At a fixed operating point with confidence >= 0.05, YOLOv10n attains the highest F1-score, whereas RT-DETR-L achieves very high recall but low precision because of many false positives at low confidence. These findings show that detector selection for orchard deployment should be guided not only by localization-aware accuracy but also by threshold robustness and the requirements of the downstream task.
Figures & tables
| Study | Main focus | Strength | Limitation relative to this study |
|---|---|---|---|
| DeepFruits [ 10 ] | Deep learning-based fruit detection in orchards | Demonstrated the feasibility of robust learning-based fruit detection in field imagery | Older detection setting; not a controlled benchmark across modern detector families |
| Bargoti and Underwood [ 11 ] | Fruit detection under orchard clutter and occlusion | Highlighted the importance of real orchard conditions, dataset quality, and occlusion handling | Did not provide a unified cross-family benchmark under one evaluation protocol |
| MinneApple [ 12 ] | Apple detection and segmentation dataset | Enabled standardized evaluation on a public apple dataset | Focused on dataset creation; not a controlled comparison of multiple modern detector families on AppleBBCH81 |
| Hani et al. [ 25 ] | Fruit detection versus counting performance | Showed that detection quality and counting quality are related but not identical | Focused on detection and counting objectives rather than detector-family benchmarking under one shared protocol |
| BFPNet [ 15 ] | Small apple detection in complex orchard scenes | Improved small-object recall using a feature-pyramid design | Specialized architecture study rather than a broad detector-family comparison |
| Ma et al. [ 16 ] | Improved YOLO-based detection and counting of small apples | Strong task-specific optimization for challenging environments | Single-architecture focus; limited cross-family comparison |
| Model | Framework | Initialization | Input size | Batch | Epochs | Optimizer | Learning rate |
|---|---|---|---|---|---|---|---|
| YOLOv10n | Ultralytics | COCO pretrained | 640 | 16 | 50 | auto | 0.01 |
| YOLO11n | Ultralytics | COCO pretrained | 640 | 16 | 50 | auto | 0.01 |
| RT-DETR-L | Ultralytics | COCO pretrained | 640 | 16 | 50 | auto | 0.01 |
| Faster R-CNN (R50-FPN) | Torchvision | COCO pretrained | 800 to 1333 | 4 | 10 | AdamW | |
| FCOS (R50-FPN) | Torchvision | COCO pretrained | 800 to 1333 | 4 | 10 | AdamW | |
| SSDLite320 (MobileNetV3-Large) | Torchvision | COCO pretrained | 320 | 4 | 10 | AdamW |
| Family | Model | [email protected]:0.95 | [email protected] |
|---|---|---|---|
| Ultralytics | YOLO11n | 0.6065 | 0.9620 |
| Ultralytics | RT-DETR-L | 0.6012 | 0.9506 |
| Ultralytics | YOLOv10n | 0.5941 | 0.9501 |
| Torchvision | Faster R-CNN (R50-FPN) | 0.5278 | 0.9091 |
| Torchvision | FCOS (R50-FPN) | 0.4926 | 0.8993 |
| Torchvision | SSDLite320 (MobileNetV3-Large) | 0.2125 | 0.5400 |
| Model | TP | FP | FN | PR AUC | Precision | 95% CI | Recall | 95% CI | F1 |
|---|---|---|---|---|---|---|---|---|---|
| YOLO11n | 1465 | 920 | 46 | 0.958 | 0.614256 | [0.594551, 0.633593] | 0.969557 | [0.959632, 0.977099] | 0.752053 |
| RT-DETR-L | 1466 | 5061 | 45 | 0.950 | 0.224605 | [0.214645, 0.234890] | 0.970218 | [0.960383, 0.977669] | 0.364767 |
| YOLOv10n | 1445 | 745 | 66 | 0.947 | 0.659817 | [0.639710, 0.679365] | 0.956320 | [0.944806, 0.965520] | 0.780870 |
| Faster R-CNN (R50-FPN) | 1391 | 717 | 120 | 0.900 | 0.659867 | [0.639368, 0.679784] | 0.920582 | [0.905858, 0.933174] | 0.768721 |
| FCOS (R50-FPN) | 1417 | 1289 | 94 | 0.904 | 0.523651 | [0.504813, 0.542422] | 0.937790 | [0.924465, 0.948893] | 0.672042 |
| SSDLite320 (MobileNetV3-Large) | 1323 | 30213 | 188 | 0.542 | 0.041952 | [0.039795, 0.044221] | 0.875579 | [0.857978, 0.891275] | 0.080068 |