Multimodal Object Detection Under Sparse Forest-Canopy Occlusion
Authors: Nitik Jain, Mangal Kothari
Organizations: Robotics & AI, Johns Hopkins University, USA. This research was carried out entirely while the author was with the Department of Aerospace Engineering, IIT Kanpur. · This research was carried out entirely while the author was with the Department of Aerospace Engineering, IIT Kanpur. · Senior Principal Flight Control Engineer, ADASI, EDGE Group, Abu Dhabi, UAE. This research was carried out entirely while the author was with the Department of Aerospace Engineering, IIT Kanpur.
Reliable detection of humans beneath forest canopy remains a difficult remote-sensing challenge due to sparse, structured, and viewpoint-dependent occlusion. This paper presents a multimodal proof-of-concept pipeline that integrates three complementary approaches: (i) experimental evaluation of LiDAR returns through vegetation to assess the feasibility of active sensing, (ii) visible--thermal image fusion using a multi-scale transform and sparse-representation framework to enhance human saliency, and (iii) synthetic-aperture image formation via Airborne Optical Sectioning (AOS) to suppress canopy clutter. A YOLOv5 detector is fine-tuned on the Teledyne FLIR thermal dataset and evaluated on thermal and fused imagery. Results show that the tested terrestrial LiDAR configuration provides limited penetration for object-level detection, while visible--thermal fusion improves target visibility in low-contrast scenes and AOS enhances ground-plane detection in synthetic forest imagery. The fine-tuned YOLOv5 achieves a mean average precision of ∼0.83 on the top three FLIR classes. These findings establish an initial baseline for UAV-deployable search-and-rescue and surveillance systems operating in forested environments, and motivate future work on dedicated forest datasets and real-time multimodal integration.