Tracking Phenological Status and Ecological Interactions in a Hawaiian Cloud Forest Understory using Low-Cost Camera Traps and Visual Foundation Models
Authors: Luke Meyers, Anirudh Potlapally, Yuyan Chen, Mike Long, Tanya Berger-Wolf, Hari Subramoni, Remi Megret, Daniel Rubenstein
Organizations: Computer Science, The University of Puerto Rico Rio Piedras, San Juan, Puerto Rico · Computer Science, The Ohio State University, Columbus, Ohio, USA · Computer Science, McGill University, Montreal, Quebec, Canada · Battele Ecology, Neon Domain 20, Hilo, Hawaii · Ecology, Princeton University, Princeton, New Jersey, USA
Plant phenology, the study of cyclical events such as leafing out, flowering, or fruiting, has wide ecological impacts but is broadly understudied, especially in the tropics. Image analysis has greatly enhanced remote phenological monitoring, yet capturing phenology at the individual level remains challenging. In this project, we deployed low-cost, animal-triggered camera traps at the Pu'u Maka'ala Natural Area Reserve in Hawaii to simultaneously document shifts in plant phenology and flora-faunal interactions. Using a combination of foundation vision models and traditional computer vision methods, we measure phenological trends from images comparable to on-the-ground observations without relying on supervised learning techniques. These temporally fine-grained phenology measurements from camera-trap images uncover trends that coarser traditional sampling fails to detect. When combined with detailed visitation data detected from images, these trends can begin to elucidate drivers of both plant phenology and animal ecology.
Figures & tables
Figure 1: Top Left: Crop showing an ’amakihi ( Chlorodrepanis virens ) visiting an ohelo flower. Bottom Left: An ’omao ( Myadestes obscurus ) consuming a pukiawe berry. Right: Camera-trap setup—tripod and cinderblock-mounted—targeting a Rubus hawaiiensis individual along NEON’s phenology transect. Below: Mini-overview of general workflow.
Figure 2: Canopy Leaf Cover Estimation (a) Raw image of the focal plant against a complex background, making individual leaf counts difficult. (b) Depth map from DepthPro; applying a 2 m threshold isolates the plant foreground. (c) Extracted foreground showing only the focal plant with background removed. (d) Segmented leaves obtained by converting the foreground to LAB space and isolating green-chromaticity pixels.
Figure 3: Change in greenness of Ohelo (Vaccinium calycinum) canopy. Top: NEON manual canopy-cover estimates and our method’s greenness estimates for specimen 06367 on the PUUM phenology transect. Bottom: NEON observations and our greenness estimates for specimen 06371. The strong correspondence between methods demonstrates that our approach accurately captures the trends recorded by NEON scientists.
Figure 4: Avian Visitors and Berry Count Estimates of Pukiawe through Time . Top: Number of bird visits at specimen 06090 on the Phenology Transect. Middle: Manual berry counts by NEON scientists for specimen 06090. Bottom: Berry counts estimated by our computer vision model.
Figure 5: UMAP visualization of BioCLIP features of positive detection crops at Camera 02 and 26, non-bird and false positive bird are MegaDetector final predictions, species labels annotated by hand
Figure 6: Avian visitors and open-flower counts for Ohelo (Vaccinium calycinum) specimens over time. Top & Third: Bird visits at specimens 06367 and 06371 on the Phenology Transect, colored by species. "Visits with missed detections" are visits where OWLv2 missed frames, while "missed visits" failed to be detected entirely. Second & Bottom: Manual open-flower counts by NEON scientists for specimens 06367 and 06371, respectively.
Department of Computing, Federal University of São Carlos (UFSCar), Sorocaba, 18052-780, Brazil · Center for Research on Biodiversity Dynamics and Climate Change and Department of Biodiversity, Bioscience Institute, São Paulo State University (UNESP), Rio Claro, 13506-900, Brazil · Wageningen University & Research (WUR), Wageningen, 6708PB, Netherlands