Reliable Tree Recruitment from Scarce Annotations for Forest Inventory Expansion
Authors: Luiz Fernando Souza Luz, Pedro J. Soto Vega, Matheus Pinheiro Ferreira, Laura Elena Cué la Rosa, Hudson Franklin Pessoa Veras, Ernandes Macedo da Cunha Neto, Evandro Orfanó Figueiredo, Ana Paula Dalla Corte, Carlos Roberto Sanquetta, José Matheus Segre Moneva Viveiros, Matheus Santos Fuza, Heitor Eduardo Ferreira Campos Morato Filpi, Cristiano Vinícius Vidal, Vinícius Moura Costa, Débora Nascimento Rosário, Danilo Roberti Alves de Almeida, Paulo Guilherme Molin, Dário Augusto Borges Oliveira
Organizations: School of Applied Mathematics, Getulio Vargas Foundation, Rio de Janeiro, RJ, Brazil. · Department of Forest Sciences, “Luiz de Queiroz” College of Agriculture, University of São Paulo (USP/ESALQ), Piracicaba, SP, Brazil. · Laboratory of Geo-Information Science and Remote Sensing, Wageningen University and Research, Wageningen, The Netherlands. · Instituto Federal do Acre, Rio Branco, AC, Brazil. · Department of Forest Science, Federal University of Paraná (UFPR), Curitiba, PR, Brazil. · Embrapa Acre, Rio Branco, AC, Brazil. · Department of Forest Sciences, University of São Paulo (USP/ESALQ), Piracicaba, SP, Brazil. · Bioflore, Belo Horizonte, MG, Brazil. · Department of Agricultural Engineer, Federal University of Viçosa, Viçosa, Brazil. · Center for Natural Sciences, Universidade Federal de São Carlos, Buri, Brazil.
Species-level inventories of individual tree crowns (ITCs) from UAV imagery are limited by annotation cost: in tropical forests, many species are represented by only a handful of field-validated crowns. We propose a reliable tree recruitment framework that expands a small annotated inventory by iteratively self-training a multi-task DeepLabV3 network, combining semantic segmentation with a crown-distance regression head, on RGB UAV orthomosaics. At each iteration, candidate crowns enter the training inventory only if they pass a confidence filter on class probability and distance map and a morphology filter on crown area and solidity, with at most five new crowns per species, keeping recruited samples consistent with the reference inventory. We evaluate the framework at two Brazilian sites: an Amazonian rainforest in Acre (17 species, 355 annotated crowns, 4 cm GSD) and a forest site in the Cerrado of Maranhão (4 species, 51 annotated crowns, 1.8 cm GSD). Over 20 iterations, the number of retained crowns grew from about 500 to 960 in Acre and from about 700 to over 3100 in Maranhão, while crown-level F1 exceeded single- and multi-task DeepLabV3 baselines (53.5% vs. 50.0% and 45.2%; 92.2% vs. 79.7% and 83.6%). The framework offers a low-cost route to expanding species inventories with consumer-grade UAVs and limited fieldwork.
Figures & tables
Fig. 1 : Overview of the proposed framework. (1) Training the ML model with the labeled samples. (2) Predicted semantic segmentation and the distance map by the multi-task model. (3) Prediction refined with a confidence threshold above 70% and distance map value above 0.25. (4) Final Individual Tree Crowns (ITCs) selected and prepared for the tree recruitment scheme’s sample inventory, incorporating morphological validation.
Fig. 2 : Overview of the proposed multitask DeepLabV3 architecture. It features a shared encoder, built upon a ResNet-50 backbone, that branches into two specialized decoders: one for semantic segmentation (supervised by LPCFL ) and another for distance transform map prediction (supervised by LPMSE ).
Fig. 3 : Example of the distance transform generation. (a) RGB image. (b) Binary mask of the ITC. (c) Euclidean distance transform with Gaussian filter
Fig. 4 : Study areas location. (A) Embrapa experimental forest in Rio Branco, Acre (AC) state, Brazil. (B) Baixao Preto Farm in Riachao, Maranhao (MA) state, Brazil, showing 3 of the 15 surveyed regions.
Fig. 5 : Examples of individual tree crowns of the 17 target species in the Amazon AC dataset (UAV RGB imagery, 4 cm GSD).
Fig. 6 : Examples of individual tree crowns of the four target species in the Bioflore MA dataset (UAV RGB imagery, 1.8 cm GSD).
Fig. 7 : Examples of patches used in the training stage. Red polygons refer to individual tree crowns.
Fig. 8 : F1-score (%) for each specie in both datasets
Fig. 9 : Visual analysis of predicted ITCs by each evaluated method on Amazon AC dataset. In the figure, TL , and PL refer to True Label and Predicted Label, respectively.
Fig. 10 : Visual analysis of predicted ITCs by each evaluated method on Bioflore MA dataset. In the figure, TL , and PL refer to True Label and Predicted Label, respectively.
Fig. 11 : Illustration of component selection based on model predictions: (a) Predicted semantic segmentation by the model. (b) Prediction with confidence above 70%. (c) High-confidence prediction where the distance map value is above 0.25. (d) ITCs are selected to compose the tree recruitment scheme sample inventory.
Fig. 12 : Individual tree crowns (ITCs) of the target species (see Table I ) over the iterations of the tree recruitment process for Amazon AC dataset.
Fig. 13 : Comparison of the canopy area distribution of the species Abiorana rosa ( Micropholis venulosa ). Highlighted are the selection limits used in the first iteration of the model.
Fig. 14 : Number of individual tree crowns (ITCs) detected and macro-average F1-score across tree recruitment iterations.
Fig. 15 : Number of predicted individual tree crowns (ITCs) in the 1st, 8th, and 13th iterations of the tree recruitment cycle. A different bar color represents each species. The count of ITCs is displayed above each bar, with the corresponding F1-score in parentheses.