A Fully Automatic Pipeline for 3D Dendrite Instance Segmentation in SBF-SEM
Organizations: A.I. Virtanen Institute for Molecular Sciences, University of Eastern Finland, Kuopio, Finland
Abstract
Accurate three-dimensional (3D) reconstruction of individual dendrites in serial block-face scanning electron microscopy (SBF-SEM) is essential for quantifying structural plasticity in the brain, yet manual annotation at scale is infeasible. We present a fully automatic pipeline for 3D dendrite instance segmentation that unifies YOLOv6-guided Segment Anything Model (SAM) prompting on downsampled slices, iterative two-dimensional mask refinement, random forest 3D instance linking, and instance-aware high-resolution refinement using nnU-Net at native resolution into a single system requiring no manual prompting at inference. Applied to hippocampal CA1 SBF-SEM datasets from a control rat and a pilocarpine- induced epileptic rat, our pipeline reconstructs coherent, well- separated dendrites with high semantic accuracy (Dice 0.93 and 0.91) and strong instance-level performance on control tissue, while analysis of the more challenging epileptic tissue identifies instance recognition in dense regions as the principal remaining limitation. The high-resolution refinement stage recovers thin dendritic protrusions, providing a basis for downstream spine- level analysis. Code is available at https://github.com/ ZE-WEN/dendrite-3d-instance-seg.
Figures & tables
| Category | Metric | Dataset A | Dataset B |
|---|---|---|---|
| Instance-level | 0.63 | 0.38 | |
| 0.75 | 0.34 | ||
| 0.44 | 0.11 | ||
| Panoptic | PQ | 0.70 | 0.37 |
| SQ | 0.82 | 0.72 | |
| DQ | 0.86 | 0.51 |
| Dataset A | Dataset B | |||
|---|---|---|---|---|
| Metric | RF | IoU only | RF | IoU only |
| 0.63 | 0.33 | 0.38 | 0.25 | |
| 0.75 | 0.29 | 0.34 | 0.30 | |
| 0.44 | 0.29 | 0.11 | 0.08 | |
3D Instance Segmentation
3D instance segmentation identifies and separates individual objects in point clouds, reconstructed scenes, and volumetric data.
See all 60 papers