cs.CVNov 4, 2026

Learning to Track Cells from Sparse Annotations in 3D Time-Lapse Microscopy

Authors: Yusuke Uchida

Organizations: GO Drive Inc. Tokyo, Japan

Abstract

Reconstructing cell lineages from 3D time-lapse microscopy requires distinguishing cell motion from division and inferring temporally consistent connections. When only a subset of cells is annotated, however, training procedures that treat unannotated regions as background or incorrect correspondences can be problematic. We propose a cell tracking pipeline that integrates detection from sparse annotations, calibration of candidate connections using image features, and joint selection of lineage graph events. For detection, we combine the outputs of 2.5D and 3D models trained to suppress erroneous background supervision at unannotated cells. We then calibrate ordinary link and division probabilities using motion features from dense flow, correspondence features from a learned cell-matching model, and features from models that identify cells immediately before division, dividing parents, and daughters immediately after division. Ordinary links, divisions represented as daughter pairs, and node inclusion are selected jointly under a surrogate objective derived from the evaluation metric, followed by gap filling and temporal coordinate refinement. The pipeline achieves an overall score of 0.9762 in 5-fold cross-validation on 199 videos from 2 zebrafish embryos. With candidates and calibrated values held fixed, joint selection outperforms a sequential method that allows replacement of existing divisions and reoptimization of ordinary links by 0.0105. The improvement arises primarily from division recovery.

Figures & tables

Explore similar work

CardsList
  1. Higher-Order Cell Tracking Transformer

    Jul 13, 2026Jordão Bragantini, Ilan Theodoro, Loïc A. RoyerGraph TransformerMulti-Object Tracking

  2. Cell as Point: One-Stage Framework for Efficient Cell Tracking

    Nov 22, 2024Yaxuan Song, Jianan Fan, Heng Huang +2Multi-Object Tracking

  3. CellNet -- Localizing Cells using Sparse and Noisy Point Annotations

    Jun 10, 2026Benjamin Eckhardt, Dmytro Fishman, Stuart Fawke +3Object CountingMicroscopy Image Analysis