TopoFuse: Topology-Aware Tri-Planar Fusion for 3D Cryo-Electron Tomography Segmentation
Organizations: Virginia Tech, Blacksburg, VA, USA · National Institute of Technology, Kurukshetra, India · Carnegie Mellon University, Pittsburgh, PA, USA
Abstract
Automated segmentation of cryo-electron tomograms routinely produces masks that are voxel-accurate but topologically broken: membranes fragment, organelles merge into one another, and enclosed cavities collapse. Existing topology-aware losses reduce these violations but cannot eliminate them, because topology is encouraged through gradient pressure rather than structurally enforced. We introduce TopoFuse, which reframes topology as a differentiable projection operator rather than a loss penalty. At each forward pass, the projection operator (a PH-guided sparse edit) identifies the critical voxels responsible for topological violations via bottleneck matching and applies sparse edits to satisfy a specified topology target (diagram feature counts and lifetime budgets) for dimensions . If the projection converges, the output satisfies those constraints on the downsampled grid (); when it does not, a repair certificate exposes this explicitly, enabling downstream filtering. A topology prior head predicts the correction target directly from input features, removing any dependence on ground-truth topology at inference. Across three cryo-ET benchmarks, TopoFuse reduces Betti number error by 54% over the strongest soft-loss baseline (), improves Dice by 4.6 points, and edits only 3.1% of voxels to achieve this.
Figures & tables
| Model | Params (M) | FLOPs (G) | PH (%) | Mem (GB) | Time (s) |
|---|---|---|---|---|---|
| CryoSAM | 631 | 328 | - | ||
| Tri-planar (no topo) | 648 | 361 | - | ||
| TopoFuse ( ) | 714 | 518 | 5.9 |
| EMD-0506 | EMPIAR-10499 | EMPIAR-10045 | Mean | ||||||||
| Method | D | BE 0 | BME | D | BE 0 | BME | D | BE 0 | BME | D | BE 0 |
| 3D U-Net | 70.2 | 3.84 | 0.38 | 69.8 | 4.12 | 0.41 | 67.3 | 5.21 | 0.47 | 69.1 | 4.39 |
| nnU-Net | 72.9 | 3.41 | 0.34 | 72.6 | 3.68 | 0.37 | 70.1 | 4.73 | 0.43 | 71.9 | 3.94 |
| CryoSAM | 75.6 | 3.07 | 0.30 | 75.2 | 3.24 | 0.32 | 72.8 | 4.31 | 0.39 | 74.5 | 3.54 |
| Tri-planar | 76.4 | 2.94 | 0.29 | 76.0 | 3.10 | 0.31 | 73.5 | 4.18 | 0.38 | 75.3 | 3.41 |
| +clDice | 78.1 | 2.61 | 0.26 | 78.4 | 2.73 | 0.27 | 76.2 | 3.72 | 0.34 | 77.6 | 3.02 |
| Variant | Dice | BE 0 | BME | Sparsity(%) |
|---|---|---|---|---|
| Tri-planar (uniform, no topo) | 76.0 | 3.10 | 0.31 | – |
| +learned fusion (no FiLM) | 77.8 | 2.88 | 0.29 | – |
| + (no proj) | 81.1 | 2.41 | 0.24 | – |
| +projection ( ) | 85.2 | 1.11 | 0.11 | |
| +FiLM conditioning | 85.4 | 1.10 | 0.11 | |
| TopoFuse (learned prior) | 85.6 | 1.09 | 0.11 |
Topology-Preserving Image Segmentation
Topology-preserving image segmentation models image regions while maintaining structural properties such as connectivity, branches, and holes.
See all 42 papers