Reconstruction differences rival individual differences in the fly compass connectome and break trained circuit models
Organizations: Wrocław University of Science and Technology · Comilla University
Abstract
Neural network models are increasingly constructed from synapse-resolution connectomes, and the same circuit is now available in reconstructions from other animals and pipelines. We do not know whether such models are dependent on the reconstruction they are built from, and whether connectome differences are biological or measurement errors. We studied the Drosophila head-direction circuit in nine versions: four flies (male CNS, hemibrain, FlyWire, BANC) and five variants of the same fly varying only by thresholds, proofreading or synapse detection. Using wiring-based correspondences validated by anatomical labels, we place all differences on one scale. A change of synapse detection within one fly changed the circuit more than halfway to the smallest between-fly difference on four distance measures; proofreading differences were smaller but depended on the metric, and left and right halves of one fly differed no more than random halves. Networks trained on each wiring to hold a cued heading developed near-perfect ring attractors, but their error increased from below 1 degree to 10-28 degrees when all weights changed by 1%. Training on each wiring did not transfer to any other connectome, including other versions of the same fly; refitting thirty cell-type gains, we repaired filtering-level differences but remaining error depended on wiring distance. Training with noise lowered precision and gave only partial transfer. In imaging data, the fly compass drifted gradually in darkness. Connectome-constrained models should report the reconstruction they were built on and be tested for robustness across reconstructions.
Figures & tables
| Version | Source | Neurons | Connections |
|---|---|---|---|
| male CNS v1.0 | FlyWire Codex (filtered) | 434 | 27,246 |
| male CNS, neuPrint | neuPrint | 434 | 33,783 |
| male CNS v0.9 | Codex | 434 | 27,246 |
| hemibrain v1.2.1 | neuPrint | 409 | 28,942 |
| FlyWire FAFB v783 | Codex, Princeton synapses, filtered | 433 | 16,741 |
| FAFB unfiltered | Codex unfiltered file, 3 synapses | 433 | 23,340 |
Appendix figures & tables15 assets
Supplementary material from the paper’s appendix.
Appendix
| Wiring | Gains | Seed | 40 steps | 80 steps | 200 steps |
|---|---|---|---|---|---|
| real | per neuron | 0 | 0.68 | 1.26 | 4.40 |
| real | per neuron | 1 | 0.57 | 1.39 | 5.31 |
| real | per neuron | 2 | 88.11 | 88.60 | 89.99 (failed) |
| real | cell type | 0 | 1.23 | 3.97 | 17.51 |
| real | cell type | 1 | 1.11 | 3.69 | 17.96 |
| real | cell type | 2 | 88.11 | 88.60 | 89.99 (failed) |
| Wiring | Gains | Seed | Err. | PC2 | H1 | Ring | Return | ||
|---|---|---|---|---|---|---|---|---|---|
| real | neuron | 0 | 4.4 | 1.000 | 1.34 | 1.000 | 0.986 | yes | yes |
| real, 7 silenced | neuron | 0 | 82.5 | 1.000 | 0.51 | 0.975 | 0.949 | yes | no |
| real | neuron | 1 | 5.3 | 1.000 | 1.18 | 1.000 | 0.997 | yes | yes |
| real, 7 silenced | neuron | 1 | 79.8 | 1.000 | 0.22 | 0.995 | 0.978 | no | no |
| real | cell type | 0 | 17.3 | 0.999 | 0.97 | 0.998 | 0.981 | yes | yes |
| real, 7 silenced | cell type | 0 | 46.3 | 0.998 | 0.72 | 1.028 | 0.982 | yes | yes |
| Wiring | Gains | Seed | 1 | 0.98 | 0.99 | 1.01 | 1.02 |
|---|---|---|---|---|---|---|---|
| real | neuron | 0 | 0.69 | 33.6 | 14.3 | 11.3 | 21.8 |
| real | neuron | 1 | 0.56 | 48.9 | 26.0 | 18.4 | 36.0 |
| real | cell type | 0 | 1.22 | 39.3 | 18.4 | 12.7 | 27.3 |
| real | cell type | 1 | 1.11 | 30.9 | 11.8 | 9.1 | 16.0 |
| 25% shuffle | neuron | 0 | 4.39 | 53.9 | 29.3 | 26.0 | 44.4 |
| 25% shuffle | neuron | 1 | 3.69 | 66.0 | 39.2 | 30.7 | 53.3 |
| Source | Kind | Comparison | Distance |
| Filtering | same fly | male CNS Codex vs. neuPrint | 0.022 |
| same fly | FlyWire filtered vs. unfiltered | 0.038 | |
| Proofreading | same fly | male CNS v0.9 vs. v1.0 | 0.000 |
| same fly | BANC v626 vs. v888 | 0.104 | |
| Synapse detector | same fly | FlyWire Princeton vs. Buhmann | 0.090 |
| same fly | FlyWire unfiltered vs. Buhmann | 0.084 |
| Fly | Cell type | Method | Agreement | Shuffled |
|---|---|---|---|---|
| male CNS | EPG | MDS of connectivity profiles | 0.99 | 0.26–0.31 |
| male CNS | PEN_a | anchored to EPG | 1.00 | 0.36–0.49 |
| male CNS | PEN_b | anchored to EPG | 1.00 | 0.33–0.40 |
| male CNS | PEG | anchored to EPG | 1.00 | 0.30–0.38 |
| hemibrain | EPG | MDS of connectivity profiles | 0.99 | 0.25–0.30 |
| hemibrain | PEN_a | anchored to EPG | 1.00 | 0.31–0.35 |
| Map | Cell type | Exact match |
|---|---|---|
| hemibrain male CNS | EPG | 100% |
| hemibrain male CNS | PEN_a | 100% |
| hemibrain male CNS | PEN_b | 100% |
| hemibrain male CNS | PEG | 83% |
| male CNS hemibrain | EPG | 100% |
| male CNS hemibrain | PEN_a | 100% |
| Source | Target | Alignment | Mirrored | Neurons used |
|---|---|---|---|---|
| male CNS | hemibrain | 0.804 | no | 99% |
| male CNS | FlyWire | 0.572 | no | 96% |
| male CNS | BANC | 0.515 | no | 94% |
| hemibrain | male CNS | 0.804 | no | 94% |
| hemibrain | FlyWire | 0.570 | yes | 93% |
| hemibrain | BANC | 0.528 | no | 93% |
| Source | Comparison | Matching | Map | Weights | Jaccard | Shares | |
|---|---|---|---|---|---|---|---|
| filtering | male CNS vs male CNS neuPrint | neuron ID | 152 | 0.022 | 0.003 | 0.121 | 0.013 |
| filtering | FlyWire vs FlyWire unfilt. | neuron ID | 155 | 0.038 | 0.061 | 0.223 | 0.023 |
| proofreading | male CNS v0.9 vs male CNS | neuron ID | 152 | 0.000 | 0.000 | 0.000 | 0.000 |
| proofreading | BANC v626 vs BANC | neuron ID | 140 | 0.104 | 0.082 | 0.132 | 0.049 |
| synapse detector | FlyWire vs FlyWire Buhmann | neuron ID | 155 | 0.090 | 0.358 | 0.257 | 0.072 |
| synapse detector | FlyWire unfilt. vs FlyWire Buhmann | neuron ID | 155 | 0.084 | 0.304 | 0.336 | 0.065 |
| Trained on | male CNS | hemibrain | FlyWire | BANC |
|---|---|---|---|---|
| male CNS | 1.2 | 89.4 | 90.7 | 89.2 |
| hemibrain | 87.9 | 0.9 | 86.2 | 90.7 |
| FlyWire | 91.1 | 91.7 | 0.7 | 88.6 |
| BANC | 89.3 | 88.5 | 83.9 | 1.1 |
| Trained on | male CNS | hemibrain | FlyWire | BANC |
|---|---|---|---|---|
| male CNS | 0.7 | 82.0 | 91.1 | 88.0 |
| hemibrain | 82.2 | 0.6 | 88.2 | 90.2 |
| FlyWire | 91.0 | 91.2 | 0.5 | 89.6 |
| BANC | 87.3 | 89.1 | 90.1 | 0.5 |
| Level | Trained on | male CNS | hemibrain | FlyWire | BANC |
|---|---|---|---|---|---|
| 0 | male CNS | 0.7 | 78.7 | 89.0 | 88.1 |
| hemibrain | 77.6 | 0.7 | 89.4 | 90.3 | |
| FlyWire | 90.6 | 89.4 | 0.5 | 90.0 | |
| BANC | 87.4 | 87.1 | 87.3 | 0.4 | |
| 0.25 | male CNS | 7.0 | 78.5 | 87.8 | 88.1 |
| hemibrain | 57.0 | 17.9 | 88.7 | 87.5 |
| Family | Test | Statistic | ||
|---|---|---|---|---|
| H1 transplant (pre.) | median transplant ratio R, celltype gains | R = 87 | – | – |
| H1 transplant (pre.) | median transplant ratio R, neuron gains | R = 162 | – | – |
| H2 level (pre.) | neuron-level R cell-type R (paired Wilcoxon, 12 pairs) | median 162 vs 87 | 2.4 | 7.3 |
| H3 distance (pre.) | (wiring distance, R), celltype gains | = -0.33 | 0.85 | 0.85 |
| H3 distance (pre.) | (wiring distance, R), neuron gains | = +0.25 | 0.21 | 0.42 |
| H4 mechanism (pre.) | banc celltype: networks meeting ring + fast return | 3/5 | – | – |
| Fly | Gains | H4 | med. | range | Radius var. | Winding | Err. 200 | |
|---|---|---|---|---|---|---|---|---|
| BANC | cell type | 5 | 3 | 1.000 | 0.998–1.009 | 0.21 | 5/5 | 12.0 |
| BANC | per neuron | 5 | 5 | 1.001 | 0.991–1.001 | 0.15 | 5/5 | 2.0 |
| FlyWire | cell type | 5 | 4 | 1.003 | 1.000–1.044 | 0.21 | 4/5 | 8.7 |
| FlyWire | per neuron | 5 | 5 | 1.001 | 1.000–1.003 | 0.21 | 5/5 | 3.5 |
| hemibrain | cell type | 4 | 3 | 1.014 | 1.008–1.021 | 0.30 | 4/4 | 12.7 |
| hemibrain | per neuron | 4 | 4 | 1.001 | 1.000–1.002 | 0.27 | 4/4 | 4.2 |
| Hypothesis | Prediction | Outcome |
|---|---|---|
| H1 transfer | Robust ( ) or fragile ( ) transfer between flies | Fragile: median (cell-type gains, registered) and 162 (per-neuron gains) |
| H2 parameter level | Neuron-level parameters transfer worse than cell-type parameters | Supported: larger at neuron level in 12 of 12 pairs, (Holm ) |
| H3 distance | Transfer failure increases with wiring distance | Not supported ( and ); all transplants at chance (floor effect) |
| H4 mechanism | Real wirings form a ring attractor with fast return (at least 3 of 5 seeds) | Supported in all 8 fly parameterization combinations; 31 of 36 networks |
| H5 drift | Descriptive comparison of model drift in darkness with the DANDI 000289 estimate; no directional prediction | Fly drift reported (darkness , bright cue 0.023, excess 0.024 rad 2 /s, to 0.076); model comparison not made (deviation 8) |
| True | True | Fitted (mean) | SD | Bias | Fitted |
|---|---|---|---|---|---|
| 0.002 | 0.1 | 0.0020 | 0.0002 | +1.2% | 0.100 |
| 0.002 | 0.3 | 0.0020 | 0.0007 | +0.6% | 0.300 |
| 0.01 | 0.1 | 0.0102 | 0.0012 | +2.2% | 0.099 |
| 0.01 | 0.3 | 0.0101 | 0.0021 | +1.2% | 0.302 |
| 0.04 | 0.1 | 0.0379 | 0.0060 | -5.2% | 0.102 |
| 0.04 | 0.3 | 0.0393 | 0.0070 | -1.7% | 0.300 |