Building functional and mechanistic models of cortical computation based on canonical cell type connectivity
Authors: Arno Granier, Katharina A Wilmes, Mihai A Petrovici, Walter Senn
Organizations: Department of Physiology, University of Bern, Switzerland · Graduate School for Cellular and Biomedical Sciences, University of Bern, Switzerland · Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zürich, Switzerland · Center for Artificial Intelligence in Medicine, University of Bern, Switzerland
Neuronal circuits of the cerebral cortex are the structural basis of mammalian cognition. The same qualitative components and connectivity motifs are repeated across functionally specialized cortical areas and mammalian species, suggesting a single underlying algorithmic motif. Here, we propose a perspective on current knowledge of the cortical structure, from which we extract two core principles for computational modeling. The first principle is that cortical cell types fulfill distinct computational roles. The second principle is that cortical connectivity can be efficiently characterized by only a few canonical blueprints of connectivity between cell types. Starting with these two foundational principles, we outline a general framework for building functional and mechanistic models of cortical circuits. Finally, we show that the compressed and generative representations of connectivity entailed by this framework are particularly amenable to automatic search through gradient-free optimization, providing a concrete first step towards modelling the evolution of functional neural circuits.
Figures & tables
Figure 1: Cortical neuron types. The extent of the apical dendritic trees is represented in dark colors, and patterns of local axonal projections in light colors. As sketches, these have some degree of arbitrariness and do not represent the variability of arborization within one class. Marker genes defining a cell type are indicated in italics. Excitatory cells can be named classically based on their laminar position (L2IT - L6b; IT: intratelencephalic, s: stellate cells, p: pyramidal, PT: pyramidal tract, CT: corticothalamic) and inhibitory cells based on expressed molecular markers (Pvalb, Sst, VIP, Lamp5). Excitatory cells are pyramidal in shape, except for L4s and L6b which have different morphologies. Interneuron subtypes depicted here are representative subtypes from the Allen Cell Types Database, notably as reported by Patiño et al. (2024) and Wu et al. (2023) . Pyramidal subtypes depicted are the major classes while more minor classes, such as near-projecting layer 5 pyramidal cells and Car3 expressing layer 6 pyramidal cells, are not represented individually. Good entry points for a catalog of those genes are the work of Matho et al. (2021) or the Allen Cell Types Database. Note that gene expression varies greatly across areas for excitatory but not inhibitory cells ( Tasic et al., 2018 ) . Consequently, some genes presented here are area-specific, such as Adamts2, Agmat, and Rrad, which characterize layer 2/3 in primary visual cortex but not in anterior lateral motor cortex ( Tasic et al., 2018 ) .
Figure 2: Canonical local cortical circuits. (a) The main information flow in a cortical column of the mouse barrel cortex as reported by Sievers et al. (2024) . The thickness of the lines indicates the strength of the projection. Dotted lines indicate the dendritic location of projections from L3IT and L4IT to L5PT. Recurrent projections from cells of one type to other cells of the same type are present throughout (not drawn). (b) The logic of intercolumnar feedforward inhibition as reported by Sievers et al. (2024) . One population of dendrite-targeting (L3d) and one population of soma-targeting (L3s) interneurons per excitatory class/layer mediate feedforward inhibition. These are controlled by local populations via direct connections and disinhibitory connections relaying through a population of bipolar cells (VIP). L4IN: layer 4 interneurons. (c) Cell-type-specific targeting of Sst interneurons subtypes as reported by Wu et al. (2023) . Expressed genes are reported in italics. (d) Local outputs of L5PT (morphologically-defined thick-tufted layer 5 pyramidal cells) as reported by Bodor et al. (2023) .
Figure 3: Specific structure of interareal projections. (a,b) Cell types of origin and laminar target patterns of main interareal feedforward (a) and feedback (b) projections, based on integrated data from Markov et al. (2014) and Harris et al. (2019) . Note that this mixes data from monkeys and mice. Harris et al. (2019) additionally report interareal projections from pyramidal cells of layer 4, not represented here. The separation of pyramidal cells from layers 2 and 3 stems from Markov et al. (2014) (in primates), while Harris et al. (2019) (in mouse) represent both of these as a homogeneous class ( Cux2 ), rendering their laminar target patterns unclear. In both studies, the granularity of layer 6 pyramidal cells could not be accounted for. Finally, Harris et al. (2019) report that interareal projections from layer 5 PT and layer 6 CT pyramidal cells are less numerous than from IT pyramidal cells. More data is needed on these matters. (c) A sketch of a typical interareal graph of connectivity, with only the strongest connections represented. Each square is an area, and colors represent broad groupings of areas, typically lobes. The spatial arrangement of squares does not reflect the physical placement of areas but is based solely on connectivity (e.g. following a force-directed graph drawing algorithm). This type of graph but with real data is presented e.g. by Gămănuţ et al. (2018) , their fig. 8. (d) Single pyramidal cells in mouse primary visual cortex project to non-random sets of other areas ( Han et al., 2018 ) . Notably, pyramidal cells in the primary visual cortex projecting to anterolateral (AL) and posteromedial (PM) visual areas are segregated populations with little local interactions ( Kim et al., 2018 ) . (e) Pyramidal cells preferentially receive feedback from areas that they themselves project to, in particular, for pyramidal cells of layer 5, at their apical dendrites ( Kim et al., 2020 ; Siu et al., 2021 ; Young et al., 2021 ) . V2L: lateral visual areas, V2M: medial visual areas.
Figure 4: What do we need for a functional and mechanistic model of cortical computation? This figure sketches model elements: the specifics are simply illustrative. (a) Defining cortical cell types. Different shapes of neuron sketches represent different neuron models (details pending), while different colors represent different cell types. Additionally to cortical cell types, we also sketch a thalamic cell type. (b) Defining prototypical synapse types. On top of the arrows we sketch the plasticity kernels, on the right the possible subcellular targets, and on the bottom the connectivity patterns. (c) Sketches of cell type connectivity blueprints matrices. Colors refer to the colors of synapse types as in b. (d) A sketch of an interareal connectivity matrix. Pictograms represent different connectivity blueprints.
Figure 5: A circuit implementing backpropagation. More precisely, the variation of Kolen and Pollack (2002) avoiding weight transport, on a multilayer perceptron with ReLU nonlinearities. (a) Two cell types using neuron models with two (red) and three (purple) compartments. s=somatic activity, d=dendritic activity, t=target. (b) Two projection types: a one-to-one non-plastic projection setting postsynaptic dendritic activity (pink) and an all-to-all projection type with learnable parameter W. (c) Canonical cell type connectivity. (d) Interareal connectivity organized in a strict hierarchy. (e) A sketch of the resulting network.
Figure 6: Canonical cortical circuit search. Given neuron and projection models, cell type connectivity and interareal connectivity matrices encode all the information necessary to construct actual networks. Here, cell type connectivity and interareal connectivity matrices are equivalently represented flattened and concatenated. Sets of connectivity matrices can be seen as genomes, actual networks as individuals, and the process that transforms the former into the latter as development. These networks can be trained and tested on functional tasks, and the underlying genomes filtered based on functional performance. This is akin to natural selection. Evolutionary search methods would then build a new set of genomes by applying crossover and mutation and repeat again the same steps.
Figure 7: Finding a circuitry for backpropagation through search. (a) The YinYang dataset ( Kriener et al., 2022 ) . Inputs are the (x,y) coordinates; target labels are represented by the colors. (b) A sketch of a small network with one hidden layer comprising 20 units. Arrows marked with ‘?’ indicate existing connections wih unknown (varying) circuitry (cell-type-specific connectivity). (c) Accuracy of the best found circuitry (applied to a network as depicted in panel b) during the search process, that is, across different generations (populations with varying circuitries). Vertical lines correspond to the generations for which the best found circuits are sketched in panel g. (d) Similar to panel c but reporting the normalized ‘metabolic’ cost of the best found circuitry across generations. This cost scales with the number of existing projections between cell-type-specific populations. (e) Circuitries or canonical cell type connectivities with best performances in the population for different generations during the search process. (f) Compressed binary encodings of the cell type connectivity matrices reported in panel e. (g) Sketches of circuitries for corresponding subpanels i, iii, v, vii of panel e.
National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, China · School of Electronics Engineering and Computer Science, Peking University, Beijing, China · School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, China +2