Multi-dimensional Persistent Sheaf Laplacians for Image Analysis
Organizations: Department of Mathematics, Michigan State University, East Lansing, MI 48824, USA. · Department of Biochemistry and Molecular Biology, Michigan State University, East Lansing, MI 48824, USA. · Department of Electrical and Computer Engineering, Michigan State University, East Lansing, MI 48824, USA.
Abstract
We propose a multi-dimensional persistent sheaf Laplacian (MPSL) framework on simplicial complexes for image analysis. The proposed method is motivated by the strong sensitivity of commonly used dimensionality reduction techniques, such as principal component analysis (PCA), to the choice of reduced dimension. Rather than selecting a single reduced dimension or averaging results across dimensions, we exploit complementary advantages of multiple reduced dimensions. At a given dimension, image samples are regarded as simplicial complexes, and persistent sheaf Laplacians are utilized to extract a multiscale localized topological spectral representation for individual image samples. Statistical summaries of the resulting spectra are then aggregated across scales and dimensions to form multiscale multi-dimensional image representations. We evaluate the proposed framework on the COIL20 and ETH80 image datasets using standard classification protocols. Experimental results show that the proposed method provides more stable performance across a wide range of reduced dimensions and achieves consistent improvements to PCA-based baselines in moderate dimensional regimes.
Figures & tables
| Symbol | Description |
| Image dataset consisting of images | |
| The -th image in the dataset | |
| Spatial resolution of an image | |
| Dimension of the vectorized image | |
| Vector with dimension n | |
| Matrix with size |
| Statistic | Definition | Interpretation |
| Zero eigenvalue count | Kernel dimension | |
| Smallest nonzero eigenvalue | Spectral gap | |
| Maximum eigenvalue | Largest spectral value | |
| Sum of eigenvalues | Total spectral magnitude | |
| Mean | Average value | |
| Median | Central tendency |
| Dataset | Classes | Images | Image type | Resolution | Characteristics |
| COIL20 [ 29 ] | 20 | 1440 | Grayscale | Single object per class | |
| ETH80 [ 18 ] | 8 | 3280 | Grayscale (converted) | Multiple object instances per class |
| PCA dim | PCA | MPSL | ||||
| Acc | MR | Macro F1 | Acc | MR | Macro F1 | |
| 200 | 0.7604 | 0.7604 | 0.7692 | 0.9049 | 0.9050 | 0.9039 |
| 300 | 0.5632 | 0.5632 | 0.5956 | 0.9000 | 0.9003 | 0.8985 |
| 400 | 0.4396 | 0.4396 | 0.4689 | 0.9146 | 0.9149 | 0.9133 |
| 500 | 0.3854 | 0.3854 | 0.4019 | 0.9125 | 0.9130 | 0.9108 |
| 600 | 0.3410 | 0.3410 | 0.3443 | 0.9118 | 0.9119 | 0.9098 |
| Method | Acc | MR | Macro F1 |
| PCA (average) | 0.3675 | 0.3675 | 0.3682 |
| MPSL (single dimension + multi- , average) | 0.9091 | 0.9093 | 0.9074 |
| MPSL (multi dimension, multi- aggregation) | 0.9167 | 0.9169 | 0.9149 |
| PCA dim | PCA | MPSL | ||||
| Acc | MR | Macro F1 | Acc | MR | Macro F1 | |
| 200 | 0.6061 | 0.6061 | 0.5876 | 0.6162 | 0.6162 | 0.6052 |
| 300 | 0.4817 | 0.4817 | 0.4370 | 0.6256 | 0.6256 | 0.6122 |
| 400 | 0.4149 | 0.4149 | 0.3520 | 0.6305 | 0.6305 | 0.6218 |
| 500 | 0.3713 | 0.3713 | 0.3106 | 0.6256 | 0.6256 | 0.6160 |
| 600 | 0.3326 | 0.3326 | 0.2866 | 0.6345 | 0.6345 | 0.6242 |
| Method | Acc | MR | Macro F1 |
| PCA (average) | 0.3576 | 0.3576 | 0.3147 |
| MPSL (single dimension multi- , average) | 0.6306 | 0.6306 | 0.6204 |
| MPSL (multi-dimension, multi- aggregation) | 0.6622 | 0.6622 | 0.6536 |
Topological Representation Learning
Topological representation learning uses connectivity, holes, and higher-order structure to build or analyze machine-learning features.
See all 67 papers