math.DGSep 18, 2025

Geodesics in the Deep Linear Network

Authors: Alan Chen

Abstract

We derive a general system of ordinary differential equations and associated explicit solutions in a special case for geodesics between full rank matrices in the deep linear network geometry. In the process, we find horizontal straight lines in the invariant balanced manifold that remain geodesics under Riemannian submersion.

Explore similar work

CardsList
  1. Riemannian Deep Learning: Modules, Networks, and Geometries

    Jul 21, 2026Ziheng ChenRiemannian Neural NetworksGeometric Representation Learning

  2. The Geometry of the Set of Equivalent Linear Neural Networks

    Apr 23, 2024Jonathan Richard Shewchuk, Sagnik BhattacharyaDeep Linear NetworksWeight-Space Analysis

  3. Special Lagrangian cones in Deep Learning

    Sep 17, 2026Tejas Kotwal, Govind Menon