Natural Gradient Methods

Ask about this topic

Momentum

1 paper in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 16

All topics
CardsList

  1. What a Reporting Convention Hides: A Matched-Budget Audit of Quantum Natural Gradient with an Exactly Computed Metric

    Oct 7, 2026Lu Wei, Yufeng Wang, Haibin LingQuantum Machine LearningVariational Quantum Algorithms

    Stony Brook University · Westlake University

  2. How Inefficient Is Natural Gradient Descent? From Exact Optimality to Θ( \sqrt{ \log d } ) Divergence

    Oct 5, 2026Guni Sharon, Alan KuhnleInformation GeometryRiemannian Optimization

    Department of Computer Science and Engineering, Texas A&M University, College Station, TX 77843, USA.

  3. The cost of useful natural gradient updates

    Sep 27, 2026Subhransu S. Bhattacharjee, Dylan Campbell, Rahul ShomeSample ComplexityNatural Gradient Methods

    School of Computing, The Australian National University

  4. Efficient Hypergradient Descent for Inverse Reinforcement Learning

    Aug 11, 2026Nikita Sevriukov, Anna Barabanova, Uliana Gagarina +4Reinforcement LearningGradient Descent

    HSE University Moscow, Russia

  5. Fisher8: Stabilizing Neural Heteroscedastic Regression via Output-Layer Fisher Geometry

    Aug 11, 2026Sumedh Vemuganti, Nickvash KaniNatural Gradient MethodsHeteroscedastic Regression

    Electrical and Computer Engineering Department, University of Illinois at Urbana-Champaign

  6. Information-Geometric Forward Policy Training in GFlowNets

    Aug 4, 2026Yordan Raykov, Rodrigo VeigaInformation GeometryNatural Gradient Methods

    School of Mathematical Sciences, University of Nottingham, Nottingham, UK

  7. Finite-Time Analysis of the Natural Policy Gradient in Finite-Horizon Markov Decision Processes

    Jul 25, 2026Asha Barua, Sajad KhodadadianPolicy GradientMarkov Decision Processes

    Grado Department of Industrial and Systems Engineering, Virginia Polytechnic Institute and State University, Blacksburg, Virginia 24061, USA.

  8. Energy Manifold Natural Gradient Descent: Riemannian Optimization for Neural PDE Solvers

    Jul 24, 2026Zhangyong Liang, Huanhuan GaoNeural PDE SolversRiemannian Optimization

    National Center for Applied Mathematics Tianjin University Tianjin, 300072, China · School of Mechanical and Aerospace Engineering Jilin University Changchun, 130025, China

  9. Differentially Private Natural Gradient Descent

    Jul 7, 2026Pan Li, Kai Chen, Shuai Chang +3Gradient DescentNatural Gradient Methods

    Institute of Information Engineering, Chinese Academy of Sciences Beijing, China · Department of Computer Science, Metropolitan College, Boston University Boston, United States · Nanyang Technological University Singapore, Singapore

  10. On the Optimizer Dependence of Neural Scaling Laws

    May 28, 2026Vansh Ramani, Shourya Vir JainNatural Gradient MethodsNeural Network Optimization

    Department of Computer Science and Engineering, Indian Institute of Technology Delhi · Department of Electrical Engineering, Indian Institute of Technology Delhi

  11. Randomized Advantage Transformation (RAT): Computing Natural Policy Gradients via Direct Backpropagation

    May 18, 2026Mingfei SunPolicy GradientNatural Gradient Methods

    The University of Manchester, United Kingdom.

  12. Adaptive Stochastic Natural Gradient Method for Safe Optimization on Binary Space

    May 18, 2026Kento Uchida, Ryoki Hamano, Masahiro Nomura +1Black-Box OptimizationNatural Gradient Methods

  13. Natural Policy Gradient as Doubly Smoothed Policy Iteration: A Bellman-Operator Framework

    May 11, 2026Phalguni Nanda, Zaiwei ChenPolicy GradientReinforcement Learning

    Edwardson School of Industrial Engineering, Purdue University

  14. Natural gradient descent with momentum

    Apr 16, 2026Anthony Nouy, Agustín SomacalDeep Learning OptimizationRiemannian Optimization

    Centrale Nantes, Nantes Universit´e, Laboratoire de Math´ematiques Jean Leray UMR CNRS 6629

  15. Sven: Singular Value Descent as a Computationally Efficient Natural Gradient Method

    Apr 1, 2026Samuel Bright-Thonney, Thomas R. Harvey, Andre Lukas +1Deep Learning OptimizationNatural Gradient Methods

    Department of Physics, Massachusetts Institute of Technology · The NSF Institute for Artificial Intelligence and Fundamental Interactions · Rudolf Peierls Centre for Theoretical Physics, University of Oxford +2

  16. Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradients

    Mar 28, 2024Johannes Müller, Semih Çaycı, Guido MontúfarPolicy GradientOptimization Convergence Analysis

    Department of Mathematics, RWTH Aachen University, Aachen, 52062, Germany · Departments of Mathematics and Statistics & Data Science, University of California, Los Angeles, 90095, USA · Max Planck Institute for Mathematics in the Sciences, Leipzig, 04103, Germany