cs.LGDec 23, 2025

Improving Matrix Exponential for Generative AI Flows: A Taylor-Based Approach Beyond Paterson--Stockmeyer

Authors: Jorge Sastre, Daniel Faronbi, José Miguel Alonso, Peter Traver, Javier Ibáñez, Nuria Lloret

Organizations: Universitat Politècnica de València, Spain; aInstituto de Telecomunicaciones y Aplicaciones Multimedia · eMusic and Audio Research Lab, New York University, New York, USA · Universitat Politècnica de València, Spain; bInstituto de Instrumentación para Imagen Molecular · Universitat Politècnica de València, Spain; cInstituto de Matemática Multidisciplinar · 

Abstract

The matrix exponential is a fundamental operator in scientific computing and system simulation, with applications ranging from control theory and quantum mechanics to modern generative machine learning. While Padé approximants combined with scaling and squaring have long served as the standard, recent Taylor-based methods, which utilize polynomial evaluation schemes that surpass the classical Paterson--Stockmeyer technique, offer superior accuracy and reduced computational complexity. This paper presents an optimized Taylor-based algorithm for the matrix exponential, specifically designed for the high-throughput requirements of generative AI flows. We provide a rigorous error analysis and develop a dynamic selection strategy for the Taylor order and scaling factor to minimize computational effort under a prescribed error tolerance. Extensive numerical experiments demonstrate that our approach provides significant acceleration and maintains high numerical stability compared to existing state-of-the-art implementations. These results establish the proposed method as a highly efficient tool for large-scale generative modeling.

Figures & tables

Explore similar work

CardsList
  1. Improving the matrix multiplication exponent with modern optimization and AlphaEvolve

    Aug 17, 2026Emilien Dupont, Marvin Eisenberger, Borislav Kozlovskii +7Matrix Optimization

  2. CoreFlow: Low-Rank Matrix Generative Models

    Apr 27, 2026Dongze Wu, Linglingzhi Zhu, Yao XieGenerative ModelingContinuous Normalizing Flows

  3. CDFlow: Building Invertible Layers with Circulant and Diagonal Matrices

    Oct 29, 2025Xuchen Feng, Siyu LiaoNormalizing FlowsDensity Estimation