Improving Matrix Exponential for Generative AI Flows: A Taylor-Based Approach Beyond Paterson--Stockmeyer
Not on the map. Why?
Abstract (arXiv)
The matrix exponential is a fundamental operator in scientific computing and system simulation, with applications ranging from control theory and quantum mechanics to modern generative machine learning. While Pad'e approximants combined with scaling and squaring have long served as the standard, recent Taylor-based methods, which utilize polynomial evaluation schemes that surpass the classical Paterson--Stockmeyer technique, offer superior accuracy and reduced computational complexity. This paper presents an optimized Taylor-based algorithm for the matrix exponential, specifically designed for the high-throughput requirements of generative AI flows. We provide a rigorous error analysis and develop a dynamic selection strategy for the Taylor order and scaling factor to minimize computational effort under a prescribed error tolerance. Extensive numerical experiments demonstrate that our approach provides significant acceleration and maintains high numerical stability compared to existing state-of-the-art implementations. These results establish the proposed method as a highly efficient tool for large-scale generative modeling.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 43 references that are in the map. First posted on arXiv 23 Dec 2025.
Builds on
11 of 43 references.
References · 11
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2016Density estimation using Real NVPcited by 2,042
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2016Pixel Recurrent Neural Networkscited by 816
- 2017Masked Autoregressive Flow for Density Estimationcited by 684
- 2023Simple and Controllable Music Generationcited by 488
- 2019Residual Flows for Invertible Generative Modelingcited by 257
- 2013Generalized Denoising Auto-Encoders as Generative Modelscited by 113
- 2021Generative Models as a Data Source for Multiview Representation Learningcited by 104
- 2023Music ControlNet: Multiple Time-varying Controls for Music Generationcited by 83
- 2020Generative Flows with Matrix Exponentialcited by 6
Built on by
Not cited yet.