Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformers
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Despite their spectacular progress, language models still struggle on complex reasoning tasks, such as advanced mathematics. We consider a long-standing open problem in mathematics: discovering a Lyapunov function that ensures the global stability of a dynamical system. This problem has no known general solution, and algorithmic solvers only exist for some small polynomial systems. We propose a new method for generating synthetic training samples from random solutions, and show that sequence-to-sequence transformers trained on such datasets perform better than algorithmic solvers and humans on polynomial systems, and can discover new Lyapunov functions for non-polynomial systems.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 44 references that are in the map. First posted on arXiv 10 Oct 2024.
Builds on
17 of 44 references.
Closest ancestors · 1
Same direction, newest first
Other references · 16
- 2017Attention Is All You Needcited by 59,932
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2019Deep Learning for Symbolic Mathematicscited by 266
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
- 2021Neural Symbolic Regression that Scalescited by 185
- 2020Neural Lyapunov Controlcited by 142
- 2021Investigating the Limitations of Transformers with Simple Arithmetic Taskscited by 136
- 2023Length Generalization in Arithmetic Transformerscited by 64
- 2021Constructions in combinatorics via neural networkscited by 46
- 2016Robustness of Control Barrier Functions for Safety Critical Controlcited by 29
- 2020It's Not What Machines Can Learn, It's What We Cannot Teachcited by 29
- 2022SALSA: Attacking Lattice Cryptography with Transformerscited by 28
4 more
- 2023Fossil 2.0: Formal Certificate Synthesis for the Verification and Control of Dynamical Modelscited by 15
- 2019Formalising perfectoid spacescited by 7
- 2024Formally Verified Physics-Informed Neural Control Lyapunov Functionscited by 4
- 2015Classical Converse Theorems in Lyapunov's Second Methodcited by 2
Built on by
Citing papers per year: 2024: 4; 2025: 14; 2026: 11.
29 papers.
Sort:
By area:
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
- 2024PatternBoost: Constructions in Mathematics with a Little Help from AIcited by 32
- 2024AIGS: Generating Science from AI-Powered Automated Falsificationcited by 17
- 2025Auto-Formulating Dynamic Programming Problems with Large Language Modelscited by 15
- 2026LemmaBench: A Live, Research-Level Benchmark to Evaluate LLM Capabilities in Mathematicscited by 7
- 2025CayleyPy RL: Pathfinding and Reinforcement Learning on Cayley Graphscited by 5
- 2025Transforming Calabi-Yau Constructions: Generating New Calabi-Yau Manifolds with Transformerscited by 5
- 2024Learning Interpretable Network Dynamics via Universal Neural Symbolic Regressioncited by 4
- 2025Neural Discovery in Mathematics: Do Machines Dream of Colored Planes?cited by 4
- 2026The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learningcited by 4
- 2025Geometric Generality of Transformer-Based Gr"obner Basis Computationcited by 3
- 2026Flow-based Extremal Mathematical Structure Discoverycited by 3
17 more
- 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Provingcited by 2
- 2025From Black Box to Bijection: Interpreting Machine Learning to Build a Zeta Map Algorithmcited by 2
- 2026Can Neural Networks Learn Small Algebraic Worlds? An Investigation Into the Group-theoretic Structures Learned By Narrow Models Trained To Predict Group Operationscited by 2
- 2025Analytical Lyapunov Function Discovery: An RL-based Generative Approachcited by 1
- 2025Int2Int: a framework for mathematics with transformerscited by 1
- 2025Counting Cycles with AI: Counting Cycles with AI: Computationally Efficient Equivalent Forms with Applicationscited by 1
- 2025Discovering Learning-Friendly Generation Orders for Sequential Computationcited by 1
- 2025CayleyPy Growth: Efficient growth computations and hundreds of new conjectures on Cayley graphs (Brief version)cited by 1
- 2025CALT: A Library for Computer Algebra with Transformercited by 0
- 2025Learning Moderately Input-Sensitive Functions: A Case Study in QR Code Decodingcited by 0
- 2026Breaking the Data Barrier in Learning Symbolic Computation: A Case Study on Variable Ordering Suggestion for Cylindrical Algebraic Decompositioncited by 0
- 2026Approximating Matrix Functions with Deep Neural Networks and Transformerscited by 0
- 2026Reconstructing conformal field theoretical compositions with Transformerscited by 0
- 2026Learning Large-Scale Modular Addition with an Auxiliary Moduluscited by 0
- 2026Mapping Uncharted Symmetries: Machine Discovery in Combinatoricscited by 0
- 2026Learning First Integrals via Backward-Generated Data and Guided Reinforcement Learningcited by 0
- 2026Generating Special Triangulations with Transformerscited by 0
- 2026Generating Special Triangulations with Transformers25 Jun 2026
- 2026Learning First Integrals via Backward-Generated Data and Guided Reinforcement Learning20 May 2026
- 2026Mapping Uncharted Symmetries: Machine Discovery in Combinatorics18 May 2026
- 2026Learning Large-Scale Modular Addition with an Auxiliary Modulus8 May 2026
- 2026Reconstructing conformal field theoretical compositions with Transformers1 May 2026
- 2026The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning16 Mar 2026
- 2026LemmaBench: A Live, Research-Level Benchmark to Evaluate LLM Capabilities in Mathematics27 Feb 2026
- 2026Approximating Matrix Functions with Deep Neural Networks and Transformers8 Feb 2026
- 2026Can Neural Networks Learn Small Algebraic Worlds? An Investigation Into the Group-theoretic Structures Learned By Narrow Models Trained To Predict Group Operations29 Jan 2026
- 2026Flow-based Extremal Mathematical Structure Discovery25 Jan 2026
- 2026Breaking the Data Barrier in Learning Symbolic Computation: A Case Study on Variable Ordering Suggestion for Cylindrical Algebraic Decomposition20 Jan 2026
- 2025From Black Box to Bijection: Interpreting Machine Learning to Build a Zeta Map Algorithm16 Nov 2025
17 more
- 2025CayleyPy Growth: Efficient growth computations and hundreds of new conjectures on Cayley graphs (Brief version)23 Sep 2025
- 2025Auto-Formulating Dynamic Programming Problems with Large Language Models15 Jul 2025
- 2025Transforming Calabi-Yau Constructions: Generating New Calabi-Yau Manifolds with Transformers4 Jul 2025
- 2025Discovering Learning-Friendly Generation Orders for Sequential Computation30 Jun 2025
- 2025Learning Moderately Input-Sensitive Functions: A Case Study in QR Code Decoding25 Jun 2025
- 2025CALT: A Library for Computer Algebra with Transformer10 Jun 2025
- 2025Counting Cycles with AI: Counting Cycles with AI: Computationally Efficient Equivalent Forms with Applications23 May 2025
- 2025Geometric Generality of Transformer-Based Gr"obner Basis Computation16 Apr 2025
- 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Proving12 Mar 2025
- 2025CayleyPy RL: Pathfinding and Reinforcement Learning on Cayley Graphs25 Feb 2025
- 2025Int2Int: a framework for mathematics with transformers22 Feb 2025
- 2025Analytical Lyapunov Function Discovery: An RL-based Generative Approach4 Feb 2025
- 2025Neural Discovery in Mathematics: Do Machines Dream of Colored Planes?30 Jan 2025
- 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec 2024
- 2024AIGS: Generating Science from AI-Powered Automated Falsification17 Nov 2024
- 2024Learning Interpretable Network Dynamics via Universal Neural Symbolic Regression11 Nov 2024
- 2024PatternBoost: Constructions in Mathematics with a Little Help from AI1 Nov 2024
- 2024PatternBoost: Constructions in Mathematics with a Little Help from AIcited by 32
- 2024AIGS: Generating Science from AI-Powered Automated Falsificationcited by 17
- 2025Auto-Formulating Dynamic Programming Problems with Large Language Modelscited by 15
- 2026LemmaBench: A Live, Research-Level Benchmark to Evaluate LLM Capabilities in Mathematicscited by 7
- 2025CayleyPy RL: Pathfinding and Reinforcement Learning on Cayley Graphscited by 5
- 2025Transforming Calabi-Yau Constructions: Generating New Calabi-Yau Manifolds with Transformerscited by 5
- 2024Learning Interpretable Network Dynamics via Universal Neural Symbolic Regressioncited by 4
- 2025Neural Discovery in Mathematics: Do Machines Dream of Colored Planes?cited by 4
- 2025Geometric Generality of Transformer-Based Gr"obner Basis Computationcited by 3
- 2026Flow-based Extremal Mathematical Structure Discoverycited by 3
- 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Provingcited by 2
- 2025From Black Box to Bijection: Interpreting Machine Learning to Build a Zeta Map Algorithmcited by 2
12 most cited of 26 All 26 (JSON)
- 2026Generating Special Triangulations with Transformers25 Jun 2026
- 2026Learning First Integrals via Backward-Generated Data and Guided Reinforcement Learning20 May 2026
- 2026Mapping Uncharted Symmetries: Machine Discovery in Combinatorics18 May 2026
- 2026Learning Large-Scale Modular Addition with an Auxiliary Modulus8 May 2026
- 2026Reconstructing conformal field theoretical compositions with Transformers1 May 2026
- 2026LemmaBench: A Live, Research-Level Benchmark to Evaluate LLM Capabilities in Mathematics27 Feb 2026
- 2026Approximating Matrix Functions with Deep Neural Networks and Transformers8 Feb 2026
- 2026Can Neural Networks Learn Small Algebraic Worlds? An Investigation Into the Group-theoretic Structures Learned By Narrow Models Trained To Predict Group Operations29 Jan 2026
- 2026Flow-based Extremal Mathematical Structure Discovery25 Jan 2026
- 2025From Black Box to Bijection: Interpreting Machine Learning to Build a Zeta Map Algorithm16 Nov 2025
- 2025CayleyPy Growth: Efficient growth computations and hundreds of new conjectures on Cayley graphs (Brief version)23 Sep 2025
- 2025Auto-Formulating Dynamic Programming Problems with Large Language Models15 Jul 2025
12 newest of 26 All 26 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Learning Lyapunov-Stable Polynomial Dynamical Systems through Imitation
- 2026Iteris: Agentic Research Loops for Computational Mathematics
- 2022Transformers Learn Shortcuts to Automata
- 2025Scalable Learning of High-Dimensional Demonstrations with Composition of Linear Parameter Varying Dynamical Systems
- 2024On Foundation Models for Dynamical Systems from Purely Synthetic Data
- 2026Stability and Generalization in Looped Transformers
- 2023Algebraic Dynamical Systems in Machine Learning
- 2023Learning a Stable Dynamic System with a Lyapunov Energy Function for Demonstratives Using Neural Networks