Learning First Integrals via Backward-Generated Data and Guided Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
The discovery of first integrals is of fundamental scientific importance for understanding conservation laws in dynamical systems. However, existing symbolic computation tools and Large Language Models (LLMs) remain limited on this task because high-quality training data are scarce and successful solutions often depend on mathematical intuition. This paper presents FISolver, an LLM-based solver developed to address this challenge. First, we introduce a "Backward Generation" algorithm that systematically builds large-scale datasets of (differential equation, first integral) pairs by deriving differential equations from sampled integrals, thereby alleviating the data scarcity bottleneck. Second, we apply supervised fine-tuning to a compact mathematical model and further improve its performance through reinforcement learning with a Levenshtein Distance-based shaped reward. In addition, we design data synthesis and blending strategies that support effective adaptation to difficult problem families from sparse examples. Experiments show that FISolver, while requiring substantially lower computational cost, significantly outperforms larger mathematical LLMs and commercial solvers such as Mathematica on challenging benchmarks, indicating a new data-driven route for automated discovery of first integrals.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 50 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
29 of 50 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Let's Verify Step by Stepcited by 3,598
- 2024Qwen2 Technical Reportcited by 2,076
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
- 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 724
- 2019Hamiltonian Neural Networkscited by 702
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
- 2015Sequence Level Training with Recurrent Neural Networkscited by 568
- 2023Textbooks Are All You Needcited by 561
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2021Datasets: A Community Library for Natural Language Processingcited by 526
17 more
- 2020Lagrangian Neural Networkscited by 388
- 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 294
- 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 276
- 2019Deep Learning for Symbolic Mathematicscited by 266
- 2023How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Compositioncited by 222
- 2021Neural Symbolic Regression that Scalescited by 185
- 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 117
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
- 2024MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMscited by 72
- 2021Linear algebra with transformerscited by 62
- 2023Learning the greatest common divisor: explaining transformer predictionscited by 33
- 2024Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformerscited by 29
- 2022AI Poincar'e 2.0: Machine Learning Conservation Laws from Differential Equationscited by 20
- 2024Transforming the Bootstrap: Using Transformers to Compute Scattering Amplitudes in Planar N = 4 Super Yang-Mills Theorycited by 17
- 2022Constants of motion networkcited by 10
- 2018Tree Edit Distance Learning via Adaptive Symbol Embeddingscited by 4
- 2025Discovering Symmetries of ODEs by Symbolic Regressioncited by 1
Built on by
Not cited yet.