mlsanityData to 7 Oct 2026

Formula-R1: Incentivizing LLM Reasoning over Complex Tables with Numerical Computation via Formula-Driven Reinforcement Learning

arXiv 2505.23667 ↗First posted 29 May 2025cs.AIcited by 3

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Tables are a fundamental medium for organizing and analyzing data, making table reasoning a critical capability for intelligent systems. Although large language models (LLMs) exhibit strong general reasoning abilities, they still struggle with accurate numerical reasoning over tabular data, particularly in complex table settings beyond simple relational lookup. Spreadsheet formulas provide a powerful and expressive interface for executable symbolic operations, enabling rich reasoning patterns that remain largely underexplored by existing LLMs. In this paper, we introduce Formula-R1, a model trained via Formula Tuning (Fortune), a formula-driven reinforcement learning (RL) framework for table reasoning. Formula Tuning trains LLMs to generate executable spreadsheet formulas for question answering over general tabular data, using execution success and answer correctness as reward signals, thereby reducing reliance on supervised formula annotations. We demonstrate the effectiveness of Formula Tuning through extensive experiments on seven table reasoning benchmarks. It substantially improves LLM performance on table reasoning, particularly for tasks involving complex tables and multi-step numerical computation. Moreover, Formula-R1 consistently outperforms prior methods under controlled comparison settings. Beyond empirical gains, our extensive analyses provide insights into the role of RL in formula-driven table reasoning, highlighting the broader potential of formula-driven RL to enhance reasoning capabilities in LLMs.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 64 of its 83 references that are in the map. First posted on arXiv 29 May 2025.

Builds on

64 of 83 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tables5 Dec
  2. 2024A Survey of Table Reasoning with Large Language Models13 Feb
  3. 2024Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding9 Jan
  4. 2023Rethinking Tabular Data Understanding with Large Language Models27 Dec
  5. 2023Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoning31 Jan
  6. 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generation15 Aug

Other references · 58

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2017Proximal Policy Optimization Algorithmscited by 14,441
  5. 2024The Llama 3 Herd of Modelscited by 14,192
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  8. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  9. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  10. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  11. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  12. 2017Deep reinforcement learning from human preferencescited by 3,846
38 more
  1. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  2. 2023Let's Verify Step by Stepcited by 3,598
  3. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  4. 2020Learning to summarize from human feedbackcited by 2,562
  5. 2022Emergent Abilities of Large Language Modelscited by 2,483
  6. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  7. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  8. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  9. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  10. 2022Solving math word problems with process- and outcome-based feedbackcited by 871
  11. 2022PAL: Program-aided Language Modelscited by 635
  12. 2023Textbooks Are All You Needcited by 561
  13. 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
  14. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
  15. 2024Large Language Models: A Surveycited by 506
  16. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
  17. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
  18. 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
  19. 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
  20. 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 257
  21. 2021TAPEX: Table Pre-training via Learning a Neural SQL Executorcited by 233
  22. 2025REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalizationcited by 233
  23. 2022Binding Language Models in Symbolic Languagescited by 224
  24. 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
  25. 2024Multi-Step Reasoning with Large Language Models, a Surveycited by 140
  26. 2023TableLlama: Towards Open Large Generalist Models for Tablescited by 136
  27. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 127
  28. 2024Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worsecited by 107
  29. 2023ReAcTable: Enhancing ReAct for Table Question Answeringcited by 76
  30. 2024TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarioscited by 76
  31. 2024TableGPT2: A Large Multimodal Model with Tabular Data Integrationcited by 69
  32. 2025DeepRetrieval: Hacking Real Search Engines and Retrievers with Large Language Models via Reinforcement Learningcited by 62
  33. 2023TableGPT: Towards Unifying Tables, Nature Language and Commands into One GPTcited by 57
  34. 2021SpreadsheetCoder: Formula Prediction from Semi-structured Contextcited by 41
  35. 2022PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-trainingcited by 41
  36. 2023Text2Analysis: A Benchmark of Table Question Answering with Advanced Data Analysis and Unclear Queriescited by 38
  37. 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learningcited by 32
  38. 2021FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretrainingcited by 19

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning-Table: Exploring Reinforcement Learning for Table Reasoning
  2. 2025TableGPT-R1: Advancing Tabular Reasoning Through Reinforcement Learning
  3. 2025Table-R1: Region-based Reinforcement Learning for Table Understanding
  4. 2025TableMind: An Autonomous Programmatic Agent for Tool-Augmented Table Reasoning
  5. 2025STaR: Towards Effective and Stable Table Reasoning via Slow-Thinking Large Language Models
  6. 2025Sparks of Tabular Reasoning via Text2SQL Reinforcement Learning
  7. 2025Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspective
  8. 2025Mixture-of-Minds: Multi-Agent Reinforcement Learning for Table Understanding