Data-Centric Post-Training for Financial Reasoning: Mining, Distillation, and Verifiable Learning
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Financial text, textbooks, and question-answer pairs are abundant, but only a small fraction is directly usable for reasoning-focused post-training. Existing QA pairs often lack explicit reasoning, sufficient context, or reliably verifiable answers, while textbooks must first be transformed into synthetic training examples. We present a data-centric pipeline that constructs complementary corpora by mining open-source reasoning traces, distilling financial instruction data, and generating knowledge-graph-guided question-answer pairs from financial educational material. After semantic deduplication, three lightweight sequence classifiers select finance-relevant examples, reject under-specified questions, and identify tasks suitable for reinforcement learning with compact rule-based verifiers. For model adaptation, we study supervised fine-tuning and reinforcement learning, while self-distilled fine-tuning and post-training model merging are used to prevent the loss of financial capabilities already present in the starting model. We evaluate the adapted language models using FINESSE-Bench, reporting aggregate performance and changes relative to their starting checkpoints. Across the selected comparisons, ordinary SFT reduces FINESSE-Bench accuracy by 3.2-4.0 percentage points, whereas self-distilled SFT improves over the corresponding starting models by 1.0-2.8 points. Equal-weight merging recovers 3.0 points over its SFT parent and finishes 0.9 points above the original model; GRPO on hard tasks adds 0.4 points after self-distilled SFT or 3.0 points when applied directly to verifiable tasks. These results show that retention-aware adaptation can improve financial reasoning without the regressions observed after ordinary SFT.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 13 of its 18 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
13 of 18 references.
Closest ancestors · 2
Same direction, newest first
- 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learning20 Mar
- 2025Fino1: On the Transferability of Reasoning-Enhanced LLMs and Reinforcement Learning to Finance12 Feb
Other references · 11
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2021Robust fine-tuning of zero-shot modelscited by 785
- 2016FastText.zip: Compressing text classification modelscited by 331
- 2025GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generationcited by 7
- 2026Why Fine-Tuning Encourages Hallucinations and How to Fix Itcited by 6
- 2026FINESSE-Bench: A Hierarchical Benchmark Suite for Financial Domain Knowledge and Technical Analysis in Large Language Modelscited by 4
- 2026Unlocking Data Value in Finance: A Study on Distillation and Difficulty-Aware Trainingcited by 3
- 2026QuantCode-Bench: A Benchmark for Evaluating the Ability of Large Language Models to Generate Executable Algorithmic Trading Strategiescited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ASDA: Automated Skill Distillation and Adaptation for Financial Reasoning
- 2025DianJin-R1: Evaluating and Enhancing Financial Reasoning in Large Language Models
- 2026Gold-Guided Programmatic Distillation for Financial Reasoning over Hybrid Tables and Text
- 2024FinLLMs: A Framework for Financial Reasoning Dataset Generation with Large Language Models
- 2024Fine-tuning Smaller Language Models for Question Answering over Financial Documents
- 2025Agentar-Fin-R1: Enhancing Financial Intelligence through Domain Expertise, Training Efficiency, and Advanced Reasoning
- 2023Beyond Classification: Financial Reasoning in State-of-the-Art Language Models
- 2026V-FiLLM: Verified Financial LLM Reasoning Benchmark