mlsanityData to 14 Oct 2026

SPARK: Skeleton-Guided Reasoning Synthesis from Large-Scale Scientific Literature

arXiv 2608.30214 ↗First posted 31 Aug 2026cs.AIcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Scientific reasoning remains challenging for open-source models, largely due to the lack of high-quality scientific reasoning data. Existing datasets are often dominated by factual recall or formulaic problem solving, with limited emphasis on mechanism understanding, evidence-grounded reasoning, and hypothesis evaluation. To address this, we introduce SPARK (Scientific Paper Abstracted Reasoning sKeleton), a paper-oriented synthesis framework built on Sci-Base, a large-scale corpus of research papers spanning 10 scientific disciplines. Instead of directly converting papers into question-answer pairs, SPARK treats the claim-evidence-derivation structure of a paper as the fundamental unit of reasoning synthesis. Specifically, SPARK (1) distills each paper into a compact reasoning skeleton capturing its central claims and supporting evidence, enabling self-contained question generation, and (2) synthesizes reasoning tasks from four scientific perspectives: mechanistic reasoning, hypothesis falsification, quantitative derivation, and boundary calibration. A final consistency verification stage further removes unsupported or contradictory outputs. Using this framework, we construct Spark-234K, a scientific reasoning dataset with substantially higher difficulty and diversity than existing resources. Experiments show that Spark-234K consistently outperforms existing scientific reasoning datasets while achieving stronger performance with significantly fewer training samples.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 71 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

29 of 71 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026WildSci: Advancing Scientific Reasoning from In-the-Wild Literature9 Jan

Other references · 28

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  6. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  7. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  8. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  9. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  10. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  11. 2022Galactica: A Large Language Model for Sciencecited by 744
  12. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
16 more
  1. 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
  2. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
  3. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 256
  4. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
  5. 2023SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Researchcited by 115
  6. 2021Decontextualization: Making Sentences Stand-Alonecited by 102
  7. 2025SCP-116K: A High-Quality Problem-Solution Dataset and a Generalized Pipeline for Automated Extraction in the Higher Education Science Domaincited by 31
  8. 2024CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Masterycited by 30
  9. 2025MathFusion: Enhancing Mathematical Problem-solving of LLM through Instruction Fusioncited by 30
  10. 2024SciQAG: A Framework for Auto-Generated Science Question Answering Dataset with Fine-grained Evaluationcited by 24
  11. 2024MedQA-CS: Objective Structured Clinical Examination (OSCE)-Style Benchmark for Evaluating LLM Clinical Skillscited by 17
  12. 2025OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Valuecited by 15
  13. 2025Savaal: Scalable Concept-Driven Question Generation to Enhance Human Learningcited by 7
  14. 2025Knowing What's Missing: Assessing Information Sufficiency in Question Answeringcited by 3
  15. 2025ResearchGPT: Benchmarking and Training LLMs for End-to-End Computer Science Research Workflowscited by 2
  16. 2026Tracing the Roots: A Multi-Agent Framework for Uncovering Data Lineage in Post-Training LLMscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Large Knowledge Model: From Papers to a Scientific Reasoning Landscape
  2. 2025Sparks of Science: Hypothesis Generation Using Structured Paper Data
  3. 2025MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoning
  4. 2025SciNets: Graph-Constrained Multi-Hop Reasoning for Scientific Literature Synthesis
  5. 2026SciR: A Controllable Benchmark for Scientific Reasoning in LLMs
  6. 2026BioPhys-Bridge: A Benchmark for Interdisciplinary Scientific Reasoning in Physics-Grounded Biological Research
  7. 2026LitTraceQA: A Benchmark for Multi-Stage Grounding and Verification in Scientific Question Answering
  8. 2026Sci-MMR: Benchmarking Multi-Step Evidence-Grounded Scientific Reasoning in Multimodal Agents