mlsanityData to 14 Oct 2026

CrossTrace: A Cross-Domain Dataset of Grounded Scientific Reasoning Traces for Hypothesis Generation

arXiv 2603.28924 ↗First posted 30 Mar 2026cs.CLcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Scientific hypothesis generation is a critical bottleneck in accelerating research, yet existing datasets for training and evaluating hypothesis-generating models are limited to single domains and lack explicit reasoning traces connecting prior knowledge to novel contributions. I introduce CrossTrace, a dataset of 1,389 grounded scientific reasoning traces spanning biomedical research (518), AI/ML (605), and cross-domain work (266). Each trace captures the structured reasoning chain from established knowledge through intermediate logical steps to a novel hypothesis, with every step grounded in source paper text. I define an Input/Trace/Output schema that extends the Bit-Flip-Spark framework of HypoGen with step-level verification, a taxonomy of eight discovery patterns, and multi-domain coverage. Fine-tuning Qwen2.5-7B-Instruct on CrossTrace via QLoRA yields substantial improvements over the untuned baseline: IAScore rises from 0.828 to 0.968 (GPT-4o judge) and from 0.716 to 0.888 (Claude Opus 4.5), structural compliance improves from 0% to 100%, and spark cosine similarity increases from 0.221 to 0.620. Balanced cross-domain training (biomedical + AI/ML + CS) outperforms single-domain training, providing evidence that scientific reasoning patterns transfer across disciplines. Human validation of 150 stratified records confirms 99.7% step-level grounding accuracy and a 0.0% fabrication rate. To my knowledge, CrossTrace is the first large-scale, cross-domain dataset with step-level grounded reasoning traces for hypothesis generation, and my results demonstrate that such traces are an effective training signal whose benefits are at least partially domain-general.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 13 of its 25 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

13 of 25 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoning22 Jul
  2. 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning9 Sep

Other references · 11

  1. 2024Qwen2.5 Technical Reportcited by 4,942
  2. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
  3. 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Modelscited by 109
  4. 2024Hypothesis Generation with Large Language Modelscited by 71
  5. 2025ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decompositioncited by 66
  6. 2025Robin: A multi-agent system for automating scientific discoverycited by 62
  7. 2025HypoBench: Towards Systematic and Principled Benchmarking for Hypothesis Generationcited by 37
  8. 2024How Does Code Pretraining Affect Language Model Task Performance?cited by 28
  9. 2025Sparks of Science: Hypothesis Generation Using Structured Paper Datacited by 25
  10. 2024ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understandingcited by 23
  11. 2025Scientific Hypothesis Generation and Validation: Methods, Datasets, and Future Directionscited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026BioPhys-Bridge: A Benchmark for Interdisciplinary Scientific Reasoning in Physics-Grounded Biological Research
  2. 2026SPARK: Skeleton-Guided Reasoning Synthesis from Large-Scale Scientific Literature
  3. 2025HypER: Literature-grounded Hypothesis Generation and Distillation with Provenance
  4. 2025SciReasoner: Laying the Scientific Reasoning Ground Across Disciplines
  5. 2026Searching for What Matters: Open-Ended Discovery of Multiple Hypotheses with Agentic Data Exploration
  6. 2025CGBench: Benchmarking Language Model Scientific Reasoning for Clinical Genetics Research
  7. 2026Sci-MMR: Benchmarking Multi-Step Evidence-Grounded Scientific Reasoning in Multimodal Agents
  8. 2026IsoSci: A Benchmark of Isomorphic Cross-Domain Science Problems for Evaluating Reasoning versus Knowledge Retrieval in LLMs