mlsanityData to 7 Oct 2026

NebulaExp-8B: An Empirical Post-Training Pipeline via Full-Scale Ablation Research

arXiv 2606.26671 ↗First posted 25 Jun 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Post-training alignment determines the reasoning and human preference following capabilities of large language models, yet most existing works withhold detailed data construction, filtering rules and training recipes, which hinders community reproducibility and lightweight model optimization. This work presents NebulaExp, a fully transparent, ablation-driven post-training pipeline built on Qwen3-8B-base, covering two orthogonal model branches: general instruct model and complex reasoning-specialized model. We curate a raw corpus of 3.84M multi-source SFT samples and a 200K verifiable RL candidate pool, and design an end-to-end data processing stack including response distillation, multi-dimensional cross-verification filtering, fine-grained difficulty grading, task classification and diversity-aware sampling. For the Instruct branch, our three-stage optimized supervised fine-tuning approach NebulaExp-Ins-SFT improves the average benchmark score from the 55.01 baseline of Qwen3-8B-nothink to 60.99. GRPO reinforcement learning then further elevates the average score to 61.85. For the Reasoning branch, medium-difficulty GRPO RL improves average reasoning score from 73.88 to 75.17. To address RL's dependency on task verifiers, we systematically investigate single-teacher and multi-teacher OPD (MOPD): utilizing merely 4K instruction-following samples and outperforms RL baseline by 3.26 points on IFEval with +4.43 average overall gain; MOPD fuses four domain-specialist teachers with merely 10K samples, lifting average performance by 4.18 over the base model. This report provides a fully reproducible empirical post-training recipe for 8B-scale LLMs, and comprehensively dissects the capability trade-offs among instruction adherence, mathematical reasoning, code generation and general knowledge.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 38 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

30 of 38 references.

References · 30

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2024Qwen2.5 Technical Reportcited by 4,713
  8. 2023Let's Verify Step by Stepcited by 3,598
  9. 2023Qwen Technical Reportcited by 3,273
  10. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  11. 2024Qwen2 Technical Reportcited by 2,076
  12. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
18 more
  1. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  2. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
  3. 2025OpenAI GPT-5 System Cardcited by 910
  4. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  5. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
  6. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  7. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
  8. 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 301
  9. 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoningcited by 186
  10. 2024Are We Done with MMLU?cited by 178
  11. 2025Generalizing Verifiable Instruction Followingcited by 178
  12. 2025Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Modelscited by 45
  13. 2025AutoLogi: Automated Generation of Logic Puzzles for Evaluating Reasoning Abilities of Large Language Modelscited by 29
  14. 2025Not All Correct Answers Are Equal: Why Your Distillation Source Matterscited by 25
  15. 2026The Llama 4 Herd: Architecture, Training, Evaluation, and Deployment Notescited by 25
  16. 2025Nemotron-Math: Efficient Long-Context Distillation of Mathematical Reasoning from Multi-Mode Supervisioncited by 22
  17. 2025Reasoning with OmniThought: A Large CoT Dataset with Verbosity and Cognitive Difficulty Annotationscited by 14
  18. 2025Closing the Data Loop: Using OpenDataArena to Engineer Superior Training Datasetscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Post-Reasoning: Improving the Performance of Non-Thinking Models at No Cost
  2. 2025A Comprehensive FP8 Training Recipe for Reasoning-Enhanced Language Models
  3. 2025Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Models
  4. 2025Quagmires in SFT-RL Post-Training: When High SFT Scores Mislead and What to Use Instead
  5. 2025Towards a Unified View of Large Language Model Post-Training
  6. 2025A Survey on Post-training of Large Language Models
  7. 2025On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models
  8. 2026Exploration-Driven Optimization for Test-Time Large Language Model Reasoning