mlsanityData to 7 Oct 2026

CoT-X: An Adaptive Framework for Cross-Model Chain-of-Thought Transfer and Optimization

arXiv 2511.05747 ↗First posted 7 Nov 2025cs.AIcited by 3

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

Abstract (arXiv)

Long Chain-of-Thought (CoT) traces can improve reasoning accuracy, but repeatedly generating them is costly for smaller or latency-constrained language models. This paper studies a practical alternative: produce a rich rationale once with a capable thinking model, compress it, and reuse the compressed trace as context for a cheaper answering model. We introduce CoT-X, an adaptive framework for cross-model CoT transfer. CoT-X segments reasoning traces into semantic units, scores their diagnostic and logical importance, selects budget-feasible evidence paths, and reconstructs a coherent compressed rationale for the answering model. On 7,501 Japanese medical licensing questions spanning 10 specialties, CoT-X improves accuracy over direct truncation by up to 40.5% under the same token budget, with the largest gains at 64--256 tokens. Across 64 thinking--answering pairs from eight DeepSeek-R1 and Qwen3 models (1.5B--32B parameters), reasoning transfer is most reliable within a model family, yet remains effective across families once compression normalizes the trace. A Gaussian Process Bayesian optimization layer finds near-optimal model--budget configurations with 15 evaluations rather than an exhaustive search over all 64 pairs, reducing evaluation cost by 84%. These results show that reasoning quality, token budget, and model compatibility can be optimized jointly, making CoT-style reasoning more practical under realistic deployment constraints.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 44 of its 77 references that are in the map. First posted on arXiv 7 Nov 2025.

Builds on

44 of 77 references.

Closest ancestors · 5

Same direction, newest first

  1. 2022Teaching Small Language Models to Reason16 Dec
  2. 2022Large Language Models are Zero-Shot Reasoners24 May
  3. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan

Other references · 39

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2020Scaling Laws for Neural Language Modelscited by 6,411
  8. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  9. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  10. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  11. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  12. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
27 more
  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  2. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  3. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  4. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  5. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  6. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  7. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  8. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  9. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  10. 2018A Tutorial on Bayesian Optimizationcited by 734
  11. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  12. 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
  13. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
  14. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  15. 2023GPTScore: Evaluate as You Desirecited by 357
  16. 2017A Survey of Model Compression and Acceleration for Deep Neural Networkscited by 298
  17. 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 279
  18. 2021Scaling Laws for Transfercited by 265
  19. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMscited by 246
  20. 2022Can large language models reason about medical questions?cited by 194
  21. 2018Neural Architecture Search with Bayesian Optimisation and Optimal Transportcited by 192
  22. 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representationscited by 192
  23. 2023Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinationscited by 63
  24. 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
  25. 2024MedCoT: Medical Chain of Thought via Hierarchical Expertcited by 46
  26. 2024JMedBench: A Benchmark for Evaluating Japanese Biomedical Large Language Modelscited by 8
  27. 2025KokushiMD-10: Benchmark for Evaluating Large Language Models on Ten Japanese National Healthcare Licensing Examinationscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Expediting and Elevating Large Language Model Reasoning via Hidden Chain-of-Thought Decoding
  2. 2025Early Stopping Chain-of-thoughts in Large Language Models
  3. 2024On the Hardness of Faithful Chain-of-Thought Reasoning in Large Language Models
  4. 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answering
  5. 2024Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs
  6. 2024Chain-of-Probe: Examining the Necessity and Accuracy of CoT Step-by-Step
  7. 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning
  8. 2026To Reason or Not to: Selective Chain-of-Thought in Medical Question Answering