CoT-X: An Adaptive Framework for Cross-Model Chain-of-Thought Transfer and Optimization
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Long Chain-of-Thought (CoT) traces can improve reasoning accuracy, but repeatedly generating them is costly for smaller or latency-constrained language models. This paper studies a practical alternative: produce a rich rationale once with a capable thinking model, compress it, and reuse the compressed trace as context for a cheaper answering model. We introduce CoT-X, an adaptive framework for cross-model CoT transfer. CoT-X segments reasoning traces into semantic units, scores their diagnostic and logical importance, selects budget-feasible evidence paths, and reconstructs a coherent compressed rationale for the answering model. On 7,501 Japanese medical licensing questions spanning 10 specialties, CoT-X improves accuracy over direct truncation by up to 40.5% under the same token budget, with the largest gains at 64--256 tokens. Across 64 thinking--answering pairs from eight DeepSeek-R1 and Qwen3 models (1.5B--32B parameters), reasoning transfer is most reliable within a model family, yet remains effective across families once compression normalizes the trace. A Gaussian Process Bayesian optimization layer finds near-optimal model--budget configurations with 15 evaluations rather than an exhaustive search over all 64 pairs, reducing evaluation cost by 84%. These results show that reasoning quality, token budget, and model compatibility can be optimized jointly, making CoT-style reasoning more practical under realistic deployment constraints.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 44 of its 77 references that are in the map. First posted on arXiv 7 Nov 2025.
Builds on
44 of 77 references.
Closest ancestors · 5
Same direction, newest first
- 2022Teaching Small Language Models to Reason16 Dec
- 2022Large Language Models are Zero-Shot Reasoners24 May
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan
Other references · 39
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
27 more
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
- 2018A Tutorial on Bayesian Optimizationcited by 734
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
- 2023GPTScore: Evaluate as You Desirecited by 357
- 2017A Survey of Model Compression and Acceleration for Deep Neural Networkscited by 298
- 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 279
- 2021Scaling Laws for Transfercited by 265
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMscited by 246
- 2022Can large language models reason about medical questions?cited by 194
- 2018Neural Architecture Search with Bayesian Optimisation and Optimal Transportcited by 192
- 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representationscited by 192
- 2023Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinationscited by 63
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2024MedCoT: Medical Chain of Thought via Hierarchical Expertcited by 46
- 2024JMedBench: A Benchmark for Evaluating Japanese Biomedical Large Language Modelscited by 8
- 2025KokushiMD-10: Benchmark for Evaluating Large Language Models on Ten Japanese National Healthcare Licensing Examinationscited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMscited by 14
- 2026PRIME: Policy-Reinforced Iterative Multi-agent Execution for Algorithmic Reasoning in Large Language Modelscited by 0
- 2026Reasoning that Travels: Dissecting How Chain-of-Thought Transfers Across Modelscited by 0
- 2026Reasoning that Travels: Dissecting How Chain-of-Thought Transfers Across Models27 May 2026
- 2026PRIME: Policy-Reinforced Iterative Multi-agent Execution for Algorithmic Reasoning in Large Language Models19 Jan 2026
- 2025MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMs18 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2024Expediting and Elevating Large Language Model Reasoning via Hidden Chain-of-Thought Decoding
- 2025Early Stopping Chain-of-thoughts in Large Language Models
- 2024On the Hardness of Faithful Chain-of-Thought Reasoning in Large Language Models
- 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answering
- 2024Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs
- 2024Chain-of-Probe: Examining the Necessity and Accuracy of CoT Step-by-Step
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning
- 2026To Reason or Not to: Selective Chain-of-Thought in Medical Question Answering