mlsanityData to 7 Oct 2026

Breaking Thought Patterns: A Multi-Dimensional Reasoning Framework for LLMs

arXiv 2506.13192 ↗First posted 16 Jun 2025cs.CL cs.AIcited by 1

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

also in 1 more
Abstract (arXiv)

Large language models (LLMs) are often constrained by rigid reasoning processes, limiting their ability to generate creative and diverse responses. To address this, a novel framework called LADDER is proposed, combining Chain-of-Thought (CoT) reasoning, Mixture of Experts (MoE) models, and multi-dimensional up/down-sampling strategies which breaks the limitations of traditional LLMs. First, CoT reasoning guides the model through multi-step logical reasoning, expanding the semantic space and breaking the rigidity of thought. Next, MoE distributes the reasoning tasks across multiple expert modules, each focusing on specific sub-tasks. Finally, dimensionality reduction maps the reasoning outputs back to a lower-dimensional semantic space, yielding more precise and creative responses. Extensive experiments across multiple tasks demonstrate that LADDER significantly improves task completion, creativity, and fluency, generating innovative and coherent responses that outperform traditional models. Ablation studies reveal the critical roles of CoT and MoE in enhancing reasoning abilities and creative output. This work contributes to the development of more flexible and creative LLMs, capable of addressing complex and novel tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 45 references that are in the map. First posted on arXiv 16 Jun 2025.

Builds on

33 of 45 references.

Closest ancestors · 3

Same direction, newest first

  1. 2022Large Language Models are Zero-Shot Reasoners24 May
  2. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan

Other references · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2025Qwen3 Technical Reportcited by 8,195
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  8. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  10. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  11. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  12. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
18 more
  1. 2022Emergent Abilities of Large Language Modelscited by 2,483
  2. 2024Mixtral of Expertscited by 1,785
  3. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  4. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  5. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  6. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  7. 2021Scaling Vision with Sparse Mixture of Expertscited by 740
  8. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
  9. 2022Mixture-of-Experts with Expert Choice Routingcited by 611
  10. 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 599
  11. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  12. 2023Learning to Compress Prompts with Gist Tokenscited by 379
  13. 2022Mixture of Attention Heads: Selecting Attention Heads Per Tokencited by 58
  14. 2017Simple and Effective Dimensionality Reduction for Word Embeddingscited by 38
  15. 2024Can Large Language Models generalize analogy solving like children can?cited by 9
  16. 2025Triple Phase Transitions: Understanding the Learning Dynamics of Large Language Models from a Neuroscience Perspectivecited by 4
  17. 2024MoE-Enhanced Explainable Deep Manifold Transformation for Complex Data Embedding and Visualizationcited by 3
  18. 2018Concept-Based Embeddings for Natural Language Processingcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Universe of Thoughts: Enabling Creative Reasoning with Large Language Models
  2. 2024Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs
  3. 2024Understanding Chain-of-Thought in LLMs through Information Theory
  4. 2024Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitation
  5. 2024Unlocking the Capabilities of Thought: A Reasoning Boundary Framework to Quantify and Optimize Chain-of-Thought
  6. 2025Mapping the Minds of LLMs: A Graph-Based Analysis of Reasoning LLM
  7. 2026Hierarchical Chain-of-Thought: Enhancing LLM Reasoning Performance and Efficiency
  8. 2025Chain or tree? Re-evaluating complex reasoning from the perspective of a matrix of thought