Re-TASK: Revisiting LLM Tasks from Capability, Skill, and Knowledge Perspectives
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
The Chain-of-Thought (CoT) paradigm has become a pivotal method for solving complex problems with large language models (LLMs). However, its application to domain-specific tasks remains challenging, as LLMs often fail to decompose tasks accurately or execute subtasks effectively. This paper introduces the Re-TASK framework, a novel theoretical model that revisits LLM tasks from capability, skill, and knowledge perspectives, drawing on the principles of Bloom's Taxonomy and Knowledge Space Theory. While CoT provides a workflow-centric perspective on tasks, Re-TASK introduces a Chain-of-Learning (CoL) paradigm that highlights task dependencies on specific capability items, further broken down into their constituent knowledge and skill components. To address CoT failures, we propose a Re-TASK prompting strategy, which strengthens task-relevant capabilities through targeted knowledge injection and skill adaptation. Experiments across diverse domains demonstrate the effectiveness of Re-TASK. In particular, we achieve improvements of 45.00% on Yi-1.5-9B and 24.50% on Llama3-Chinese-8B for legal tasks. These results highlight the potential of Re-TASK to significantly enhance LLM performance and its applicability in specialized domains. We release our code and data at https://github.com/Uylee/Re-TASK.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 36 references that are in the map. First posted on arXiv 13 Aug 2024.
Builds on
27 of 36 references.
Closest ancestors · 5
Same direction, newest first
- 2023Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models9 Oct
- 2022Large Language Models are Zero-Shot Reasoners24 May
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan
Other references · 22
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Let's Verify Step by Stepcited by 3,789
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023Qwen Technical Reportcited by 3,344
- 2023Mistral 7Bcited by 3,164
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
10 more
- 2022A Survey on In-context Learningcited by 721
- 2024Yi: Open Foundation Models by 01.AIcited by 719
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2021Generated Knowledge Prompting for Commonsense Reasoningcited by 214
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 195
- 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 170
- 2023Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Modelscited by 121
- 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
- 2023KoLA: Carefully Benchmarking World Knowledge of Large Language Modelscited by 85
- 2024Can Large Language Models Reason and Plan?cited by 82
Built on by
Citing papers per year: 2024: 4; 2025: 5; 2026: 4.
13 papers.
Sort:
By area:
- 2024Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitationcited by 19
- 2024Benchmarking Cognitive Domains for LLMs: Insights from Taiwanese Hakka Culturecited by 6
- 2024The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarkscited by 6
- 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoningcited by 3
- 2024Conceptual In-Context Learning and Chain of Concepts: Solving Complex Conceptual Problems Using Large Language Modelscited by 2
- 2025FinEval-KR: A Financial Domain Evaluation Framework for Large Language Models' Knowledge and Reasoningcited by 2
- 2025From Parameters to Prompts: Understanding and Mitigating the Factuality Gap between Fine-Tuned LLMscited by 1
- 2025From Memorization to Generalization: Fine-Tuning Large Language Models for Biomedical Term-to-Identifier Normalizationcited by 1
- 2026UsefulBench: Towards Decision-Useful Information as a Target for Information Retrievalcited by 1
- 2025Evaluating Cultural Knowledge Processing in Large Language Models: A Cognitive Benchmarking Framework Integrating Retrieval-Augmented Generationcited by 0
- 2026Towards Scalable Customization and Deployment of Multi-Agent Systems for Enterprise Applicationscited by 0
- 2026Task Decomposition for Efficient Annotationcited by 0
1 more
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoning28 Sep 2026
- 2026Task Decomposition for Efficient Annotation23 Jun 2026
- 2026Towards Scalable Customization and Deployment of Multi-Agent Systems for Enterprise Applications16 Jun 2026
- 2026UsefulBench: Towards Decision-Useful Information as a Target for Information Retrieval17 Apr 2026
- 2025Evaluating Cultural Knowledge Processing in Large Language Models: A Cognitive Benchmarking Framework Integrating Retrieval-Augmented Generation3 Nov 2025
- 2025From Memorization to Generalization: Fine-Tuning Large Language Models for Biomedical Term-to-Identifier Normalization21 Oct 2025
- 2025FinEval-KR: A Financial Domain Evaluation Framework for Large Language Models' Knowledge and Reasoning18 Jun 2025
- 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning13 Jun 2025
- 2025From Parameters to Prompts: Understanding and Mitigating the Factuality Gap between Fine-Tuned LLMs29 May 2025
- 2024Conceptual In-Context Learning and Chain of Concepts: Solving Complex Conceptual Problems Using Large Language Models19 Dec 2024
- 2024The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarks9 Oct 2024
- 2024Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitation5 Sep 2024
1 more
- 2024Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitationcited by 19
- 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoningcited by 3
- 2025FinEval-KR: A Financial Domain Evaluation Framework for Large Language Models' Knowledge and Reasoningcited by 2
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoningcited by 0
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoning28 Sep 2026
- 2025FinEval-KR: A Financial Domain Evaluation Framework for Large Language Models' Knowledge and Reasoning18 Jun 2025
- 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning13 Jun 2025
- 2024Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitation5 Sep 2024
- 2024Benchmarking Cognitive Domains for LLMs: Insights from Taiwanese Hakka Culturecited by 6
- 2024The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarkscited by 6
- 2024Conceptual In-Context Learning and Chain of Concepts: Solving Complex Conceptual Problems Using Large Language Modelscited by 2
- 2025From Parameters to Prompts: Understanding and Mitigating the Factuality Gap between Fine-Tuned LLMscited by 1
- 2025From Memorization to Generalization: Fine-Tuning Large Language Models for Biomedical Term-to-Identifier Normalizationcited by 1
- 2026UsefulBench: Towards Decision-Useful Information as a Target for Information Retrievalcited by 1
- 2026Task Decomposition for Efficient Annotationcited by 0
- 2026Task Decomposition for Efficient Annotation23 Jun 2026
- 2026UsefulBench: Towards Decision-Useful Information as a Target for Information Retrieval17 Apr 2026
- 2025From Memorization to Generalization: Fine-Tuning Large Language Models for Biomedical Term-to-Identifier Normalization21 Oct 2025
- 2025From Parameters to Prompts: Understanding and Mitigating the Factuality Gap between Fine-Tuned LLMs29 May 2025
- 2024Conceptual In-Context Learning and Chain of Concepts: Solving Complex Conceptual Problems Using Large Language Models19 Dec 2024
- 2024The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarks9 Oct 2024
- 2024Benchmarking Cognitive Domains for LLMs: Insights from Taiwanese Hakka Culture3 Sep 2024
Similar, not cited
Close in wording, no citation either way
- 2025Rectifying LLM Thought from Lens of Optimization
- 2025Mapping the Minds of LLMs: A Graph-Based Analysis of Reasoning LLM
- 2026Beyond Prompt or Skill? Attribution-Guided Optimization of Modular LLM Programs
- 2025Chain-of-Thought Matters: Improving Long-Context Language Models with Reasoning Path Supervision
- 2026Beyond the Prompt in Large Language Models: Comprehension, In-Context Learning, and Chain-of-Thought
- 2026Enhancing LLM Instruction Following: An Evaluation-Driven Multi-Agentic Workflow for Prompt Instructions Optimization
- 2025Why Prompt Design Matters and Works: A Complexity Analysis of Prompt Search Space in LLMs
- 2026SKILL-KD: Contrastive Skill Distillation for LLM Agents