CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Tasks
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
While Chain-of-Thought prompting is popular in reasoning tasks, its application to Large Language Models (LLMs) in Natural Language Understanding (NLU) is under-explored. Motivated by multi-step reasoning of LLMs, we propose Coarse-to-Fine Chain-of-Thought (CoF-CoT) approach that breaks down NLU tasks into multiple reasoning steps where LLMs can learn to acquire and leverage essential concepts to solve tasks from different granularities. Moreover, we propose leveraging semantic-based Abstract Meaning Representation (AMR) structured knowledge as an intermediate step to capture the nuances and diverse structures of utterances, and to understand connections between their varying levels of granularity. Our proposed approach is demonstrated effective in assisting the LLMs adapt to the multi-grained NLU tasks under both zero-shot and few-shot multi-domain settings.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 28 references that are in the map. First posted on arXiv 23 Oct 2023.
Builds on
22 of 28 references.
Closest ancestors · 4
Same direction, newest first
- 2023Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Framework5 May
- 2022Complexity-Based Prompting for Multi-Step Reasoning3 Oct
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
Other references · 18
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2020SLURP: A Spoken Language Understanding Resource Packagecited by 198
- 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 158
- 2018Joint Slot Filling and Intent Detection via Capsule Neural Networkscited by 73
- 2018A Survey on Semantic Parsingcited by 62
- 2019SG-Net: Syntax-Guided Machine Reading Comprehensioncited by 52
- 2021Syntax-BERT: Improving Pre-trained Transformers with Syntax Treescited by 51
- 2020SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Fillingcited by 42
- 2020Syntax-Enhanced Pre-trained Modelcited by 30
6 more
- 2019Enhancing Machine Translation with Dependency-Aware Self-Attentioncited by 24
- 2020CG-BERT: Conditional Text Generation with BERT for Generalized Few-shot Intent Detectioncited by 23
- 2020Dynamic Semantic Matching and Aggregation Network for Few-shot Intent Detectioncited by 17
- 2023Enhancing Cross-lingual Transfer via Phonemic Transcription Integrationcited by 11
- 2023Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learningcited by 4
- 2022XQA-DST: Multi-Domain and Multi-Lingual Dialogue State Trackingcited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 7; 2025: 7; 2026: 3.
18 papers.
Sort:
By area:
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2024Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoningcited by 110
- 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 51
- 2024TimeRefine: Temporal Grounding with Time Refining Video LLMcited by 15
- 2025What Makes a Good Natural Language Prompt?cited by 7
- 2024Prompting with Phonemes: Enhancing LLMs' Multilinguality for Non-Latin Script Languagescited by 6
- 2025Beyond In-Distribution Success: Scaling Curves of CoT Granularity for Language Model Generalizationcited by 5
- 2024CORI: CJKV Benchmark with Romanization Integration -- A step towards Cross-lingual Transfer Beyond Textual Scriptscited by 4
- 2025Semantic Mastery: Enhancing LLMs with Advanced Natural Language Understandingcited by 4
- 2023kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest Neighbor In-Context Learningcited by 3
- 2025PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowchartscited by 3
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generationcited by 2
6 more
- 2026Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domainscited by 2
- 2025From Large to Super-Tiny: End-to-End Optimization for Cost-Efficient LLMscited by 1
- 2024Traffic Light or Light Traffic? Investigating Phrasal Semantics in Large Language Modelscited by 0
- 2025SalaMAnder: Shapley-based Mathematical Expression Attribution and Metric for Chain-of-Thought Reasoningcited by 0
- 2026LLM-Driven Multi-Turn Task-Oriented Dialogue Synthesis for Realistic Reasoningcited by 0
- 2026Learning Generalizable Multimodal Representations for Software Vulnerability Detectioncited by 0
- 2026Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domains17 May 2026
- 2026Learning Generalizable Multimodal Representations for Software Vulnerability Detection28 Apr 2026
- 2026LLM-Driven Multi-Turn Task-Oriented Dialogue Synthesis for Realistic Reasoning27 Feb 2026
- 2025SalaMAnder: Shapley-based Mathematical Expression Attribution and Metric for Chain-of-Thought Reasoning20 Sep 2025
- 2025What Makes a Good Natural Language Prompt?7 Jun 2025
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generation26 May 2025
- 2025From Large to Super-Tiny: End-to-End Optimization for Cost-Efficient LLMs18 Apr 2025
- 2025Semantic Mastery: Enhancing LLMs with Advanced Natural Language Understanding1 Apr 2025
- 2025PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts9 Mar 2025
- 2025Beyond In-Distribution Success: Scaling Curves of CoT Granularity for Language Model Generalization25 Feb 2025
- 2024TimeRefine: Temporal Grounding with Time Refining Video LLM12 Dec 2024
- 2024Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning12 Dec 2024
6 more
- 2024Prompting with Phonemes: Enhancing LLMs' Multilinguality for Non-Latin Script Languages4 Nov 2024
- 2024Traffic Light or Light Traffic? Investigating Phrasal Semantics in Large Language Models3 Oct 2024
- 2024CORI: CJKV Benchmark with Romanization Integration -- A step towards Cross-lingual Transfer Beyond Textual Scripts19 Apr 2024
- 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers7 Apr 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2023kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest Neighbor In-Context Learning17 Dec 2023
- 2024Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoningcited by 110
- 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 51
- 2025SalaMAnder: Shapley-based Mathematical Expression Attribution and Metric for Chain-of-Thought Reasoningcited by 0
- 2026LLM-Driven Multi-Turn Task-Oriented Dialogue Synthesis for Realistic Reasoningcited by 0
- 2026LLM-Driven Multi-Turn Task-Oriented Dialogue Synthesis for Realistic Reasoning27 Feb 2026
- 2025SalaMAnder: Shapley-based Mathematical Expression Attribution and Metric for Chain-of-Thought Reasoning20 Sep 2025
- 2024Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning12 Dec 2024
- 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers7 Apr 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2024TimeRefine: Temporal Grounding with Time Refining Video LLMcited by 15
- 2025What Makes a Good Natural Language Prompt?cited by 7
- 2024Prompting with Phonemes: Enhancing LLMs' Multilinguality for Non-Latin Script Languagescited by 6
- 2025Beyond In-Distribution Success: Scaling Curves of CoT Granularity for Language Model Generalizationcited by 5
- 2024CORI: CJKV Benchmark with Romanization Integration -- A step towards Cross-lingual Transfer Beyond Textual Scriptscited by 4
- 2025Semantic Mastery: Enhancing LLMs with Advanced Natural Language Understandingcited by 4
- 2023kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest Neighbor In-Context Learningcited by 3
- 2025PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowchartscited by 3
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generationcited by 2
- 2025From Large to Super-Tiny: End-to-End Optimization for Cost-Efficient LLMscited by 1
- 2024Traffic Light or Light Traffic? Investigating Phrasal Semantics in Large Language Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Learning Generalizable Multimodal Representations for Software Vulnerability Detection28 Apr 2026
- 2025What Makes a Good Natural Language Prompt?7 Jun 2025
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generation26 May 2025
- 2025From Large to Super-Tiny: End-to-End Optimization for Cost-Efficient LLMs18 Apr 2025
- 2025Semantic Mastery: Enhancing LLMs with Advanced Natural Language Understanding1 Apr 2025
- 2025PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts9 Mar 2025
- 2025Beyond In-Distribution Success: Scaling Curves of CoT Granularity for Language Model Generalization25 Feb 2025
- 2024TimeRefine: Temporal Grounding with Time Refining Video LLM12 Dec 2024
- 2024Prompting with Phonemes: Enhancing LLMs' Multilinguality for Non-Latin Script Languages4 Nov 2024
- 2024Traffic Light or Light Traffic? Investigating Phrasal Semantics in Large Language Models3 Oct 2024
- 2024CORI: CJKV Benchmark with Romanization Integration -- A step towards Cross-lingual Transfer Beyond Textual Scripts19 Apr 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understanding
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning
- 2025CoT Vectors: Transferring and Probing the Reasoning Mechanisms of LLMs
- 2026Attention-guided Fine-tuning of Multimodal Large Language Models Improves Chain-of-Thought Reasoning
- 2024Enhancing Chain of Thought Prompting in Large Language Models via Reasoning Patterns
- 2023Semi-Structured Chain-of-Thought: Integrating Multiple Sources of Knowledge for Improved Language Model Reasoning
- 2025Advancing Reasoning in Large Language Models: Promising Methods and Approaches
- 2024Expediting and Elevating Large Language Model Reasoning via Hidden Chain-of-Thought Decoding