mlsanityData to 14 Oct 2026

AutoCAP: Towards Automatic Cross-lingual Alignment Planning for Zero-shot Chain-of-Thought

arXiv 2406.13940 ↗First posted 20 Jun 2024cs.CLcited by 19

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Cross-lingual chain-of-thought can effectively complete reasoning tasks across languages, which gains increasing attention. Recently, dominant approaches in the literature improve cross-lingual alignment capabilities by integrating reasoning knowledge from different languages. Despite achieving excellent performance, current methods still have two main challenges: (1) Manual language specification: They still highly rely on manually selecting the languages to integrate, severely affecting their generalizability; (2) Static weight allocation: Current methods simply integrate all languages equally. In fact, different language reasoning paths should have different weights to achieve better complementation and integration. Motivated by this, we introduce an Automatic Cross-lingual Alignment Planning (AutoCAP) for zero-shot chain-of-thought to address the above challenges. The core of AutoCAP consists of two components: (1) Automatic Language Selection Prompting to guide LLMs to select appropriate languages and (2) Automatic Weight Allocation Prompting to automatically allocate alignment weight scores to each reasoning path. Extensive experiments on several benchmarks reveal that AutoCAP achieves state-of-the-art performance, surpassing previous methods that required manual effort.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 14 of its 29 references that are in the map. First posted on arXiv 20 Jun 2024.

Builds on

14 of 29 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers7 Apr
  2. 2024xCoT: Cross-lingual Instruction Tuning for Cross-lingual Chain-of-Thought Reasoning13 Jan
  3. 2023Empowering Multi-step Reasoning across Languages via Tree-of-Thoughts14 Nov
  4. 2023Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners24 May
  5. 2023LLaMA: Open and Efficient Foundation Language Models27 Feb

Other references · 9

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  3. 2023Mistral 7Bcited by 3,164
  4. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
  5. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
  6. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 530
  7. 2021Few-shot Learning with Multilingual Language Modelscited by 278
  8. 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thoughtcited by 121
  9. 2024Large Language Models Meet NLP: A Surveycited by 103

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 9; 2026: 6.

19 papers.

Sort:

By area:

  1. 2025The Emergence of Abstract Thought in Large Language Models Beyond Any Languagecited by 21
  2. 2025ViTCoT: Video-Text Interleaved Chain-of-Thought for Boosting Video Understanding in Large Language Modelscited by 18
  3. 2024What are the Essential Factors in Crafting Effective Long Context Multi-Hop Instruction Datasets? Insights and Best Practicescited by 14
  4. 2024Wrong-of-Thought: An Integrated Reasoning Framework with Multi-Perspective Verification and Wrong Informationcited by 10
  5. 2026Understanding Multilingualism in Mixture-of-Experts LLMs: Routing Mechanism, Expert Specialization, and Layerwise Steeringcited by 10
  6. 2025Large Reasoning Embedding Models: Towards Next-Generation Dense Retrieval Paradigmcited by 9
  7. 2025LAVCap: LLM-based Audio-Visual Captioning using Optimal Transportcited by 7
  8. 2025CCHall: A Novel Benchmark for Joint Cross-Lingual and Cross-Modal Hallucinations Detection in Large Language Modelscited by 7
  9. 2024Lens: Rethinking Multilingual Enhancement for Large Language Modelscited by 6
  10. 2024Exploring Prompt Engineering: A Systematic Review with SWOT Analysiscited by 5
  11. 2025MLDebugging: Towards Benchmarking Code Debugging Across Multi-Library Scenarioscited by 3
  12. 2026Latent Visual Cache for Video Reasoningcited by 3
7 more
  1. 2025A Survey on Training-free Alignment of Large Language Modelscited by 2
  2. 2026SinkTrack: Attention Sink based Context Anchoring for Large Language Modelscited by 2
  3. 2025Uncovering inequalities in new knowledge learning by large language models across different languagescited by 1
  4. 2025What Factors Affect LLMs and RLLMs in Financial Question Answering?cited by 1
  5. 2026Thinking Traps in Long Chain-of-Thought: A Measurable Study and Trap-Aware Adaptive Restartcited by 1
  6. 2026Less Languages, Less Tokens: An Efficient Unified Logic Cross-lingual Chain-of-Thought Reasoning Frameworkcited by 1
  7. 2026Bridging the English-Arabic Medical Knowledge Gap: Targeted Low-Rank Adaptation via Causal Layer Selectioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languages
  2. 2026Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages
  3. 2026Soft Token Alignment for Cross-Lingual Reasoning
  4. 2025Cross-Lingual Consistency: A Novel Inference Framework for Advancing Reasoning in Large Language Models
  5. 2025AdaMCoT: Rethinking Cross-Lingual Factual Reasoning through Adaptive Multilingual Chain-of-Thought
  6. 2024LinguaLIFT: An Effective Two-stage Instruction Tuning Framework for Low-Resource Language Reasoning
  7. 2024LangBridge: Multilingual Reasoning Without Multilingual Supervision
  8. 2025SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignment