CRAT: A Multi-Agent Framework for Causality-Enhanced Reflective and Retrieval-Augmented Translation with Large Language Models
On the map: Retrieval-augmented generation → Agentic RAG, agents and memory
also in 1 more
Abstract (arXiv)
Large language models (LLMs) have shown great promise in machine translation, but they still struggle with contextually dependent terms, such as new or domain-specific words. This leads to inconsistencies and errors that are difficult to address. Existing solutions often depend on manual identification of such terms, which is impractical given the complexity and evolving nature of language. While Retrieval-Augmented Generation (RAG) could provide some assistance, its application to translation is limited by issues such as hallucinations from information overload. In this paper, we propose CRAT, a novel multi-agent translation framework that leverages RAG and causality-enhanced self-reflection to address these challenges. This framework consists of several specialized agents: the Unknown Terms Identification agent detects unknown terms within the context, the Knowledge Graph (KG) Constructor agent extracts relevant internal knowledge about these terms and retrieves bilingual information from external sources, the Causality-enhanced Judge agent validates the accuracy of the information, and the Translator agent incorporates the refined information into the final output. This automated process allows for more precise and consistent handling of key terms during translation. Our results show that CRAT significantly improves translation accuracy, particularly in handling context-sensitive terms and emerging vocabulary.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 19 of its 29 references that are in the map. First posted on arXiv 28 Oct 2024.
Builds on
19 of 29 references.
References · 19
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2023Enabling Large Language Models to Generate Text with Citationscited by 584
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 344
- 2023Prompting Large Language Model for Machine Translation: A Case Studycited by 247
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 205
- 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
- 2021RnG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answeringcited by 86
- 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translationcited by 74
- 2023TIM: Teaching Large Language Models to Translate with Comparisoncited by 50
- 2019Improving Robustness of Machine Translation with Synthetic Noisecited by 36
- 2022Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal Viewcited by 31
7 more
- 2024TasTe: Teaching Large Language Models to Translate through Self-Reflectioncited by 27
- 2024DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memorycited by 27
- 2024Towards Cross-Cultural Machine Translation with Retrieval-Augmented Generation from Multilingual Knowledge Graphscited by 21
- 2023Improving Large Language Models in Event Relation Logical Predictioncited by 17
- 2024Causal-Guided Active Learning for Debiasing Large Language Modelscited by 15
- 2022Original or Translated? A Causal Analysis of the Impact of Translationese on Machine Translation Performancecited by 11
- 2016Context-Dependent Word Representation for Neural Machine Translationcited by 7
Built on by
Citing papers per year: 2025: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025MARAG-R1: Beyond Single Retriever via Reinforcement-Learned Multi-Tool Agentic Retrieval
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAG
- 2024Retrieval-Augmented Machine Translation with Unstructured Knowledge
- 2024M-RAG: Reinforcing Large Language Model Performance through Retrieval-Augmented Generation with Multiple Partitions
- 2025SIRAG: Towards Stable and Interpretable RAG with A Process-Supervised Multi-Agent Framework
- 2025CoCoA: Collaborative Chain-of-Agents for Parametric-Retrieved Knowledge Synergy
- 2024Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Models
- 2026ReflectMT: Internalizing Reflection for Efficient and High-Quality Machine Translation