TransLaw: A Large-Scale Dataset and Multi-Agent Benchmark Simulating Professional Translation of Hong Kong Case Law
Not on the map. Why?
Abstract (arXiv)
Translating Hong Kong Court Judgments from English to Traditional Chinese is mandated by Articles 8-9 of the Basic Law, yet remains constrained by a shortage of parallel resources and rigorous demands on legal terminology, citation format, and judicial style. We introduce HKCFA Judgment 97-22, the first large-scale sentence-aligned parallel corpus for HK case law, comprising 344 professionally translated judgments (11,099 sentence pairs; 2.1M tokens) spanning 1997-2022. Building on this resource, we propose TransLaw, a multi-agent framework that decomposes translation into word-level expression, sentence-level translation, and multidimensional review, integrating a specialized Hong Kong legal glossary database, Retrieval-Augmented Generation, and iterative feedback, with four-dimensional expert review covering semantic alignment, terminology, citation, and style. Benchmarking 13 open-source and commercial LLMs, we demonstrate that TransLaw significantly outperforms single-agent baselines across all evaluated models, with convergence within 3 iterations. Human evaluation by 10 certified legal translators using our proposed Legal ACS metric confirms gains in legal-semantic accuracy, while showing that TransLaw still trails human experts in stylistic naturalness. The dataset and benchmark code are available at https://github.com/xuanxixi/TransLaw.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 60 references that are in the map. First posted on arXiv 1 Jul 2025.
Builds on
28 of 60 references.
References · 28
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024GPT-4o System Cardcited by 4,588
- 2023Qwen Technical Reportcited by 3,344
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
16 more
- 2023Baichuan 2: Open Large-scale Language Modelscited by 670
- 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 265
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2024MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolutioncited by 134
- 2024FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Makingcited by 113
- 2023Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debatecited by 97
- 2024Evaluating Retrieval Quality in Retrieval-Augmented Generationcited by 90
- 2024LegalAgentBench: Evaluating LLM Agents in Legal Domaincited by 59
- 2024(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary Textscited by 49
- 2024TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinementcited by 39
- 2024xTower: A Multilingual LLM for Explaining and Correcting Translation Errorscited by 17
- 2023Bringing order into the realm of Transformer-based language models for artificial intelligence and lawcited by 13
- 2025SwiLTra-Bench: The Swiss Legal Translation Benchmarkcited by 11
- 2024Chasing COMET: Leveraging Minimum Bayes Risk Decoding for Self-Improving Machine Translationcited by 6
- 2024LLM-based Translation Inference with Iterative Bilingual Understandingcited by 6
- 2025Solving the Unsolvable: Translating Case Law in Hong Kongcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025CLaw: Benchmarking Chinese Legal Knowledge in Large Language Models - A Fine-grained Corpus and Reasoning Analysis
- 2023One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Support
- 2026WisdomInterrogatory (LuWen): An Open-Source Legal Large Language Model Technical Report
- 2025Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mapping
- 2023LawBench: Benchmarking Legal Knowledge of Large Language Models
- 2026Multi-Legal-Bench: Evaluating LLMs on Legal Reasoning Across Jurisdictions, Languages, and Legal Traditions
- 2026From Benchmarking to Reasoning: A Dual-Aspect, Large-Scale Evaluation of LLMs on Vietnamese Legal Text
- 2025Scaling Legal AI: Benchmarking Mamba and Transformers for Statutory Classification and Case Law Retrieval