AppellateGen: A Benchmark for Appellate Legal Judgment Generation
Not on the map. Why?
Abstract (arXiv)
Legal judgment generation is a critical task in legal intelligence. However, existing research in legal judgment generation has predominantly focused on first-instance trials, relying on static fact-to-verdict mappings while neglecting the dialectical nature of appellate (second-instance) review. To address this, we introduce AppellateGen, a benchmark for second-instance legal judgment generation comprising 7,351 case pairs. The task requires models to draft legally binding judgments by reasoning over the initial verdict and evidentiary updates, thereby modeling the causal dependency between trial stages. We further propose a judicial Standard Operating Procedure (SOP)-based Legal Multi-Agent System (SLMAS) to simulate judicial workflows, which decomposes the generation process into discrete stages of issue identification, retrieval, and drafting. Experimental results indicate that while SLMAS improves logical consistency, the complexity of appellate reasoning remains a substantial challenge for current LLMs. The dataset and code are publicly available at: https://anonymous.4open.science/r/AppellateGen-5763.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 56 references that are in the map. First posted on arXiv 4 Jan 2026.
Builds on
29 of 56 references.
References · 29
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
17 more
- 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecturecited by 119
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 117
- 2024LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domaincited by 113
- 2023LawBench: Benchmarking Legal Knowledge of Large Language Modelscited by 111
- 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
- 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
- 2017Learning to Predict Charges for Criminal Cases with Legal Basiscited by 61
- 2024LegalAgentBench: Evaluating LLM Agents in Legal Domaincited by 56
- 2022FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processingcited by 48
- 2024LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Modelscited by 36
- 2019Charge-Based Prison Term Prediction with Deep Gating Networkcited by 31
- 2025GreekBarBench: A Challenging Benchmark for Free-Text Legal Reasoning and Citationscited by 15
- 2024LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domaincited by 10
- 2025CaseGen: A Benchmark for Multi-Stage Legal Case Documents Generationcited by 8
- 2025LegalSearchLM: Rethinking Legal Case Retrieval as Legal Elements Generationcited by 5
- 2019Creating Auxiliary Representations from Charge Definitions for Criminal Charge Predictioncited by 4
- 2025AppealCase: A Dataset and Benchmark for Civil Case Appeal Scenarioscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.