mlsanityData to 7 Oct 2026

AppellateGen: A Benchmark for Appellate Legal Judgment Generation

arXiv 2601.01331 ↗First posted 4 Jan 2026cs.CY cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Legal judgment generation is a critical task in legal intelligence. However, existing research in legal judgment generation has predominantly focused on first-instance trials, relying on static fact-to-verdict mappings while neglecting the dialectical nature of appellate (second-instance) review. To address this, we introduce AppellateGen, a benchmark for second-instance legal judgment generation comprising 7,351 case pairs. The task requires models to draft legally binding judgments by reasoning over the initial verdict and evidentiary updates, thereby modeling the causal dependency between trial stages. We further propose a judicial Standard Operating Procedure (SOP)-based Legal Multi-Agent System (SLMAS) to simulate judicial workflows, which decomposes the generation process into discrete stages of issue identification, retrieval, and drafting. Experimental results indicate that while SLMAS improves logical consistency, the complexity of appellate reasoning remains a substantial challenge for current LLMs. The dataset and code are publicly available at: https://anonymous.4open.science/r/AppellateGen-5763.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 56 references that are in the map. First posted on arXiv 4 Jan 2026.

Builds on

29 of 56 references.

References · 29

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  6. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  7. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  8. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  9. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  10. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  11. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
  12. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
17 more
  1. 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecturecited by 119
  2. 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 117
  3. 2024LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domaincited by 113
  4. 2023LawBench: Benchmarking Legal Knowledge of Large Language Modelscited by 111
  5. 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
  6. 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
  7. 2017Learning to Predict Charges for Criminal Cases with Legal Basiscited by 61
  8. 2024LegalAgentBench: Evaluating LLM Agents in Legal Domaincited by 56
  9. 2022FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processingcited by 48
  10. 2024LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Modelscited by 36
  11. 2019Charge-Based Prison Term Prediction with Deep Gating Networkcited by 31
  12. 2025GreekBarBench: A Challenging Benchmark for Free-Text Legal Reasoning and Citationscited by 15
  13. 2024LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domaincited by 10
  14. 2025CaseGen: A Benchmark for Multi-Stage Legal Case Documents Generationcited by 8
  15. 2025LegalSearchLM: Rethinking Legal Case Retrieval as Legal Elements Generationcited by 5
  16. 2019Creating Auxiliary Representations from Charge Definitions for Criminal Charge Predictioncited by 4
  17. 2025AppealCase: A Dataset and Benchmark for Civil Case Appeal Scenarioscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.