mlsanityData to 14 Oct 2026

Augmenting Legal Decision Support Systems with LLM-based NLI for Analyzing Social Media Evidence

arXiv 2410.15990 ↗First posted 21 Oct 2024cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents our system description and error analysis of our entry for NLLP 2024 shared task on Legal Natural Language Inference (L-NLI) citephagag2024legallenssharedtask2024. The task required classifying these relationships as entailed, contradicted, or neutral, indicating any association between the review and the complaint. Our system emerged as the winning submission, significantly outperforming other entries with a substantial margin and demonstrating the effectiveness of our approach in legal text analysis. We provide a detailed analysis of the strengths and limitations of each model and approach tested, along with a thorough error analysis and suggestions for future improvements. This paper aims to contribute to the growing field of legal NLP by offering insights into advanced techniques for natural language inference in legal contexts, making it accessible to both experts and newcomers in the field.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 21 Oct 2024.

Builds on

12 of 21 references.

References · 12

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2024Qwen2 Technical Reportcited by 2,120
  3. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  4. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  5. 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 562
  6. 2023Zephyr: Direct Distillation of LM Alignmentcited by 506
  7. 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 432
  8. 2021ContractNLI: A Dataset for Document-level Natural Language Inference for Contractscited by 148
  9. 2022Logical Reasoning with Span-Level Predictions for Interpretable and Robust NLI Modelscited by 18
  10. 2024LegalLens: Leveraging LLMs for Legal Violation Identification in Unstructured Textcited by 12
  11. 2022LawngNLI: A Long-Premise Benchmark for In-Domain Generalization from Short to Long Contexts and for Implication-Based Retrievalcited by 6
  12. 2024LegalLens Shared Task 2024: Legal Violation Identification in Unstructured Textcited by 5

Built on by

Not cited yet.