# JNLP Team: Deep Learning Approaches for Legal Processing Tasks in COLIEE 2021

arXiv: https://arxiv.org/abs/2106.13405 · HTML: https://mlsanity.com/paper/2106.13405/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- Builds on 6 of its 13 references that are in the map.
- First posted on arXiv 25 Jun 2021.

## Builds on (most cited first, 6 of 6)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Unsupervised Cross-lingual Representation Learning at Scale](https://mlsanity.com/paper/1911.02116/) (2019)
- [Building Legal Case Retrieval Systems with Lexical Matching and Summarization using A Pre-Trained Phrase Scoring Model](https://mlsanity.com/paper/2009.14083/) (2020)
- [JNLP Team: Deep Learning for Legal Processing in COLIEE 2020](https://mlsanity.com/paper/2011.08071/) (2020)
- [IITP@COLIEE 2019: Legal Information Retrieval using BM25 and BERT](https://mlsanity.com/paper/2104.08653/) (2021)
- [Threshold-Based Retrieval and Textual Entailment Detection on Legal Bar Exam Questions](https://mlsanity.com/paper/1905.13350/) (2019)

## Built on by (most cited first, 8 of 8)

- [U-CREAT: Unsupervised Case Retrieval using Events extrAcTion](https://mlsanity.com/paper/2307.05260/) (2023)
- [Attentive Deep Neural Networks for Legal Document Retrieval](https://mlsanity.com/paper/2212.13899/) (2022)
- [How well do SOTA legal reasoning models support abductive reasoning?](https://mlsanity.com/paper/2304.06912/) (2023)
- [Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networks](https://mlsanity.com/paper/2301.12847/) (2023)
- [Unsupervised Law Article Mining based on Deep Pre-Trained Language Representation Models with Application to the Italian Civil Code](https://mlsanity.com/paper/2112.03033/) (2021)
- [CAPTAIN at COLIEE 2023: Efficient Methods for Legal Information Retrieval and Entailment Tasks](https://mlsanity.com/paper/2401.03551/) (2024)
- [LLM-based Embedders for Prior Case Retrieval](https://mlsanity.com/paper/2507.18455/) (2025)
- [Self-Verification is All You Need To Pass The Japanese Bar Examination](https://mlsanity.com/paper/2601.03144/) (2026)

## Abstract (arXiv)

COLIEE is an annual competition in automatic computerized legal text processing. Automatic legal document processing is an ambitious goal, and the structure and semantics of the law are often far more complex than everyday language. In this article, we survey and report our methods and experimental results in using deep learning in legal document processing. The results show the difficulties as well as potentials in this family of approaches.