mlsanityData to 7 Oct 2026

NOWJ@COLIEE 2025: A Multi-stage Framework Integrating Embedding Models and Large Language Models for Legal Retrieval and Entailment

arXiv 2509.08025 ↗First posted 9 Sep 2025cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper presents the methodologies and results of the NOWJ team's participation across all five tasks at the COLIEE 2025 competition, emphasizing advancements in the Legal Case Entailment task (Task 2). Our comprehensive approach systematically integrates pre-ranking models (BM25, BERT, monoT5), embedding-based semantic representations (BGE-m3, LLM2Vec), and advanced Large Language Models (Qwen-2, QwQ-32B, DeepSeek-V3) for summarization, relevance scoring, and contextual re-ranking. Specifically, in Task 2, our two-stage retrieval system combined lexical-semantic filtering with contextualized LLM analysis, achieving first place with an F1 score of 0.3195. Additionally, in other tasks--including Legal Case Retrieval, Statute Law Retrieval, Legal Textual Entailment, and Legal Judgment Prediction--we demonstrated robust performance through carefully engineered ensembles and effective prompt-based reasoning strategies. Our findings highlight the potential of hybrid models integrating traditional IR techniques with contemporary generative models, providing a valuable reference for future advancements in legal information processing.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 7 of its 20 references that are in the map. First posted on arXiv 9 Sep 2025.

Builds on

7 of 20 references.

References · 7

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2020How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligencecited by 128
  6. 2024Towards an In-Depth Comprehension of Case Relevance for Better Legal Retrievalcited by 6
  7. 2023Japanese Tort-case Dataset for Rationale-supported Legal Judgment Predictioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026NOWJ@COLIEE 2026: Adaptive Pipelines for Legal Retrieval and Reasoning
  2. 2026Cross-Architecture LLM Ensembles, Feature-Based Reranking and Retrieval-Augmented Prompting for Legal Information Processing
  3. 2024Exploiting LLMs' Reasoning Capability to Infer Implicit Concepts in Legal Information Retrieval
  4. 2025ReaKase-8B: Legal Case Retrieval via Knowledge and Reasoning Representations with LLMs
  5. 2026Legal2LogicICL: Improving Generalization in Transforming Legal Cases to Logical Formulas via Diverse Few-Shot Learning
  6. 2024Athena: Retrieval-augmented Legal Judgment Prediction with Large Language Models
  7. 2023One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Support
  8. 2024DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment