mlsanityData to 7 Oct 2026

A Multi-Source Heterogeneous Knowledge Injected Prompt Learning Method for Legal Charge Prediction

arXiv 2408.02233 ↗First posted 5 Aug 2024cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Legal charge prediction, an essential task in legal AI, seeks to assign accurate charge labels to case descriptions, attracting significant recent interest. Existing methods primarily employ diverse neural network structures for modeling case descriptions directly, failing to effectively leverage multi-source external knowledge. We propose a prompt learning framework-based method that simultaneously leverages multi-source heterogeneous external knowledge from a legal knowledge base, a conversational LLM, and related legal articles. Specifically, we match knowledge snippets in case descriptions via the legal knowledge base and encapsulate them into the input through a hard prompt template. Additionally, we retrieve legal articles related to a given case description through contrastive learning, and then obtain factual elements within the case description through a conversational LLM. We fuse the embedding vectors of soft prompt tokens with the encoding vector of factual elements to achieve knowledge-enhanced model forward inference. Experimental results show that our method achieved state-of-the-art results on CAIL-2018, the largest legal charge prediction dataset, and our method has lower data dependency. Case studies also demonstrate our method's strong interpretability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 38 references that are in the map. First posted on arXiv 5 Aug 2024.

Builds on

16 of 38 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  5. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  6. 2020Transformers as Soft Reasoners over Languagecited by 265
  7. 2023FinGPT: Open-Source Financial Large Language Modelscited by 244
  8. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  9. 2019Neural Legal Judgment Prediction in Englishcited by 208
  10. 2020How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligencecited by 128
  11. 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 115
  12. 2019Large-Scale Multi-Label Text Classification on EU Legislationcited by 104
4 more
  1. 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
  2. 2019Charge-Based Prison Term Prediction with Deep Gating Networkcited by 31
  3. 2022Legal Case Document Similarity: You Need Both Network and Textcited by 16
  4. 2022Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuningcited by 13

Built on by

Not cited yet.