mlsanityData to 7 Oct 2026

The Large Language Model GreekLegalRoBERTa

arXiv 2410.12852 ↗First posted 10 Oct 2024cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We develop four versions of GreekLegalRoBERTa, which are four large language models trained on Greek legal and nonlegal text. We show that our models surpass the performance of GreekLegalBERT, Greek- LegalBERT-v2, and GreekBERT in two tasks involving Greek legal documents: named entity recognition and multi-class legal topic classification. We view our work as a contribution to the study of domain-specific NLP tasks in low-resource languages, like Greek, using modern NLP techniques and methodologies.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 10 Oct 2024.

Builds on

25 of 35 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  7. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  8. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  9. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  10. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  11. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  12. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
13 more
  1. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
  2. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
  3. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
  4. 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 189
  5. 2020A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languagescited by 131
  6. 2020LEGAL-BERT: The Muppets straight out of Law Schoolcited by 111
  7. 2021MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfercited by 89
  8. 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
  9. 2023LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Developmentcited by 54
  10. 2020PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generationcited by 42
  11. 2020GREEK-BERT: The Greeks visiting Sesame Streetcited by 37
  12. 2017Discourse-Based Objectives for Fast Unsupervised Sentence Representation Learningcited by 18
  13. 2021Multi-granular Legal Topic Classification on Greek Legislationcited by 15

Built on by

Not cited yet.