PyEuroVoc: A Tool for Multilingual Legal Document Classification with EuroVoc Descriptors
Not on the map. Why?
Abstract (arXiv)
EuroVoc is a multilingual thesaurus that was built for organizing the legislative documentary of the European Union institutions. It contains thousands of categories at different levels of specificity and its descriptors are targeted by legal texts in almost thirty languages. In this work we propose a unified framework for EuroVoc classification on 22 languages by fine-tuning modern Transformer-based pretrained language models. We study extensively the performance of our trained models and show that they significantly improve the results obtained by a similar tool - JEX - on the same dataset. The code and the fine-tuned models were open sourced, together with a programmatic interface that eases the process of loading the weights of a trained model and of classifying a new document.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 2 Aug 2021.
Builds on
20 of 40 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2016Enriching Word Vectors with Subword Informationcited by 1,583
- 2019CamemBERT: a Tasty French Language Modelcited by 368
- 2018Explainable Prediction of Medical Codes from Clinical Textcited by 234
- 2019Quantization Networkscited by 153
- 2019Multilingual is not enough: BERT for Finnishcited by 119
- 2020LEGAL-BERT: The Muppets straight out of Law Schoolcited by 111
- 2019BERTje: A Dutch BERT Modelcited by 109
- 2019Large-Scale Multi-Label Text Classification on EU Legislationcited by 104
8 more
- 2019DocBERT: BERT for Document Classificationcited by 68
- 2020KLEJ: Comprehensive Benchmark for Polish Language Understandingcited by 51
- 2020The birth of Romanian BERTcited by 44
- 2020GREEK-BERT: The Greeks visiting Sesame Streetcited by 38
- 2020Playing with Words at the National Library of Sweden -- Making a Swedish BERTcited by 35
- 2020WikiBERT models: deep transfer learning for many languagescited by 20
- 2020EstBERT: A Pretrained Language-Specific BERT for Estoniancited by 16
- 2013JRC EuroVoc Indexer JEX - A freely available multi-label categorisation toolcited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 2; 2025: 1.
6 papers.
- 2021Distilling the Knowledge of Romanian BERTs Using Multiple Teacherscited by 13
- 2023Bringing order into the realm of Transformer-based language models for artificial intelligence and lawcited by 13
- 2025The Lucie-7B LLM and the Lucie Training Dataset: Open resources for multilingual language generationcited by 10
- 2024GRAF: Graph Retrieval Augmented by Facts for Romanian Legal Multi-Choice Question Answeringcited by 4
- 2022Creation and Analysis of an International Corpus of Privacy Lawscited by 3
- 2024RELATE: A Modern Processing Platform for Romanian Languagecited by 0
- 2025The Lucie-7B LLM and the Lucie Training Dataset: Open resources for multilingual language generation15 Mar 2025
- 2024GRAF: Graph Retrieval Augmented by Facts for Romanian Legal Multi-Choice Question Answering5 Dec 2024
- 2024RELATE: A Modern Processing Platform for Romanian Language29 Oct 2024
- 2023Bringing order into the realm of Transformer-based language models for artificial intelligence and law10 Aug 2023
- 2022Creation and Analysis of an International Corpus of Privacy Laws28 Jun 2022
- 2021Distilling the Knowledge of Romanian BERTs Using Multiple Teachers23 Dec 2021