On the Ethical Limits of Natural Language Processing on Legal Text
Not on the map. Why?
Abstract (arXiv)
Natural language processing (NLP) methods for analyzing legal text offer legal scholars and practitioners a range of tools allowing to empirically analyze law on a large scale. However, researchers seem to struggle when it comes to identifying ethical limits to using NLP systems for acquiring genuine insights both about the law and the systems' predictive capacity. In this paper we set out a number of ways in which to think systematically about such issues. We place emphasis on three crucial normative parameters which have, to the best of our knowledge, been underestimated by current debates: (a) the importance of academic freedom, (b) the existence of a wide diversity of legal and ethical norms domestically but even more so internationally and (c) the threat of moralism in research related to computational law. For each of these three parameters we provide specific recommendations for the legal NLP community. Our discussion is structured around the study of a real-life scenario that has prompted recent debate in the legal NLP research community.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 8 of its 33 references that are in the map. First posted on arXiv 6 May 2021.
Builds on
8 of 33 references.
References · 8
- 2019Neural Legal Judgment Prediction in Englishcited by 209
- 2020How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligencecited by 129
- 2020LEGAL-BERT: The Muppets straight out of Law Schoolcited by 111
- 2021Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights Casescited by 77
- 2017Learning to Predict Charges for Criminal Cases with Legal Basiscited by 61
- 2018Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptionscited by 36
- 2019Charge-Based Prison Term Prediction with Deep Gating Networkcited by 31
- 2020Give Me Convenience and Give Her Death: Who Should Decide What Uses of NLP are Appropriate, and on What Basis?cited by 27
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 11; 2024: 4; 2025: 1; 2026: 1.
26 papers.
Sort:
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 310
- 2021Can Machines Learn Morality? The Delphi Experimentcited by 141
- 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
- 2021Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmarkcited by 60
- 2023MultiLegalPile: A 689GB Multilingual Legal Corpuscited by 60
- 2023LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Developmentcited by 54
- 2022FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processingcited by 49
- 2022LEVEN: A Large-Scale Chinese Legal Event Detection Datasetcited by 36
- 2022ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the UScited by 17
- 2022An Empirical Study on Cross-X Transfer for Legal Judgment Predictioncited by 16
- 2023Bringing order into the realm of Transformer-based language models for artificial intelligence and lawcited by 13
- 2022Towards a multi-stakeholder value-based assessment framework for algorithmic systemscited by 12
14 more
- 2023Leveraging Task Dependency and Contrastive Learning for Case Outcome Classification on European Court of Human Rights Casescited by 12
- 2024LegalLens: Leveraging LLMs for Legal Violation Identification in Unstructured Textcited by 12
- 2021Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2021): Workshop and Shared Task Reportcited by 9
- 2023Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networkscited by 9
- 2023The Law and NLP: Bridging Disciplinary Disconnectscited by 8
- 2023Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Modelscited by 7
- 2023Anonymity at Risk? Assessing Re-Identification Capabilities of Large Language Modelscited by 7
- 2024Towards Explainability and Fairness in Swiss Judgement Prediction: Benchmarking on a Multilingual Datasetcited by 7
- 2023Regulation and NLP (RegNLP): Taming Large Language Modelscited by 5
- 2025LeCoPCR: Legal Concept-guided Prior Case Retrieval for European Court of Human Rights casescited by 5
- 2024Incorporating Precedents for Legal Judgement Prediction on European Court of Human Rights Casescited by 4
- 2024Know When to Fuse: Investigating Non-English Hybrid Retrieval in the Legal Domaincited by 1
- 2023The Ethics of Automating Legal Actorscited by 0
- 2026N"urnberg NLP at ChildSafeAds 2026: Structurally Dissimilar Voter Ensembles under Four Levels of Data Accesscited by 0
- 2026N"urnberg NLP at ChildSafeAds 2026: Structurally Dissimilar Voter Ensembles under Four Levels of Data Access28 Sep 2026
- 2025LeCoPCR: Legal Concept-guided Prior Case Retrieval for European Court of Human Rights cases23 Jan 2025
- 2024Incorporating Precedents for Legal Judgement Prediction on European Court of Human Rights Cases27 Sep 2024
- 2024Know When to Fuse: Investigating Non-English Hybrid Retrieval in the Legal Domain2 Sep 2024
- 2024Towards Explainability and Fairness in Swiss Judgement Prediction: Benchmarking on a Multilingual Dataset26 Feb 2024
- 2024LegalLens: Leveraging LLMs for Legal Violation Identification in Unstructured Text6 Feb 2024
- 2023The Ethics of Automating Legal Actors1 Dec 2023
- 2023The Law and NLP: Bridging Disciplinary Disconnects22 Oct 2023
- 2023Regulation and NLP (RegNLP): Taming Large Language Models9 Oct 2023
- 2023Anonymity at Risk? Assessing Re-Identification Capabilities of Large Language Models22 Aug 2023
- 2023Bringing order into the realm of Transformer-based language models for artificial intelligence and law10 Aug 2023
- 2023MultiLegalPile: A 689GB Multilingual Legal Corpus3 Jun 2023
14 more
- 2023Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models21 May 2023
- 2023LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development12 May 2023
- 2023Leveraging Task Dependency and Contrastive Learning for Case Outcome Classification on European Court of Human Rights Cases1 Feb 2023
- 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain30 Jan 2023
- 2023Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networks30 Jan 2023
- 2022ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the US1 Nov 2022
- 2022An Empirical Study on Cross-X Transfer for Legal Judgment Prediction25 Sep 2022
- 2022Towards a multi-stakeholder value-based assessment framework for algorithmic systems9 May 2022
- 2022LEVEN: A Large-Scale Chinese Legal Event Detection Dataset16 Mar 2022
- 2022FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing14 Mar 2022
- 2021Can Machines Learn Morality? The Delphi Experiment14 Oct 2021
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in English3 Oct 2021
- 2021Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmark2 Oct 2021
- 2021Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2021): Workshop and Shared Task Report17 Aug 2021
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 310
- 2021Can Machines Learn Morality? The Delphi Experimentcited by 141
- 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
- 2021Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmarkcited by 60
- 2023MultiLegalPile: A 689GB Multilingual Legal Corpuscited by 60
- 2023LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Developmentcited by 54
- 2022FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processingcited by 49
- 2022LEVEN: A Large-Scale Chinese Legal Event Detection Datasetcited by 36
- 2022ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the UScited by 17
- 2022An Empirical Study on Cross-X Transfer for Legal Judgment Predictioncited by 16
- 2023Bringing order into the realm of Transformer-based language models for artificial intelligence and lawcited by 13
- 2022Towards a multi-stakeholder value-based assessment framework for algorithmic systemscited by 12
12 most cited of 26 All 26 (JSON)
- 2026N"urnberg NLP at ChildSafeAds 2026: Structurally Dissimilar Voter Ensembles under Four Levels of Data Access28 Sep 2026
- 2025LeCoPCR: Legal Concept-guided Prior Case Retrieval for European Court of Human Rights cases23 Jan 2025
- 2024Incorporating Precedents for Legal Judgement Prediction on European Court of Human Rights Cases27 Sep 2024
- 2024Know When to Fuse: Investigating Non-English Hybrid Retrieval in the Legal Domain2 Sep 2024
- 2024Towards Explainability and Fairness in Swiss Judgement Prediction: Benchmarking on a Multilingual Dataset26 Feb 2024
- 2024LegalLens: Leveraging LLMs for Legal Violation Identification in Unstructured Text6 Feb 2024
- 2023The Ethics of Automating Legal Actors1 Dec 2023
- 2023The Law and NLP: Bridging Disciplinary Disconnects22 Oct 2023
- 2023Regulation and NLP (RegNLP): Taming Large Language Models9 Oct 2023
- 2023Anonymity at Risk? Assessing Re-Identification Capabilities of Large Language Models22 Aug 2023
- 2023Bringing order into the realm of Transformer-based language models for artificial intelligence and law10 Aug 2023
- 2023MultiLegalPile: A 689GB Multilingual Legal Corpus3 Jun 2023
12 newest of 26 All 26 (JSON)