Interpretable Low-Resource Legal Decision Making
Not on the map. Why?
Abstract (arXiv)
Over the past several years, legal applications of deep learning have been on the rise. However, as with other high-stakes decision making areas, the requirement for interpretability is of crucial importance. Current models utilized by legal practitioners are more of the conventional machine learning type, wherein they are inherently interpretable, yet unable to harness the performance capabilities of data-driven deep learning models. In this work, we utilize deep learning models in the area of trademark law to shed light on the issue of likelihood of confusion between trademarks. Specifically, we introduce a model-agnostic interpretable intermediate layer, a technique which proves to be effective for legal documents. Furthermore, we utilize weakly supervised learning by means of a curriculum learning strategy, effectively demonstrating the improved performance of a deep learning model. This is in contrast to the conventional models which are only able to utilize the limited number of expensive manually-annotated samples by legal experts. Although the methods presented in this work tackles the task of risk of confusion for trademarks, it is straightforward to extend them to other fields of law, or more generally, to other similar high-stakes application scenarios.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 1 Jan 2022.
Builds on
24 of 42 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2019Attention is not Explanationcited by 916
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2019Attention is not not Explanationcited by 629
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
12 more
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2020On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselinescited by 254
- 2020Understanding the Role of Individual Units in a Deep Neural Networkcited by 254
- 2018Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Taskscited by 214
- 2016Layer-wise Relevance Propagation for Neural Networks with Local Renormalization Layerscited by 197
- 2020When Do Curricula Work?cited by 105
- 2015Supersparse Linear Integer Models for Optimized Medical Scoring Systemscited by 76
- 2018How Important Is a Neuron?cited by 73
- 2017Identifying beneficial task relations for multi-task learning in deep neural networkscited by 59
- 2018Towards Explainable NLP: A Generative Explanation Framework for Text Classificationcited by 55
- 2018Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptionscited by 36
- 2020A Survey on Curriculum Learningcited by 15
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 0; 2025: 1.
3 papers.