A Two-Stage Architecture for NDA Analysis: LLM-based Segmentation and Transformer-based Clause Classification
Not on the map. Why?
Abstract (arXiv)
In business-to-business relations, it is common to establish NonDisclosure Agreements (NDAs). However, these documents exhibit significant variation in format, structure, and writing style, making manual analysis slow and error-prone. We propose an architecture based on LLMs to automate the segmentation and clauses classification within these contracts. We employed two models: LLaMA-3.1-8B-Instruct for NDA segmentation (clause extraction) and a fine-tuned Legal-Roberta-Large for clause classification. In the segmentation task, we achieved a ROUGE F1 of 0.95 +/- 0.0036; for classification, we obtained a weighted F1 of 0.85, demonstrating the feasibility and precision of the approach.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 45 references that are in the map. First posted on arXiv 13 Feb 2026.
Builds on
20 of 45 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 199
- 2021ContractNLI: A Dataset for Document-level Natural Language Inference for Contractscited by 145
- 2020Metrics for Multi-Class Classification: an Overviewcited by 140
- 2020LEGAL-BERT: The Muppets straight out of Law Schoolcited by 111
- 2023LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Developmentcited by 54
- 2023Information Retrieval: Recent Advances and Beyondcited by 49
8 more
- 2020A Benchmark for Lease Contract Reviewcited by 26
- 2020A Dataset of German Legal Documents for Named Entity Recognitioncited by 24
- 2022Processing Long Legal Documents with Pre-trained Transformers: Modding LegalBERT and Longformercited by 20
- 2022Legal Case Document Similarity: You Need Both Network and Textcited by 16
- 2021AutoLAW: Augmented Legal Reasoning through Legal Precedent Predictioncited by 14
- 2023Bringing order into the realm of Transformer-based language models for artificial intelligence and lawcited by 13
- 2021Customizing Contextualized Language Models forLegal Document Reviewscited by 8
- 2021Unsupervised Law Article Mining based on Deep Pre-Trained Language Representation Models with Application to the Italian Civil Codecited by 6
Built on by
Not cited yet.