mlsanityData to 7 Oct 2026

LLaMandement: Large Language Models for Summarization of French Legislative Proposals

arXiv 2401.16182 ↗First posted 29 Jan 2024cs.CL cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

This report introduces LLaMandement, a state-of-the-art Large Language Model, fine-tuned by the French government and designed to enhance the efficiency and efficacy of processing parliamentary sessions (including the production of bench memoranda and documents required for interministerial meetings) by generating neutral summaries of legislative proposals. Addressing the administrative challenges of manually processing a growing volume of legislative amendments, LLaMandement stands as a significant legal technological milestone, providing a solution that exceeds the scalability of traditional human efforts while matching the robustness of a specialized legal drafter. We release all our fine-tuned models and training data to the community.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 34 of its 52 references that are in the map. First posted on arXiv 29 Jan 2024.

Builds on

34 of 52 references.

References · 34

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  7. 2020Scaling Laws for Neural Language Modelscited by 6,411
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  9. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  10. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  11. 2023Mistral 7Bcited by 3,065
  12. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
22 more
  1. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  2. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  3. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  4. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  5. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  6. 2023BloombergGPT: A Large Language Model for Financecited by 923
  7. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
  8. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 540
  9. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 410
  10. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
  11. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
  12. 2019CamemBERT: a Tasty French Language Modelcited by 368
  13. 2019Measuring Bias in Contextualized Word Representationscited by 275
  14. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
  15. 2021Societal Biases in Language Generation: Progress and Challengescited by 201
  16. 2019FlauBERT: Unsupervised Language Model Pre-training for Frenchcited by 153
  17. 2023Can GPT-3 Perform Statutory Reasoning?cited by 71
  18. 2023Learning to Retrieve In-Context Examples for Large Language Modelscited by 60
  19. 2022Legal Prompt Engineering for Multilingual Legal Judgement Predictioncited by 54
  20. 2023Putting ChatGPT's Medical Advice to the (Turing) Testcited by 23
  21. 2023Beyond Classification: Financial Reasoning in State-of-the-Art Language Modelscited by 18
  22. 2023Zero is Not Hero Yet: Benchmarking Zero-Shot Performance of LLMs for Financial Taskscited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 2; 2026: 1.

9 papers.

  1. 2024Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challengescited by 42
  2. 2024CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generationcited by 18
  3. 2024RoQLlama: A Lightweight Romanian Adapted Language Modelcited by 7
  4. 2024Exploring the Nexus of Large Language Models and Legal Systems: A Short Surveycited by 6
  5. 2024It Cannot Be Right If It Was Written by AI: On Lawyers' Preferences of Documents Perceived as Authored by an LLM vs a Humancited by 5
  6. 2025Aspect-Based Summarization with Self-Aspect Retrieval Enhanced Generationcited by 2
  7. 2024Exploiting LLMs' Reasoning Capability to Infer Implicit Concepts in Legal Information Retrievalcited by 1
  8. 2025Operational Change Detection for Geographical Information: Overview and Challengescited by 0
  9. 2026Maistros: A Greek Large Language Model Adapted Through Knowledge Distillation From Large Reasoning Modelscited by 0