mlsanityData to 7 Oct 2026

SteuerLLM: Local specialized large language model for German tax law analysis

arXiv 2602.11081 ↗First posted 11 Feb 2026cs.CL cs.AI cs.LGcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Large language models (LLMs) demonstrate strong general reasoning and language understanding, yet their performance degrades in domains governed by strict formal rules, precise terminology, and legally binding structure. Tax law exemplifies these challenges, as correct answers require exact statutory citation, structured legal argumentation, and numerical accuracy under rigid grading schemes. We algorithmically generate SteuerEx, the first open benchmark derived from authentic German university tax law examinations. SteuerEx comprises 115 expert-validated examination questions spanning six core tax law domains and multiple academic levels, and employs a statement-level, partial-credit evaluation framework that closely mirrors real examination practice. We further present SteuerLLM, a domain-adapted LLM for German tax law trained on a large-scale synthetic dataset generated from authentic examination material using a controlled retrieval-augmented pipeline. SteuerLLM (28B parameters) consistently outperforms general-purpose instruction-tuned models of comparable size and, in several cases, substantially larger systems, demonstrating that domain-specific data and architectural adaptation are more decisive than parameter scale for performance on realistic legal reasoning tasks. All benchmark data, training datasets, model weights, and evaluation code are released openly to support reproducible research in domain-specific legal artificial intelligence. A web-based demo of SteuerLLM is available at https://steuerllm.i5.ai.fau.de.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 41 of its 65 references that are in the map. First posted on arXiv 11 Feb 2026.

Builds on

41 of 65 references.

References · 41

  1. 2017Attention Is All You Needcited by 59,932
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  7. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  8. 2020Scaling Laws for Neural Language Modelscited by 6,411
  9. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  10. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  11. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  12. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
29 more
  1. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  2. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  3. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  4. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  5. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  6. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  7. 2025Gemma 3 Technical Reportcited by 1,686
  8. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  9. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,104
  10. 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 621
  11. 2023TinyStories: How Small Can Language Models Be and Still Speak Coherent English?cited by 425
  12. 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
  13. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
  14. 2015Net2Net: Accelerating Learning via Knowledge Transfercited by 245
  15. 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
  16. 2021Generating Datasets with Pretrained Language Modelscited by 192
  17. 2020Break It Down: A Question Understanding Benchmarkcited by 131
  18. 2020How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligencecited by 128
  19. 2020LEGAL-BERT: The Muppets straight out of Law Schoolcited by 111
  20. 2024LLaMA Pro: Progressive LLaMA with Block Expansioncited by 99
  21. 2024KMMLU: Measuring Massive Multitask Language Understanding in Koreancited by 91
  22. 2023Can GPT-3 Perform Statutory Reasoning?cited by 71
  23. 2021bert2BERT: Towards Reusable Pretrained Language Modelscited by 70
  24. 2022EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domaincited by 39
  25. 2024SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domaincited by 39
  26. 2022DiscoScore: Evaluating Text Generation with BERT and Discourse Coherencecited by 35
  27. 2024Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challengescited by 31
  28. 2022Parameter-Efficient Legal Domain Adaptationcited by 12
  29. 2025Multi-step retrieval and reasoning improves radiology question answering with large language modelscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergence
  2. 2025Taxation Perspectives from Large Language Models: A Case Study on Additional Tax Penalties
  3. 2026Domain-Adaptation through Synthetic Data: Fine-Tuning Large Language Models for German Law
  4. 2025Using Large Language Models for Legal Decision-Making in Austrian Value-Added Tax Law: A Comparative Study
  5. 2025Language Models and Logic Programs for Trustworthy Tax Reasoning
  6. 2026BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law
  7. 2026GradeLegal: Automated Grading for German Legal Cases
  8. 2026Reasoners or Translators? Contamination-aware Evaluation and Neuro-Symbolic Robustness in Tax Law