mlsanityData to 14 Oct 2026

Instruction Finetuning LLaMA-3-8B Model Using LoRA for Financial Named Entity Recognition

arXiv 2601.10043 ↗First posted 15 Jan 2026q-fin.CP cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Particularly, financial named-entity recognition (NER) is one of the many important approaches to translate unformatted reports and news into structured knowledge graphs. However, free, easy-to-use large language models (LLMs) often fail to differentiate organisations as people, or disregard an actual monetary amount entirely. This paper takes Meta's Llama 3 8B and applies it to financial NER by combining instruction fine-tuning and Low-Rank Adaptation (LoRA). Each annotated sentence is converted into an instruction-input-output triple, enabling the model to learn task descriptions while fine-tuning with small low-rank matrices instead of updating all weights. Using a corpus of 1,693 sentences, our method obtains a micro-F1 score of 0.894 compared with Qwen3-8B, Baichuan2-7B, T5, and BERT-Base. We present dataset statistics, describe training hyperparameters, and perform visualizations of entity density, learning curves, and evaluation metrics. Our results show that instruction tuning combined with parameter-efficient fine-tuning enables state-of-the-art performance on domain-sensitive NER.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 9 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

6 of 9 references.

References · 6

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2025FinLoRA: Benchmarking LoRA Methods for Fine-Tuning LLMs on Financial Datasetscited by 12
  4. 2025Financial Named Entity Recognition: How Far Can LLM Go?cited by 8
  5. 2024Baichuan2-Sum: Instruction Finetune Baichuan2-7B Model for Dialogue Summarizationcited by 7
  6. 2024Retrieval Augmented Instruction Tuning for Open NER with Large Language Modelscited by 4

Built on by

Not cited yet.