# Exploring Fact Memorization and Style Imitation in LLMs Using QLoRA: An Experimental Study and Quality Assessment Methods

arXiv: https://arxiv.org/abs/2406.08582 · HTML: https://mlsanity.com/paper/2406.08582/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 1 of its 2 references that are in the map.
- First posted on arXiv 12 Jun 2024.

## Builds on (most cited first, 1 of 1)

- [QLoRA: Efficient Finetuning of Quantized LLMs](https://mlsanity.com/paper/2305.14314/) (2023)

## Abstract (arXiv)

There are various methods for adapting LLMs to different domains. The most common methods are prompting, finetuning, and RAG. In this work, we explore the possibility of adapting a model using one of the PEFT methods - QLoRA. The experiment aims to simulate human responses based on their interviews. The simulation quality is assessed by comparing the quality of the style and the quality of the generated facts.