Exploring Fact Memorization and Style Imitation in LLMs Using QLoRA: An Experimental Study and Quality Assessment Methods
Not on the map. Why?
Abstract (arXiv)
There are various methods for adapting LLMs to different domains. The most common methods are prompting, finetuning, and RAG. In this work, we explore the possibility of adapting a model using one of the PEFT methods - QLoRA. The experiment aims to simulate human responses based on their interviews. The simulation quality is assessed by comparing the quality of the style and the quality of the generated facts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 1 of its 2 references that are in the map. First posted on arXiv 12 Jun 2024.
Builds on
1 of 2 references.
References · 1
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models
- 2025The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs
- 2024LLMs are Biased Evaluators But Not Biased for Retrieval Augmented Generation
- 2024LEAF: Learning and Evaluation Augmented by Fact-Checking to Improve Factualness in Large Language Models
- 2025Evaluating Prompt Engineering Techniques for Accuracy and Confidence Elicitation in Medical LLMs
- 2024Vernacular? I Barely Know Her: Challenges with Style Control and Stereotyping
- 2024Reconciling Methodological Paradigms: Employing Large Language Models as Novice Qualitative Research Assistants in Talent Management Research
- 2024A Comparison of LLM Finetuning Methods & Evaluation Metrics with Travel Chatbot Use Case