mlsanityData to 14 Oct 2026

CACHE-UK: A Stability-Aware Memory Editor for Sequentially Updated Quantized LLMs in Finance

arXiv 2607.28292 ↗First posted 30 Jul 2026cs.CL cs.AI cs.CEcited by 1

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) deployed in dynamic financial environments face a critical challenge: maintaining factual accuracy as market conditions, regulations, and corporate facts change continuously. While 4-bit quantization enables efficient deployment, it severely limits the viability of sequential memory editing: existing methods undergo catastrophic performance degradation under this "quantization stability crisis." We introduce CACHE-UK (Contextual Adaptive Continual Hybrid Editor for UK Finance), a stability-aware memory editing framework specifically designed for domain-specific, quantized LLMs. CACHE-UK integrates three components: a rank-1 LoRA perturbation mechanism that confines edits to the low-rank adapter subspace, a financial domain prioritization module for content-adaptive edit strength, and a closed-loop Stability Controller that tracks "degradation debt" to prevent catastrophic forgetting across sequential updates. Evaluated on a 4-bit quantized OpenLLaMA-3B model with a curated UK financial corpus of 88,021 documents, CACHE-UK reduces knowledge degradation by 11-17% relative to adapted baselines under identical 4-bit constraints -- its most robust effect -- while attaining the highest test success (generalization) rate observed in our setting (28%, a 6 percentage point improvement over the strongest adapted baseline). These results indicate that stability-aware editing can improve factual maintenance in resource-constrained financial LLM deployments, though absolute generalization rates remain low.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 19 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

16 of 19 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  5. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  6. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  7. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
  8. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  9. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  10. 2022Mass-Editing Memory in a Transformercited by 1,001
  11. 2021Editing Factual Knowledge in Language Modelscited by 553
  12. 2021Fast Model Editing at Scalecited by 498
4 more
  1. 20218-bit Optimizers via Block-wise Quantizationcited by 403
  2. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 163
  3. 2023EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Modelscited by 98
  4. 2025Demystifying Domain-adaptive Post-training for Financial LLMscited by 24

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025SPEAR-MM: Selective Parameter Evaluation and Restoration via Model Merging for Efficient Financial LLM Adaptation
  2. 2026YouZhi: Towards High-Concurrency Financial LLMs via Adaptive GQA-to-MLA Transition
  3. 2026More Edits, More Stable: Understanding the Lifelong Normalization in Sequential Model Editing
  4. 2026Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents
  5. 2025LLM Output Drift: Cross-Provider Validation & Mitigation for Financial Workflows
  6. 2026QuantEval: A Benchmark for Financial Quantitative Tasks in Large Language Models
  7. 2026Unlocking Data Value in Finance: A Study on Distillation and Difficulty-Aware Training
  8. 2026Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements