mlsanityData to 14 Oct 2026

MMLA: Memory-Mediated Learning Architecture for Predictive Dual-State Adaptation

arXiv 2606.28876 ↗First posted 27 Jun 2026cs.CL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Memory-Mediated Learning Architecture (MMLA) separates slow base parameters theta, a bounded numerical policy carrier Phi, and a bounded authoritative memory M. Predictive Dual-State Adaptation (PDSA) lets feedback update Phi while one problem remains active and lets a trusted lifecycle atomically commit one typed row or exact NULL. Later reasoning may read both states, but their writers, resets, rollback domains, and ledgers remain distinct. Realized futures supervise values only during training; deployment is causal and future-blind. We give conditional theory and falsifiable contracts for reasoning-time updates, completed-segment consolidation, predictive admission, authoritative memory, and dual-state attribution. Assumptions, counterexamples, capacity and cost ledgers, recovery duties, and identifying experiments are explicit; these are not implementation guarantees. Controlled studies show exact lifecycle execution on 300/300 held-out records for each of three seeds, calibrated retrieval gains over frozen-hidden dense and BM25 baselines, and exact typed anchor-filler transport on 240/240 held-out records per seed. These validate restricted components, not natural-language memory management or complete PDSA. Post-training studies retain positive and negative evidence. Later protocols obtain restricted readout progress, but a nine-trajectory comparison finds that matched latent readout, a full-width bridge, and bridge plus frozen text-teacher alignment all fail continuous-event qualification across both task families. A separately adapted text reference and restoration checks pass. At the September 13, 2026 evidence cutoff, no strict policy-only reasoning-time-training effect, predictive-admission oracle margin, learned future-blind admission policy, or policy-by-memory factorial advantage is established.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 59 of its 111 references that are in the map. First posted on arXiv 27 Jun 2026.

Builds on

59 of 111 references.

References · 59

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  6. 2024Qwen2.5 Technical Reportcited by 4,942
  7. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  8. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  9. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  10. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  11. 2023Mistral 7Bcited by 3,164
  12. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
38 more
  1. 2020GLU Variants Improve Transformercited by 1,804
  2. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  3. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  4. 2020Rethinking Attention with Performerscited by 1,601
  5. 2018World Modelscited by 1,513
  6. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  7. 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
  8. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
  9. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  10. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  11. 2016Deep Variational Information Bottleneckcited by 930
  12. 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
  13. 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 832
  14. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
  15. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  16. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
  17. 2014Neural Turing Machinescited by 644
  18. 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 613
  19. 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 532
  20. 2023Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Timecited by 439
  21. 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attentioncited by 407
  22. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
  23. 2014Memory Networkscited by 363
  24. 2025TTRL: Test-Time Reinforcement Learningcited by 275
  25. 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 237
  26. 2022Memorizing Transformerscited by 226
  27. 2023Landmark Attention: Random-Access Infinite Context Length for Transformerscited by 213
  28. 2024Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentioncited by 200
  29. 2025Kimi Linear: An Expressive, Efficient Attention Architecturecited by 196
  30. 2023Augmenting Language Models with Long-Term Memorycited by 189
  31. 2025MemOS: A Memory OS for AI Systemcited by 138
  32. 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 129
  33. 2026Learning to Discover at Test Timecited by 115
  34. 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agentscited by 78
  35. 2020Tent: Fully Test-time Adaptation by Entropy Minimizationcited by 69
  36. 2025Mem-α: Learning Memory Construction via Reinforcement Learningcited by 55
  37. 2024Memory Layers at Scalecited by 48
  38. 2026Gated DeltaNet-2: Decoupling Erase and Write in Linear Attentioncited by 33

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.