MMLA: Memory-Mediated Learning Architecture for Predictive Dual-State Adaptation
Not on the map. Why?
Abstract (arXiv)
Memory-Mediated Learning Architecture (MMLA) separates slow base parameters theta, a bounded numerical policy carrier Phi, and a bounded authoritative memory M. Predictive Dual-State Adaptation (PDSA) lets feedback update Phi while one problem remains active and lets a trusted lifecycle atomically commit one typed row or exact NULL. Later reasoning may read both states, but their writers, resets, rollback domains, and ledgers remain distinct. Realized futures supervise values only during training; deployment is causal and future-blind. We give conditional theory and falsifiable contracts for reasoning-time updates, completed-segment consolidation, predictive admission, authoritative memory, and dual-state attribution. Assumptions, counterexamples, capacity and cost ledgers, recovery duties, and identifying experiments are explicit; these are not implementation guarantees. Controlled studies show exact lifecycle execution on 300/300 held-out records for each of three seeds, calibrated retrieval gains over frozen-hidden dense and BM25 baselines, and exact typed anchor-filler transport on 240/240 held-out records per seed. These validate restricted components, not natural-language memory management or complete PDSA. Post-training studies retain positive and negative evidence. Later protocols obtain restricted readout progress, but a nine-trajectory comparison finds that matched latent readout, a full-width bridge, and bridge plus frozen text-teacher alignment all fail continuous-event qualification across both task families. A separately adapted text reference and restoration checks pass. At the September 13, 2026 evidence cutoff, no strict policy-only reasoning-time-training effect, predictive-admission oracle margin, learned future-blind admission policy, or policy-by-memory factorial advantage is established.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 59 of its 111 references that are in the map. First posted on arXiv 27 Jun 2026.
Builds on
59 of 111 references.
References · 59
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Mistral 7Bcited by 3,164
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
38 more
- 2020GLU Variants Improve Transformercited by 1,804
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2020Rethinking Attention with Performerscited by 1,601
- 2018World Modelscited by 1,513
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2016Deep Variational Information Bottleneckcited by 930
- 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
- 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 832
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
- 2014Neural Turing Machinescited by 644
- 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 613
- 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 532
- 2023Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Timecited by 439
- 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attentioncited by 407
- 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
- 2014Memory Networkscited by 363
- 2025TTRL: Test-Time Reinforcement Learningcited by 275
- 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 237
- 2022Memorizing Transformerscited by 226
- 2023Landmark Attention: Random-Access Infinite Context Length for Transformerscited by 213
- 2024Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentioncited by 200
- 2025Kimi Linear: An Expressive, Efficient Attention Architecturecited by 196
- 2023Augmenting Language Models with Long-Term Memorycited by 189
- 2025MemOS: A Memory OS for AI Systemcited by 138
- 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 129
- 2026Learning to Discover at Test Timecited by 115
- 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agentscited by 78
- 2020Tent: Fully Test-time Adaptation by Entropy Minimizationcited by 69
- 2025Mem-α: Learning Memory Construction via Reinforcement Learningcited by 55
- 2024Memory Layers at Scalecited by 48
- 2026Gated DeltaNet-2: Decoupling Erase and Write in Linear Attentioncited by 33
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.