mlsanityData to 14 Oct 2026

Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA

arXiv 2608.09819 ↗First posted 10 Aug 2026cs.LG cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Macaron-V1 is an open agent-model family for experiential intelligence: learning from experience in real environments and continuing to learn after deployment. It is organized around two system goals. Adaptation is pursued through recursive improvement of versioned model-harness pairs, where experience from one configuration is evaluated under an external contract and used to construct its successor. Collaboration is pursued via the Mixture-of-LoRA (MoL) architecture that freezes a base model, composes specialist LoRA adapters, and selects one LoRA per user turn. The flagship Macaron-V1-Venti (748B) combines a 744B GLM-5.2 base with four LoRAs for chat, agent, coding, and GenUI; the Qwen3.6-35B-based Macaron-V1-Tall (50B) uses the same design for local deployment. This report presents Macaron-V1 as a co-designed system spanning architecture, algorithms, and infrastructure. The MoL architecture supports continual learning through extensible LoRA specialists. The algorithm combines Model-Harness Co-design and recursive self-improvement loop, including the UI4A component-native GenUI harness, a stateful action substrate, versioned Harness Context Protocol contract, and the agentic RL framework MindForge. The supporting infrastructure includes the post-training platform MinT, the long-context RL method LongStraw, and stability techniques for sparse MoE and DSA base models. We evaluate Macaron-V1 on Personal Intelligence, GenUI, and general capability benchmarks against frontier baselines. Our results validate the current system, while compounding gains from continual learning and collective intelligence remain open questions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 56 of its 83 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

56 of 83 references.

References · 56

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  6. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  7. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  8. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  9. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  10. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  11. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
  12. 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
38 more
  1. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  2. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  3. 2024EAGLE: Speculative Sampling Requires Rethinking Feature Uncertaintycited by 578
  4. 2025Kimi K2: Open Agentic Intelligencecited by 567
  5. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  6. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  7. 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
  8. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
  9. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
  10. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 349
  11. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  12. 2021What Will it Take to Fix Benchmarking in Natural Language Understanding?cited by 203
  13. 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 178
  14. 2023S-LoRA: Serving Thousands of Concurrent LoRA Adapterscited by 152
  15. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
  16. 2018Categorizing Variants of Goodhart's Lawcited by 149
  17. 2020Unsupervised Evaluation of Interactive Dialog with DialoGPTcited by 139
  18. 2023Punica: Multi-Tenant LoRA Servingcited by 83
  19. 2025Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routerscited by 72
  20. 2025Every Step Evolves: Scaling Reinforcement Learning for Trillion-Scale Thinking Modelcited by 55
  21. 2025Rethinking Mixture-of-Agents: Is Mixing Different Large Language Models Beneficial?cited by 54
  22. 2026Continual Harness: Online Adaptation for Self-Improving Foundation Agentscited by 41
  23. 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 35
  24. 2026Recursive Harness Self-Improvementcited by 32
  25. 2026Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updatescited by 19
  26. 2025TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretrainingcited by 15
  27. 2026EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answeringcited by 15
  28. 2026ClawGym: A Scalable Framework for Building Effective Claw Agentscited by 15
  29. 2026δ-mem: Efficient Online Memory for Large Language Modelscited by 13
  30. 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactionscited by 12
  31. 2026Generative UI: LLMs are Effective UI Generatorscited by 8
  32. 2026When Does Continual Learning Require Learningcited by 7
  33. 2026Metis: Memory Foundation Modelcited by 7
  34. 2025Generative Interfaces for Language Modelscited by 6
  35. 2026Effective LoRA Adapter Routing using Task Representationscited by 6
  36. 2026Decomposing the Basic Abilities of Large Language Models: Mitigating Cross-Task Interference in Multi-Task Instruct-Tuningcited by 5
  37. 2026EVOCHAMBER: Test-Time Co-evolution of Multi-Agent System at Individual, Team, and Population Scalescited by 4
  38. 2026MoLoRA: Composable Specialization via Per-Token Adapter Routingcited by 3

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026CERA-MoA: Co-Evolving Routing Mechanisms with Continually Learning LLM Agents
  2. 2026CLaaS: Continual learning as a service for sample efficient online learning
  3. 2025Adaptive Minds: Empowering Agents with LoRA-as-Tools
  4. 2026MMoA: An AI-Agent framework with recurrence for Memoried Mixure-of-Agent
  5. 2025Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement
  6. 2026Learning to Select, Not Relearn: Hard-Routed Mixtures of Reasoning LoRAs
  7. 2025Tina: Tiny Reasoning Models via LoRA
  8. 2026ACLArena: Agent Continue Learning in Multi-stage Post-training