Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA
Not on the map. Why?
Abstract (arXiv)
Macaron-V1 is an open agent-model family for experiential intelligence: learning from experience in real environments and continuing to learn after deployment. It is organized around two system goals. Adaptation is pursued through recursive improvement of versioned model-harness pairs, where experience from one configuration is evaluated under an external contract and used to construct its successor. Collaboration is pursued via the Mixture-of-LoRA (MoL) architecture that freezes a base model, composes specialist LoRA adapters, and selects one LoRA per user turn. The flagship Macaron-V1-Venti (748B) combines a 744B GLM-5.2 base with four LoRAs for chat, agent, coding, and GenUI; the Qwen3.6-35B-based Macaron-V1-Tall (50B) uses the same design for local deployment. This report presents Macaron-V1 as a co-designed system spanning architecture, algorithms, and infrastructure. The MoL architecture supports continual learning through extensible LoRA specialists. The algorithm combines Model-Harness Co-design and recursive self-improvement loop, including the UI4A component-native GenUI harness, a stateful action substrate, versioned Harness Context Protocol contract, and the agentic RL framework MindForge. The supporting infrastructure includes the post-training platform MinT, the long-context RL method LongStraw, and stability techniques for sparse MoE and DSA base models. We evaluate Macaron-V1 on Personal Intelligence, GenUI, and general capability benchmarks against frontier baselines. Our results validate the current system, while compounding gains from continual learning and collective intelligence remain open questions.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 56 of its 83 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
56 of 83 references.
References · 56
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
- 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
38 more
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2024EAGLE: Speculative Sampling Requires Rethinking Feature Uncertaintycited by 578
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2024Executable Code Actions Elicit Better LLM Agentscited by 564
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
- 2021AI and the Everything in the Whole Wide World Benchmarkcited by 349
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2021What Will it Take to Fix Benchmarking in Natural Language Understanding?cited by 203
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 178
- 2023S-LoRA: Serving Thousands of Concurrent LoRA Adapterscited by 152
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
- 2018Categorizing Variants of Goodhart's Lawcited by 149
- 2020Unsupervised Evaluation of Interactive Dialog with DialoGPTcited by 139
- 2023Punica: Multi-Tenant LoRA Servingcited by 83
- 2025Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routerscited by 72
- 2025Every Step Evolves: Scaling Reinforcement Learning for Trillion-Scale Thinking Modelcited by 55
- 2025Rethinking Mixture-of-Agents: Is Mixing Different Large Language Models Beneficial?cited by 54
- 2026Continual Harness: Online Adaptation for Self-Improving Foundation Agentscited by 41
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 35
- 2026Recursive Harness Self-Improvementcited by 32
- 2026Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updatescited by 19
- 2025TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretrainingcited by 15
- 2026EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answeringcited by 15
- 2026ClawGym: A Scalable Framework for Building Effective Claw Agentscited by 15
- 2026δ-mem: Efficient Online Memory for Large Language Modelscited by 13
- 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactionscited by 12
- 2026Generative UI: LLMs are Effective UI Generatorscited by 8
- 2026When Does Continual Learning Require Learningcited by 7
- 2026Metis: Memory Foundation Modelcited by 7
- 2025Generative Interfaces for Language Modelscited by 6
- 2026Effective LoRA Adapter Routing using Task Representationscited by 6
- 2026Decomposing the Basic Abilities of Large Language Models: Mitigating Cross-Task Interference in Multi-Task Instruct-Tuningcited by 5
- 2026EVOCHAMBER: Test-Time Co-evolution of Multi-Agent System at Individual, Team, and Population Scalescited by 4
- 2026MoLoRA: Composable Specialization via Per-Token Adapter Routingcited by 3
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026CERA-MoA: Co-Evolving Routing Mechanisms with Continually Learning LLM Agents
- 2026CLaaS: Continual learning as a service for sample efficient online learning
- 2025Adaptive Minds: Empowering Agents with LoRA-as-Tools
- 2026MMoA: An AI-Agent framework with recurrence for Memoried Mixure-of-Agent
- 2025Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement
- 2026Learning to Select, Not Relearn: Hard-Routed Mixtures of Reasoning LoRAs
- 2025Tina: Tiny Reasoning Models via LoRA
- 2026ACLArena: Agent Continue Learning in Multi-stage Post-training