Laguna M.1/XS.2 Technical Report
On the map: LLM agents and tool use → Software engineering coding agents
also in 1 more
Abstract (arXiv)
We present Laguna M.1 and Laguna XS.2, two Mixture-of-Experts foundation models built for long-horizon, agentic coding: M.1 has 225.8B total parameters (23.4B activated per token) and XS.2 has 33.4B total (3B activated). Both models were trained from scratch end-to-end inside the same internal system that we refer to as our Model Factory: a tightly-integrated stack of versioned data, training, evaluation, and inference components that turn model development into an industrial process. We describe the principles and design choices of the Model Factory and also detail the end-to-end training process of our models, throughout pre-training data and architecture, post-training stages, evaluation, and quantization. On agentic software engineering and terminal benchmarks (SWE-bench Verified, SWE-bench Multilingual, SWE-Bench Pro, and Terminal-Bench 2.0) M.1 and XS.2 are competitive with state-of-the-art open models in their respective weight classes. Laguna XS.2 weights are released under Apache~2.0 at https://huggingface.co/collections/poolside/laguna-xs2.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 72 of its 98 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
72 of 98 references.
Closest ancestors · 4
Same direction, newest first
- 2026GLM-5: from Vibe Coding to Agentic Engineering17 Feb
- 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
Other references · 68
- 2017Attention Is All You Needcited by 60,361
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
38 more
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
- 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
- 2017Mixed Precision Trainingcited by 1,156
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2020On Layer Normalization in the Transformer Architecturecited by 922
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
- 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2023Textbooks Are All You Needcited by 569
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 483
- 2024SpinQuant: LLM quantization with learned rotationscited by 471
- 2025Muon is Scalable for LLM Trainingcited by 428
- 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 399
- 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
- 2024DataComp-LM: In search of the next generation of training sets for language modelscited by 398
- 2022Reducing Activation Recomputation in Large Transformer Modelscited by 302
- 2024CRUXEval: A Benchmark for Code Reasoning, Understanding and Executioncited by 300
- 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 283
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
- 2025MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attentioncited by 263
- 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 232
- 2024Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performancecited by 184
- 2024RegMix: Data Mixture as Regression for Language Model Pre-trainingcited by 177
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Dion3: Full-Stack Orthogonal Updatescited by 4
- 2026Dion3: Full-Stack Orthogonal Updates12 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026FormulaCode: Evaluating Agentic Optimization on Large Codebases
- 2026Agentic coding without the cloud: evaluating open-weight large language models on longitudinal data preparation tasks
- 2024DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models
- 2026Multi-task Code LLMs: Data Mix or Model Merge?
- 2026The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligence
- 2025KAT-Coder Technical Report
- 2026Identical Runs, Different Results: Benchmarking AI Coding Agents on Open-Weight Models
- 2026ISO-Bench: Can Coding Agents Optimize Real-World Inference Workloads?