mlsanityData to 7 Oct 2026

Project Greenhouse: Progress Toward Fully Open and Sovereign Agentic Search

arXiv 2610.11922 ↗First posted 8 Oct 2026cs.IR cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Project Greenhouse represents our exploration of a simple thesis: We believe that it is possible to build fully open and sovereign models for agentic search with only modest computational resources. As a first milestone, we describe how to build a competitive pointwise decoder-only reranker using a simple two-step recipe comprising pre-training from scratch followed by supervised fine-tuning, starting only from commonly available datasets. Contrary to the dominant approach in the literature, we do not rely on existing open-weight backbones from third parties, and thus we are fully in control of model training, from end to end. We were able to accomplish the bulk of our experiments using no more than a handful of GPUs. This report articulates the importance and benefits of our approach, and we share artifacts that enable transparent, independent reproduction of all aspects of model training. Beyond data, code, and configurations that capture our efforts, we also release checkpoints for our family of Gaggle models, demonstrating the feasibility of our approach and providing a first step toward validating our broader thesis.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 85 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

41 of 85 references.

References · 41

  1. 2024Qwen2 Technical Reportcited by 2,076
  2. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  4. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  5. 2019Passage Re-ranking with BERTcited by 629
  6. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
  7. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
  8. 2024DataComp-LM: In search of the next generation of training sets for language modelscited by 381
  9. 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 307
  10. 20242 OLMo 2 Furiouscited by 302
  11. 2018An Empirical Model of Large-Batch Trainingcited by 268
  12. 2019Multi-Stage Document Ranking with BERTcited by 200
29 more
  1. 2026Gemma 4 Technical Reportcited by 187
  2. 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 180
  3. 2023RankZephyr: Effective and Robust Zero-Shot Listwise Reranking is a Breeze!cited by 151
  4. 2020Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillationcited by 143
  5. 2023LLM360: Towards Fully Transparent Open-Source LLMscited by 100
  6. 2025Olmo 3cited by 95
  7. 2025Recursive Language Modelscited by 94
  8. 2021The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Modelscited by 81
  9. 2023RankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large Language Modelscited by 69
  10. 2024MAP-Neo: Highly Capable and Transparent Bilingual Large Language Model Seriescited by 67
  11. 2025Rank-R1: Enhancing Reasoning in LLM-based Document Rerankers via Reinforcement Learningcited by 58
  12. 2024Large Language Models Reflect the Ideology of their Creatorscited by 56
  13. 2024UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessorcited by 41
  14. 2026Beyond Semantic Similarity: Rethinking Retrieval for Agentic Search via Direct Corpus Interactioncited by 33
  15. 2025The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Textcited by 25
  16. 2021A Proposed Conceptual Framework for a Representational Approach to Information Retrievalcited by 24
  17. 2025jina-reranker-v3: Last but Not Late Interaction for Listwise Document Rerankingcited by 23
  18. 2026Olmo Hybrid: From Theory to Practice and Backcited by 22
  19. 2025R3-RAG: Learning Step-by-Step Reasoning and Retrieval for LLMs via Reinforcement Learningcited by 19
  20. 2026Rethinking Agentic Search with Pi-Serini: Is Lexical Retrieval Sufficient?cited by 8
  21. 2025Apertus: Democratizing Open and Compliant LLMs for Global Language Environmentscited by 7
  22. 2026EuroLLM-22B: Technical Reportcited by 7
  23. 2022Building a Culture of Reproducibility in Academic Researchcited by 5
  24. 2025Even Small Reasoners Should Quote Their Sources: Introducing the Pleias-RAG Model Familycited by 3
  25. 2025K2-V2: A 360-Open, Reasoning-Enhanced LLMcited by 3
  26. 2026Apertus LLM Family Expansion via Distillation and Quantizationcited by 1
  27. 2026Thomson: Continual Learning of Frontier Models for SovereignAIcited by 1
  28. 2026Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within 5090cited by 1
  29. 2026OPEN-1B: A Fully Auditable Training Runcited by 1

Built on by

Not cited yet.