Thomson: Continual Learning of Frontier Models for SovereignAI
Not on the map. Why?
Abstract (arXiv)
The development of frontier models is commonly perceived to be the exclusive remit of a small number of heavily funded players, creating an information, economic and power asymmetry between developers and the diverse user base of modern AI. Recent public discourse acknowledges this concern, calling for SovereignAI (an organisation's capability to independently build, deploy and govern AI use), but offers little concrete advice on how this can be achieved in the short term under a diversity of funding settings. We argue that frontier performance is achievable by a wide range of institutions through Continual Learning on readily available open-weight models. Unlike limited approaches such as small-scale fine-tuning, prompt engineering, or tool-augmentation of a frozen model, our approach exploits a modern mid- & post-training stack while introducing safeguards that preserve both plasticity and stability at each stage, making the minimal number of high-impact interventions on the parameters. This yields gains comparable to those typically seen across multiple successive model generations, at compute and personnel budgets substantially lower than commonly thought, making ownership of large parts of the SovereignAI stack (model, tool infrastructure, values & data privacy) viable for far more actors. We demonstrate this with Thomson, a general-purpose frontier model trained with an enhanced focus on high-stakes professional work. Thomson performs competitively with recent frontier models across agentic tasks, safety, legal, tax & multilingualism, and large-scale Deep Research. Evaluations show a distinctive π-shaped pattern: distinct improvements across a wide range of capabilities, including those not explicitly targeted, while almost completely eliminating the forgetting problem common to narrow domain adaptation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). First posted on arXiv 27 Aug 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
- 2026Contextual Multi-Objective Optimization: Rethinking Objectives in Frontier AI Systems
- 2026How Inference Compute Shapes Frontier LLM Evaluation
- 2025Can Small Training Runs Reliably Guide Data Curation? Rethinking Proxy-Model Practice
- 2026verdi: retrieval is not transfer for continual world model optimization
- 2026Learning on the Job: Continual Learning from Deployment Feedback for Frozen-Weights Agents
- 2026Frontier AI Forecasting Has a Measurement Problem: An Audit of Progress Evidence
- 2026The Institutional Scaling Law: Non-Monotonic Fitness, Capability-Trust Divergence, and Symbiogenetic Scaling in Generative AI