mlsanityData to 7 Oct 2026

Polaris: A G"odel Agent Framework for Small Language Models through Experience-Abstracted Policy Repair

arXiv 2603.23129 ↗First posted 24 Mar 2026cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

G"odel agent realize recursive self-improvement: an agent inspects its own policy and traces and then modifies that policy in a tested loop. We introduce Polaris, G"odel agent for compact models that performs policy repair via experience abstraction, turning failures into policy updates through a structured cycle of analysis, strategy formation, abstraction, and minimal code patch repair with conservative checks. Unlike response level self correction or parameter tuning, Polaris makes policy level changes with small, auditable patches that persist in the policy and are reused on unseen instances within each benchmark. As part of the loop, the agent engages in meta reasoning: it explains its errors, proposes concrete revisions to its own policy, and then updates the policy. To enable cumulative policy refinement, we introduce experience abstraction, which distills failures into compact, reusable strategies that transfer to unseen instances. On MGSM, DROP, GPQA, and LitBench (covering arithmetic reasoning, compositional inference, graduate-level problem solving, and creative writing evaluation), a 7-billion-parameter model equipped with Polaris achieves consistent gains over the base policy and competitive baselines.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

21 of 32 references.

References · 21

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  6. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  7. 2022Mass-Editing Memory in a Transformercited by 976
  8. 2023Teaching Large Language Models to Self-Debugcited by 963
  9. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
  10. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  11. 2017Deep Reinforcement Learning that Matterscited by 727
  12. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
9 more
  1. 2016The Option-Critic Architecturecited by 433
  2. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
  3. 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 182
  4. 2021MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Researchcited by 96
  5. 2024Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learningcited by 80
  6. 2025LitBench: A Benchmark and Dataset for Reliable Evaluation of Creative Writingcited by 39
  7. 2024A Systematic Literature Review on Large Language Models for Automated Program Repaircited by 37
  8. 2024G"odel Agent: A Self-Referential Agent Framework for Recursive Self-Improvementcited by 27
  9. 2023A Definition of Open-Ended Learning Problems for Goal-Conditioned Agentscited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026NLPG: Natural-Language Policy Gradients for Self-Evolving Language Agents
  2. 2025Self-Abstraction from Grounded Experience for Plan-Guided Policy Refinement
  3. 2026RESKILL: Explicit Failure Attribution and Structured Repair for Interactive Language Agents
  4. 2026MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution
  5. 2026Harness Learning Enables Generalizable Test-Time Adaptation
  6. 2025RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Code
  7. 2026Metan: Recursive Self-Improvement through Emergent Depth
  8. 2026USA: Update-aware SAM for Cross-domain On-Policy Disitllation of Language Agents