In harmony with gpt-oss
Not on the map. Why?
Abstract (arXiv)
No one has independently reproduced OpenAI's published scores for gpt-oss-20b with tools, because the original paper discloses neither the tools nor the agent harness. We reverse-engineered the model's in-distribution tools: when prompted without tool definitions, gpt-oss still calls tools from its training distribution with high statistical confidence -- a strong prior, not a hallucination. We then built a native harmony agent harness (https://github.com/borislavmavrin/harmonyagent.git) that encodes messages in the model's native format, bypassing the lossy Chat Completions conversion. Together, these yield the first independent reproduction of OpenAI's published scores: 60.4% on SWE Verified HIGH (published 60.7%), 53.3% MEDIUM (53.2%), and 91.7% on AIME25 with tools (90.4%).
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 2 of its 12 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
2 of 12 references.
References · 2
Built on by
Citing papers per year: 2026: 1.
1 paper.