mlsanityData to 7 Oct 2026

OGX: An Open-Source, Vendor-Neutral Generative AI Application Server

arXiv 2608.14580 ↗First posted 12 Jun 2026cs.AI cs.IRcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

OGX (Open GenAI Stack) is an open-source AI application server and Python library that implements the APIs of major frontier labs (OpenAI, Anthropic, Google) with pluggable backend providers. Developers building agentic AI applications--such as retrieval-augmented generation pipelines, multi-turn agents, and tool-calling workflows--can develop against a single API surface and deploy with any combination of inference engine, vector database, and safety backend, without changing application code. OGX's primary focus is the Responses API for server-side agentic orchestration, conforming to the Open Responses specification. The server also supports the Anthropic Messages API and Google GenAI Interactions API, decoupling SDK choice from model and deployment decisions. With over 20 inference providers, 13 vector store backends, and a companion Kubernetes Operator for production deployment, OGX serves as the self-hosted, model-agnostic backend for AI-powered developer tools including Claude Code, Codex CLI, OpenCode, and OpenHands. The project has over 8,400 GitHub stars, 242 contributors, and 4,000 commits across nearly two years of public development.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 3 of its 16 references that are in the map. First posted on arXiv 12 Jun 2026.

Builds on

3 of 16 references.

References · 3

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  2. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
  3. 2026Securing the Agent: Vendor-Neutral, Multitenant Enterprise Retrieval and Tool Usecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023OpenAgents: An Open Platform for Language Agents in the Wild
  2. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents
  3. 2025EnvX: Agentize Everything with Agentic AI
  4. 2026OmniaBench: Benchmarking General AI Agents Across Diverse Scenarios
  5. 2026OpenSage: Self-programming Agent Generation Engine
  6. 2023Agents: An Open-source Framework for Autonomous Language Agents
  7. 2025Re-opening open-source science through AI assisted development ↗
  8. 2026A Large-Scale Study on the Development and Issues of Multi-Agent AI Systems