Executable Code Knowledge: Code as a Native, Validation-Carrying Knowledge Representation for AI Coding Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
AI coding agents need more than relevant snippets: they need business semantics, validation evidence, relations, and assurance that their context is current. Existing systems usually infer or externalize this knowledge through retrieval, summaries, graphs, rules, or reverse specifications. We investigate a complementary representation in which selected code units directly carry agent-usable knowledge. We introduce Executable Code Knowledge (ECK) and define an Executable Code Knowledge Unit (ECKU) as a source-bound object combining stable identity, semantics, executable behavior, contracts, evidence, relations, provenance, validation state, and a query interface. Our Python prototype supports code-local authoring, manifest export, evidence execution, exact changed-line impact, freshness checking, and agent-facing projections. Across three real Python repositories and 26 controlled patch tasks, direct ECK provides executable test coverage for 11/11 evidence-bearing tasks and exact selectors for 9/11; hiding declared evidence reduces exact recovery to 1/11 (paired exact McNemar p=0.0078). ECK-derived rules recover 11/11 exact selectors, showing that rules are effective delivery artifacts while ECK supplies source binding, validation state, impact, and freshness. Exact changed-line impact matches independently authored labels on all 26 patches (12 unit links; precision, recall, and F1 all 1.000). AST-bounded fingerprints classify 50 positive changes and 17 unrelated same-file controls correctly, whereas static rules snapshots detect none of the 50 stale cases. Model-backed patch-review and cross-layer studies measure projection fidelity rather than independent impact discovery. These results support a hybrid architecture: retrieval for coverage, ECK for source and evidence governance, and projections for delivery.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 17 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
7 of 17 references.
Closest ancestors · 4
Same direction, newest first
- 2026CORE-Bench: A Comprehensive Benchmark for Code Retrieval in the Era of Agentic Coding10 Jun
- 2026Codebase-Memory: Tree-Sitter-Based Knowledge Graphs for LLM Code Exploration via MCP28 Mar
- 2026SWE-Skills-Bench: Do Agent Skills Actually Help in Real-World Software Engineering?16 Mar
- 2026ContextBench: A Benchmark for Context Retrieval in Coding Agents5 Feb
Other references · 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Preventing Premature Commitment in Coding Agents with an Evidence-Conditioned Execution Layer
- 2026LLMoxie: Exploring Agentic AI for Scientific Software Development
- 2026ABTest: Behavior-Driven Testing for AI Coding Agents
- 2026From Verification Failures to Reusable Guidance for Coding Agents
- 2026An Exploratory Study of Agent Plans for Agentic AI Coding Tools in Open-Source Software
- 2026Understanding the Architecture of Coding Agents: An Exploratory Study Using a Research Prototype
- 2026Compact Documentation for Coding Agents: A Benchmark, an Optimizer, and Why It Does Not Transfer
- 2026Harness Engineering for Agentic AI Coding Tools: An Exploratory Study