Ceci n'est pas une pipe: AI systems as semantic abstractions
Not on the map. Why?
Abstract (arXiv)
An AI system's output is not the fact or world state it appears to describe, but rather an engineered representation. We propose a semantic framework to describe AI systems, to be able to examine the correctness of such representations. To do so, we distinguish what is justified by accepted domain knowledge, what reference sources say, and what the system can currently use. This allows us to give precise definitions to common failures: extrapolation, refuted or unsupported assertion, sources versus knowledge mismatch, stale or refuted source, added hypotheses, unsupported use... We hope our framework gives a useful vocabulary for specifying and checking AI systems whose outputs, citations, tool calls, and world-changing actions must be justified by reliable claims and explicit authority rather than apparent fluency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 106 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
31 of 106 references.
References · 31
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2023Enabling Large Language Models to Generate Text with Citationscited by 584
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
- 2019Control Barrier Functions: Theory and Applicationscited by 332
- 2021Measuring Attribution in Natural Language Generation Modelscited by 253
- 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agentscited by 196
19 more
- 2025Progent: Securing AI Agents with Privilege Controlcited by 121
- 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systemscited by 118
- 2022Prompting Is Programming: A Query Language for Large Language Modelscited by 110
- 2022Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Modelscited by 108
- 2021Introduction to Neural Network Verificationcited by 63
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2021Run Time Assurance for Safety-Critical Systems: An Introduction to Safety Filtering Approaches for Complex Control Systemscited by 25
- 2024The Fusion of Large Language Models and Formal Methods for Trustworthy AI Agents: A Roadmapcited by 20
- 2024Prompts Are Programs Too! Understanding How Developers Build Software Containing Promptscited by 19
- 2015A Survey and Classification of Controlled Natural Languagescited by 18
- 2024Evaluating LLM-driven User-Intent Formalization for Verification-Aware Languagescited by 16
- 2025AgentGuard: Runtime Verification of AI Agentscited by 16
- 2023Formally Specifying the High-Level Behavior of LLM-Based Agentscited by 15
- 2026Intent Formalization: A Grand Challenge for Reliable Coding in the Age of AI Agentscited by 8
- 2025SAIL: Sound Abstract Interpreters with LLMscited by 2
- 2026Composing Verifiable Conceptual Models via Building Blocks: Towards Design-Time Verification of Agentic AI Workflowscited by 2
- 2014A Logic for Reasoning about Evidencecited by 1
- 2026Formal-Method-Guided Vibe Coding: Closing the Verification Loop on AI-Generated Safety-Critical Software Through Model-Driven Engineeringcited by 1
- 2026Propagation of~Interval Belief Structures and~Imprecise Copulas for~Neural Network Verificationcited by 1
Built on by
Not cited yet.