ai.txt: A Domain-Specific Language for Guiding AI Interactions with the Internet
Not on the map. Why?
Abstract (arXiv)
We introduce ai.txt, a novel domain-specific language (DSL) designed to explicitly regulate interactions between AI models, agents, and web content, addressing critical limitations of the widely adopted robots.txt standard. As AI increasingly engages with online materials for tasks such as training, summarization, and content modification, existing regulatory methods lack the necessary granularity and semantic expressiveness to ensure ethical and legal compliance. ai.txt extends traditional URL-based access controls by enabling precise element-level regulations and incorporating natural language instructions interpretable by AI systems. To facilitate practical deployment, we provide an integrated development environment with code autocompletion and automatic XML generation. Furthermore, we propose two compliance mechanisms: XML-based programmatic enforcement and natural language prompt integration, and demonstrate their effectiveness through preliminary experiments and case studies. Our approach aims to aid the governance of AI-Internet interactions, promoting responsible AI use in digital ecosystems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 2 of its 19 references that are in the map. First posted on arXiv 2 May 2025.
Builds on
2 of 19 references.
References · 2
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
Built on by
Citing papers per year: 2026: 2.
2 papers.