ONTO: A Token-Efficient Columnar Notation for LLM Input Optimization
Not on the map. Why?
Abstract (arXiv)
Serialization formats designed for document interchange impose structural overhead that becomes prohibitive when large language models consume operational data at scale. A modest dataset of 1,000 IoT sensor readings serialized as JSON requires approximately 80,000 tokens - the majority spent on repeated field names, nested braces, and structural punctuation rather than semantic content. We present ONTO (Object Notation for Token Optimization), a columnar notation that declares field names once per entity and arranges values in pipe-delimited rows with indentation-based hierarchy. This schema-once, data-many design eliminates per-record key repetition while preserving human readability and nested structure support. Evaluation across three synthetic operational datasets demonstrates 46-51% token reduction versus JSON, with stable scaling from 100 to 1,000 records. Controlled inference benchmarks on Qwen2.5-7B show corresponding 5-10% latency improvement. Comprehension validation confirms no material degradation in LLM task accuracy across lookup, counting, extraction, and aggregation operations when format context is provided. Ablation analysis reveals that key repetition accounts for the majority of JSON overhead, with indentation costs in nested structures explaining the 4-percentage-point gap between flat and hierarchical data. ONTO occupies a previously unfilled position in the serialization landscape: columnar efficiency with hierarchical structure, optimized for LLM context windows rather than document interchange. Code and specification are available at https://github.com/harsh-aranga/onto.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 18 references that are in the map. First posted on arXiv 19 Apr 2026.
Builds on
8 of 18 references.
References · 8
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 503
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 348
- 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 287
- 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 214
- 2023Batch Prompting: Efficient Inference with Large Language Model APIscited by 85
- 2022Structured Prompting: Scaling In-Context Learning to 1,000 Examplescited by 81
- 2024Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inferencecited by 53
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Object Aligner: A Configurable JSON Schema Similarity Score for Graphs, Applied to LLM Prompt Optimization
- 2026TruncProof: A Guardrail for LLM-based JSON Generation under Token-Length Constraints
- 2026When JSON Is Not Enough: Semantic Reliability of Schema-Constrained LLM Ordering Agents
- 2025PARSE: LLM Driven Schema Optimization for Reliable Entity Extraction
- 2026Tool-Schema Compression Enables Agentic RAG Under Constrained Context Budgets
- 2026Capacity, Not Format: Rethinking Structured Reasoning Failures
- 2026TSCG: Deterministic Tool-Schema Compilation for Agentic LLM Deployments
- 2026Notation Matters: A Benchmark Study of Token-Optimized Formats in Agentic AI Systems