mlsanityData to 7 Oct 2026

Pramana: A Composable, Domain-Specific Backend for Empirical Networking Research

arXiv 2607.26352 ↗First posted 28 Jul 2026cs.NI cs.AI cs.MAcited by 0

Not on the map. Why?

Abstract (arXiv)

Networking research advances by turning hypotheses into empirical evidence, so accelerating it means reducing the lag between ideation (synthesizing a hypothesis) and generating the data that tests it. Consider a concrete case: does a bulk BBR download fairly share its bottleneck with competing real-time Google Meet traffic? Validating this requires configuring a realistic bottleneck link, concurrently generating BBR's bulk transfer and Meet's real-time traffic, and collecting relevant service-quality metrics. Today this overhead is high, often forcing researchers to start from scratch for every new idea. This ideation-to-data-generation gap will only worsen in the agentic AI era, where AI-assisted ideation accelerates exponentially, yet its outputs cannot be validated without a data-generation backend. This paper explores how to bridge this gap. We envision a composable, domain-specific backend, Pramana, shaped as a thin waist, with diverse research intents at the top and disparate execution substrates at the bottom. Pramana realizes this waist through a single contract, the intent specification, which disaggregates an experiment into three independent axes: the intent (what data to generate), the substrate (where to generate it), and the mechanism (how to produce it), so one specification runs on any substrate. We demonstrate Pramana's utility by building a first-of-its-kind corpus of 255 data-generation intents mined from 66 published papers, and show the intent specification satisfies all of them, where no existing tool satisfies more than 13%. Our current proof-of-concept implementation already satisfies 34% of these intents, more than twice the best existing tool, and we lay out a roadmap for closing this abstraction-implementation gap through a broader community effort to build the envisioned data-generation backend and accelerate empirical networking research.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 46 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

14 of 46 references.

References · 14

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  3. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  4. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  5. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
  6. 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 186
  7. 2025Barbarians at the Gate: How AI is Upending Systems Researchcited by 48
  8. 2025Automated Hypothesis Validation with Agentic Sequential Falsificationscited by 40
  9. 2025NetArena: Dynamic Benchmarks for AI Agents in Network Automationcited by 8
  10. 2023In Search of netUnicorn: A Data-Collection Platform to Develop Generalizable ML Models for Network Security Problemscited by 6
  11. 2025NetReplica: A Programmable Substrate for Bottleneck-Centric Network Data Generationcited by 2
  12. 2025NetBurst: Event-Centric Forecasting of Bursty, Intermittent Time Seriescited by 2
2 more
  1. 2017Kleene Algebra Modulo Theoriescited by 1
  2. 2025NetGent: Agent-Based Automation of Network Application Workflowscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentIdeaBench: Benchmarking Scientific Ideation in the Agent Era
  2. 2026ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research
  3. 2025aiXiv: A Next-Generation Open Access Ecosystem for Scientific Discovery Generated by AI Scientists
  4. 2026GENESIS: Harnessing AI Agents for Autonomous 6G RAN Synthesis, Research, and Testing
  5. 2026ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences
  6. 2025AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite
  7. 2026ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyond
  8. 2026FedWeave: Rethinking the Unit of Specialization in Heterogeneous Federated MoE-LoRA