SemPiper: Interactive Code Synthesis for Semantic Operators in Machine Learning Pipelines
Not on the map. Why?
Abstract (arXiv)
Machine learning (ML) pipelines require extensive data preparation, feature engineering, and integration across heterogeneous sources, making them tedious and error-prone to develop. While large language models (LLMs) have recently shown promise for assisting programming tasks, chat-based interfaces provide limited control over pipeline behavior and often produce code that is difficult to optimize or integrate into production systems. We demonstrate SemPipes, a novel programming model that extends ML pipelines with declarative, LLM-powered semantic data operators. SemPipes allows developers to specify high-level natural language instructions for data-centric operations, while seamlessly combining these operators with arbitrary Python code from standard data science libraries. For the semantic operators, it synthesizes specialized implementations at pipeline training time, conditioned on dataset characteristics and pipeline context, enabling the flexible yet controlled integration of LLM capabilities. We demonstrate SemPipes through SemPiper, an interactive interface that visualizes computational graphs of the pipelines, synthesized operator implementations, and optimization trajectories produced by an evolutionary search procedure. Attendees can explore three end-to-end scenarios, modify pipelines, inspect generated code, and observe how semantic operators are synthesized and iteratively optimized. The demonstration highlights how declarative semantic operators enable controllable, optimizable, and practical integration of LLMs into ML pipeline development.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 4 of its 12 references that are in the map. First posted on arXiv 12 Jun 2026.
Builds on
4 of 12 references.
References · 4
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivitycited by 101
- 2021Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunitiescited by 23
- 2026SemPipes -- Optimizable Semantic Data Operators for Tabular Machine Learning Pipelinescited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.