Linguacodus: A Synergistic Framework for Transformative Code Generation in Machine Learning Pipelines
Not on the map. Why?
Abstract (arXiv)
In the ever-evolving landscape of machine learning, seamless translation of natural language descriptions into executable code remains a formidable challenge. This paper introduces Linguacodus, an innovative framework designed to tackle this challenge by deploying a dynamic pipeline that iteratively transforms natural language task descriptions into code through high-level data-shaping instructions. The core of Linguacodus is a fine-tuned large language model (LLM), empowered to evaluate diverse solutions for various problems and select the most fitting one for a given task. This paper details the fine-tuning process, and sheds light on how natural language descriptions can be translated into functional code. Linguacodus represents a substantial leap towards automated code generation, effectively bridging the gap between task descriptions and executable code. It holds great promise for advancing machine learning applications across diverse domains. Additionally, we propose an algorithm capable of transforming a natural description of an ML task into code with minimal human interaction. In extensive experiments on a vast machine learning code dataset originating from Kaggle, we showcase the effectiveness of Linguacodus. The investigations highlight its potential applications across diverse domains, emphasizing its impact on applied machine learning in various scientific fields.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 73 references that are in the map. First posted on arXiv 18 Mar 2024.
Builds on
29 of 73 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
17 more
- 2023PaLM 2 Technical Reportcited by 1,154
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
- 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
- 2020AutoGluon-Tabular: Robust and Accurate AutoML for Structured Datacited by 368
- 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 220
- 2017Abstract Syntax Networks for Code Generation and Semantic Parsingcited by 92
- 2018TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generationcited by 88
- 2022Natural Language to Code Generation in Interactive Data Science Notebookscited by 86
- 2016Latent Predictor Networks for Code Generationcited by 73
- 2023DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agentscited by 52
- 2019JuICe: A Large Scale Distantly Supervised Dataset for Open Domain Context-based Code Generationcited by 49
- 2022CoditT5: Pretraining for Source Code and Natural Language Editingcited by 45
- 2015Program Synthesis using Natural Languagecited by 41
- 2021LightAutoML: AutoML Solution for a Large Financial Services Ecosystemcited by 32
- 2022Training and Evaluating a Jupyter Notebook Data Science Assistantcited by 31
- 2024Grounding Data Science Code Generation with Input-Output Specificationscited by 7
- 2022Code4ML: a Large-scale Dataset of annotated Machine Learning Codecited by 2
Built on by
Not cited yet.