DeepCoder: Learning to Write Programs
Not on the map. Why?
Abstract (arXiv)
We develop a first line of attack for solving programming competition-style problems from input-output examples using deep learning. The approach is to train a neural network to predict properties of the program that generated the outputs from the inputs. We use the neural network's predictions to augment search techniques from the programming languages community, including enumerative search and an SMT-based solver. Empirically, we show that our approach leads to an order of magnitude speedup over the strong non-augmented baselines and a Recurrent Neural Network approach, and that we are able to solve problems of difficulty comparable to the simplest problems on programming competition websites.
Key facts. Cited by 145 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 28; 2023: 34; 2024: 22; 2025: 17; 2026: 12.
145 papers.
Sort:
By area:
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2023Learning Performance-Improving Code Editscited by 103
- 2022Language Models Can Teach Themselves to Program Bettercited by 75
- 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Surveycited by 72
- 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scalecited by 61
- 2021Learning to Synthesize Programs as Interpretable and Generalizable Policiescited by 59
- 2022Top-Down Synthesis for Library Learningcited by 57
38 more
- 2024What Are Tools Anyway? A Survey from the Language Model Perspectivecited by 53
- 2021Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threadscited by 51
- 2025MARFT: Multi-Agent Reinforcement Fine-Tuningcited by 51
- 2021Inductive logic programming at 30cited by 46
- 2023LILO: Learning Interpretable Libraries by Compressing and Documenting Codecited by 46
- 2024AgileCoder: Dynamic Collaborative Agents for Software Development based on Agile Methodologycited by 45
- 2021Leveraging Language to Learn Program Abstractions and Search Heuristicscited by 44
- 2021SpreadsheetCoder: Formula Prediction from Semi-structured Contextcited by 41
- 2023CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generationcited by 39
- 2021Communicating Natural Programs to Humans and Machinescited by 35
- 2021Latent Execution for Neural Program Synthesiscited by 35
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
- 2025Self-Improving Language Models for Evolutionary Program Synthesis: A Case Study on ARC-AGIcited by 34
- 2023Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Modelscited by 28
- 2023Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generationcited by 27
- 2024Is Programming by Example solved by LLMs?cited by 27
- 2024A Survey on Multimodal Benchmarks: In the Era of Large AI Modelscited by 27
- 2021Programming Puzzlescited by 25
- 2023Flows: Building Blocks of Reasoning and Collaborating AIcited by 25
- 2021Neural-guided, Bidirectional Program Search for Abstraction and Reasoningcited by 23
- 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replaycited by 23
- 2023InstructABSA: Instruction Learning for Aspect Based Sentiment Analysiscited by 22
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2024LLMs for Relational Reasoning: How Far are We?cited by 21
- 2021Generating Adversarial Computer Programs using Optimized Obfuscationscited by 20
- 2023Hierarchical Programmatic Reinforcement Learning via Learning to Compose Programscited by 20
- 2023Enhancing Network Management Using Code Generated by Large Language Modelscited by 20
- 2021PyGlove: Symbolic Programming for Automated Machine Learningcited by 19
- 2022CrossBeam: Learning to Search in Bottom-Up Program Synthesiscited by 18
- 2024Pix2Code: Learning to Compose Neural Visual Concepts as Programscited by 18
- 2022Less is More: Summary of Long Instructions is Better for Program Synthesiscited by 17
- 2023ExeDec: Execution Decomposition for Compositional Generalization in Neural Program Synthesiscited by 17
- 2023Exploring the Robustness of Large Language Models for Solving Programming Problemscited by 16
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Modelscited by 16
- 2024HYSYNTH: Context-Free LLM Approximation for Guiding Program Synthesiscited by 14
- 2021Neural Program Generation Modulo Static Analysiscited by 13
- 2023Neural Task Synthesis for Visual Programmingcited by 13
- 2023Explaining Competitive-Level Programming Solutions using LLMscited by 13
50 most cited of 145 All 145 (JSON)
- 2026Narcissus: Program Synthesis Using Context-Aware LLM Approximations26 Aug 2026
- 2026Solver-Aware Decompositions for Programming-by-Example: When Dividing Requires Knowing how to Conquer4 Aug 2026
- 2026Fixed-Set Robustness in Programming by Example: Example Corruption and Semantic Partition Recovery1 Jul 2026
- 2026Neuro-Bayesian-Symbolic Residual Attention Shallow Network: Explainable Deep Learning for Cybersecurity Risk Assessment29 Jun 2026
- 2026CP-Agent: A Calibrated Risk-Controlled Agent for Feedback-Driven Competitive Programming23 May 2026
- 2026Hypothesis Generation and Inductive Inference in Children and Language Models23 May 2026
- 2026Distribution-Aware Algorithm Design with LLM Agents13 May 2026
- 2026ReaComp: Compiling LLM Reasoning into Symbolic Solvers for Efficient Program Synthesis6 May 2026
- 2026Why Search When You Can Transfer? Amortized Agentic Workflow Design from Structural Priors27 Apr 2026
- 2026Gradient-Based Program Synthesis with Neurally Interpreted Languages20 Apr 2026
- 2026Learning Hierarchical and Geometry-Aware Graph Representations for Text-to-CAD11 Apr 2026
- 2026DSL-R1: From SQL to DSL for Training Retrieval Agents across Structured and Unstructured Data with Reinforcement Learning14 Jan 2026
38 more
- 2025Herb.jl: A Unifying Program Synthesis Library10 Oct 2025
- 2025Combining Large Language Models and Gradient-Free Optimization for Automatic Control Policy Synthesis1 Oct 2025
- 2025Advancing rail safety: An onboard measurement system of rolling stock wheel flange wear based on dynamic machine learning algorithms21 Aug 2025
- 2025Finite Automata Extraction: Low-data World Model Learning as Programs from Gameplay Video15 Aug 2025
- 2025Modelling Program Spaces in Program Synthesis with Constraints10 Jul 2025
- 2025Self-Improving Language Models for Evolutionary Program Synthesis: A Case Study on ARC-AGI10 Jul 2025
- 2025Structured Program Synthesis using LLMs: Results and Insights from the IPARC Challenge15 Jun 2025
- 2025Bayesian Inverse Physics for Neuro-Symbolic Robot Learning10 Jun 2025
- 2025PBEBench: A Multi-Step Programming by Examples Reasoning Benchmark inspired by Historical Linguistics29 May 2025
- 2025MARCO: Meta-Reflection with Cross-Referencing for Code Reasoning23 May 2025
- 2025Beyond Either-Or Reasoning: Transduction and Induction as Cooperative Problem-Solving Paradigms20 May 2025
- 2025AutoGEEval: A Multimodal and Automated Framework for Geospatial Code Generation on GEE with Large Language Models19 May 2025
- 2025MARFT: Multi-Agent Reinforcement Fine-Tuning21 Apr 2025
- 2025Shedding Light in Task Decomposition in Program Synthesis: The Driving Force of the Synthesizer Model11 Mar 2025
- 2025Unveiling the Magic of Code Reasoning through Hypothesis Decomposition and Amendment17 Feb 2025
- 2025Learning Semantics-aware Search Operators for Genetic Programming6 Feb 2025
- 2025AlgoPilot: Fully Autonomous Program Synthesis Without Human-Written Programs11 Jan 2025
- 2024Learning Randomized Reductions24 Dec 2024
- 2024Guiding Genetic Programming with Graph Neural Networks3 Nov 2024
- 2024A Survey on Multimodal Benchmarks: In the Era of Large AI Models21 Sep 2024
- 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scale9 Sep 2024
- 2024Case2Code: Scalable Synthetic Data for Code Generation17 Jul 2024
- 2024Efficacy of Various Large Language Models in Generating Smart Contracts28 Jun 2024
- 2024AgileCoder: Dynamic Collaborative Agents for Software Development based on Agile Methodology16 Jun 2024
- 2024Is Programming by Example solved by LLMs?12 Jun 2024
- 2024Amortizing Pragmatic Program Synthesis with Rankings1 Jun 2024
- 2024Diffusion On Syntax Trees For Program Synthesis30 May 2024
- 2024AbstractBeam: Enhancing Bottom-Up Program Synthesis using Library Learning27 May 2024
- 2024Synthesizing Programmatic Reinforcement Learning Policies with Large Language Model Guided Search26 May 2024
- 2024HYSYNTH: Context-Free LLM Approximation for Guiding Program Synthesis24 May 2024
- 2024What Are Tools Anyway? A Survey from the Language Model Perspective18 Mar 2024
- 2024Guiding Enumerative Program Synthesis with Large Language Models6 Mar 2024
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Models6 Mar 2024
- 2024Robust Synthetic Data-Driven Detection of Living-Off-the-Land Reverse Shells28 Feb 2024
- 2024Pix2Code: Learning to Compose Neural Visual Concepts as Programs13 Feb 2024
- 2024Grounding Data Science Code Generation with Input-Output Specifications12 Feb 2024
- 2024Guided Sketch-Based Program Induction by Search Gradients10 Feb 2024
- 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replay7 Feb 2024
50 newest of 145 All 145 (JSON)
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replaycited by 23
- 2024LLMs for Relational Reasoning: How Far are We?cited by 21
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Modelscited by 16
- 2025Unveiling the Magic of Code Reasoning through Hypothesis Decomposition and Amendmentcited by 6
- 2022LEMMA: Bootstrapping High-Level Mathematical Reasoning with Learned Symbolic Abstractionscited by 5
- 2025PBEBench: A Multi-Step Programming by Examples Reasoning Benchmark inspired by Historical Linguisticscited by 2
- 2026ReaComp: Compiling LLM Reasoning into Symbolic Solvers for Efficient Program Synthesiscited by 1
- 2025MARCO: Meta-Reflection with Cross-Referencing for Code Reasoningcited by 0
- 2026ReaComp: Compiling LLM Reasoning into Symbolic Solvers for Efficient Program Synthesis6 May 2026
- 2025PBEBench: A Multi-Step Programming by Examples Reasoning Benchmark inspired by Historical Linguistics29 May 2025
- 2025MARCO: Meta-Reflection with Cross-Referencing for Code Reasoning23 May 2025
- 2025Unveiling the Magic of Code Reasoning through Hypothesis Decomposition and Amendment17 Feb 2025
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Models6 Mar 2024
- 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replay7 Feb 2024
- 2024LLMs for Relational Reasoning: How Far are We?17 Jan 2024
- 2022LEMMA: Bootstrapping High-Level Mathematical Reasoning with Learned Symbolic Abstractions16 Nov 2022
- 2022Competition-Level Code Generation with AlphaCode8 Feb 2022
- 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scalecited by 61
- 2025MARFT: Multi-Agent Reinforcement Fine-Tuningcited by 51
- 2026Why Search When You Can Transfer? Amortized Agentic Workflow Design from Structural Priorscited by 6
- 2026CP-Agent: A Calibrated Risk-Controlled Agent for Feedback-Driven Competitive Programmingcited by 2
- 2024Learning Randomized Reductionscited by 0
- 2026Distribution-Aware Algorithm Design with LLM Agentscited by 0
- 2026Hypothesis Generation and Inductive Inference in Children and Language Modelscited by 0
- 2026CP-Agent: A Calibrated Risk-Controlled Agent for Feedback-Driven Competitive Programming23 May 2026
- 2026Hypothesis Generation and Inductive Inference in Children and Language Models23 May 2026
- 2026Distribution-Aware Algorithm Design with LLM Agents13 May 2026
- 2026Why Search When You Can Transfer? Amortized Agentic Workflow Design from Structural Priors27 Apr 2026
- 2025MARFT: Multi-Agent Reinforcement Fine-Tuning21 Apr 2025
- 2024Learning Randomized Reductions24 Dec 2024
- 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scale9 Sep 2024
- 2024Diffusion On Syntax Trees For Program Synthesiscited by 10
- 2024Diffusion On Syntax Trees For Program Synthesis30 May 2024
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2023Learning Performance-Improving Code Editscited by 103
- 2022Language Models Can Teach Themselves to Program Bettercited by 75
- 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Surveycited by 72
- 2021Learning to Synthesize Programs as Interpretable and Generalizable Policiescited by 59
- 2022Top-Down Synthesis for Library Learningcited by 57
- 2024What Are Tools Anyway? A Survey from the Language Model Perspectivecited by 53
- 2021Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threadscited by 51
12 most cited of 124 All 124 (JSON)
- 2026Narcissus: Program Synthesis Using Context-Aware LLM Approximations26 Aug 2026
- 2026Solver-Aware Decompositions for Programming-by-Example: When Dividing Requires Knowing how to Conquer4 Aug 2026
- 2026Fixed-Set Robustness in Programming by Example: Example Corruption and Semantic Partition Recovery1 Jul 2026
- 2026Neuro-Bayesian-Symbolic Residual Attention Shallow Network: Explainable Deep Learning for Cybersecurity Risk Assessment29 Jun 2026
- 2026Gradient-Based Program Synthesis with Neurally Interpreted Languages20 Apr 2026
- 2026Learning Hierarchical and Geometry-Aware Graph Representations for Text-to-CAD11 Apr 2026
- 2026DSL-R1: From SQL to DSL for Training Retrieval Agents across Structured and Unstructured Data with Reinforcement Learning14 Jan 2026
- 2025Herb.jl: A Unifying Program Synthesis Library10 Oct 2025
- 2025Combining Large Language Models and Gradient-Free Optimization for Automatic Control Policy Synthesis1 Oct 2025
- 2025Advancing rail safety: An onboard measurement system of rolling stock wheel flange wear based on dynamic machine learning algorithms21 Aug 2025
- 2025Modelling Program Spaces in Program Synthesis with Constraints10 Jul 2025
- 2025Structured Program Synthesis using LLMs: Results and Insights from the IPARC Challenge15 Jun 2025
12 newest of 124 All 124 (JSON)