Write, Execute, Assess: Program Synthesis with a REPL
Not on the map. Why?
Abstract (arXiv)
We present a neural program synthesis approach integrating components which write, execute, and assess code to navigate the search space of possible programs. We equip the search process with an interpreter or a read-eval-print-loop (REPL), which immediately executes partially written programs, exposing their semantics. The REPL addresses a basic challenge of program synthesis: tiny changes in syntax can lead to huge changes in semantics. We train a pair of models, a policy that proposes the new piece of code to write, and a value function that assesses the prospects of the code written so-far. At test time we can combine these models with a Sequential Monte Carlo algorithm. We apply our approach to two domains: synthesizing text editing programs and inferring 2D and 3D graphics programs.
Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 18; 2023: 22; 2024: 19; 2025: 14; 2026: 4.
92 papers.
Sort:
By area:
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
- 2022CodeT: Code Generation with Generated Testscited by 369
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 229
- 2023Planning with Large Language Models for Code Generationcited by 179
- 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 121
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 120
- 2023Hypothesis Search: Inductive Reasoning with Language Modelscited by 119
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 101
- 2023Execution-based Code Generation using Deep Reinforcement Learningcited by 95
38 more
- 2023Hierarchical Neural Coding for Controllable CAD Model Generationcited by 84
- 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 78
- 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agentscited by 77
- 2022Language Models Can Teach Themselves to Program Bettercited by 75
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 74
- 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Surveycited by 72
- 2021SketchGen: Generating Constrained CAD Sketchescited by 68
- 2021Learning to Synthesize Programs as Interpretable and Generalizable Policiescited by 59
- 2021Engineering Sketch Generation for Computer-Aided Designcited by 49
- 2022Reasoning Like Program Executorscited by 45
- 2021Leveraging Language to Learn Program Abstractions and Search Heuristicscited by 44
- 2022Reconstructing editable prismatic CAD from rounded voxel modelscited by 41
- 2023D2CSG: Unsupervised Learning of Compact CSG Trees with Dual Complements and Dropoutscited by 39
- 2022Learning Math Reasoning from Self-Sampled Correct and Partially-Correct Solutionscited by 38
- 2021Communicating Natural Programs to Humans and Machinescited by 35
- 2021Latent Execution for Neural Program Synthesiscited by 35
- 2022Fault-Aware Neural Code Rankerscited by 33
- 2024Can Large Language Models Understand Symbolic Graphics Programs?cited by 32
- 2025HoLa: B-Rep Generation using a Holistic Latent Representationcited by 29
- 2024Is Programming by Example solved by LLMs?cited by 27
- 2021Neural-guided, Bidirectional Program Search for Abstraction and Reasoningcited by 23
- 2023ShapeCoder: Discovering Abstractions for Visual Programs from Unstructured Primitivescited by 22
- 2025TikZero: Zero-Shot Text-Guided Graphics Program Synthesiscited by 21
- 2025DTGBrepGen: A Novel B-rep Generative Model through Decoupling Topology and Geometrycited by 20
- 2022CrossBeam: Learning to Search in Bottom-Up Program Synthesiscited by 18
- 2024Pix2Code: Learning to Compose Neural Visual Concepts as Programscited by 18
- 2023ExeDec: Execution Decomposition for Compositional Generalization in Neural Program Synthesiscited by 17
- 2023B-Coder: Value-Based Deep Reinforcement Learning for Program Synthesiscited by 16
- 2025AutoBrep: Autoregressive B-Rep Generation with Unified Topology and Geometrycited by 16
- 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learningcited by 14
- 2025BrepGPT: Autoregressive B-rep Generation with Voronoi Half-Patchcited by 12
- 2022Discovering Design Concepts for CAD Sketchescited by 10
- 2023Improving Unsupervised Visual Program Inference with Code Rewriting Familiescited by 10
- 2024Diffusion On Syntax Trees For Program Synthesiscited by 10
- 2025VLMaterial: Procedural Material Generation with Large Vision-Language Modelscited by 9
- 2021Learning to Combine Per-Example Solutions for Neural Program Synthesiscited by 8
- 2022From {Solution Synthesis} to {Student Attempt Synthesis} for Block-Based Visual Programming Taskscited by 8
- 2023Synthesis of Mathematical programs from Natural Language Specificationscited by 8
50 most cited of 92 All 92 (JSON)
- 2026Autoregressive B-Rep Shape Generation with Parametric Surfaces19 Jul 2026
- 2026HiDiGen: Hierarchical Diffusion for B-Rep Generation with Explicit Topological Constraints3 Apr 2026
- 2026CADReasoner: Iterative Program Editing for CAD Reverse Engineering18 Feb 2026
- 2026PLLM: Pseudo-Labeling Large Language Models for CAD Program Synthesis13 Feb 2026
- 2025AutoBrep: Autoregressive B-Rep Generation with Unified Topology and Geometry2 Dec 2025
- 2025BrepGPT: Autoregressive B-rep Generation with Voronoi Half-Patch27 Nov 2025
- 2025Natural Building Blocks for Structured World Models: Theory, Evidence, and Scaling3 Nov 2025
- 2025MultiMat: Multimodal Program Synthesis for Procedural Materials using Large Multimodal Models26 Sep 2025
- 2025Out-of-Distribution Generalization in the ARC-AGI Domain: Comparing Execution-Guided Neural Program Synthesis and Test-Time Fine-Tuning17 Jul 2025
- 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learning28 May 2025
- 2025Beyond Either-Or Reasoning: Transduction and Induction as Cooperative Problem-Solving Paradigms20 May 2025
- 2025HoLa: B-Rep Generation using a Holistic Latent Representation19 Apr 2025
38 more
- 2025DTGBrepGen: A Novel B-rep Generative Model through Decoupling Topology and Geometry17 Mar 2025
- 2025TikZero: Zero-Shot Text-Guided Graphics Program Synthesis14 Mar 2025
- 2025Neurosymbolic Decision Trees11 Mar 2025
- 2025Shedding Light in Task Decomposition in Program Synthesis: The Driving Force of the Synthesizer Model11 Mar 2025
- 2025Learning to Place Objects with Programs and Iterative Self Training6 Mar 2025
- 2025VLMaterial: Procedural Material Generation with Large Vision-Language Models27 Jan 2025
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLM7 Nov 2024
- 2024Learning to Synthesize Graphics Programs for Geometric Artworks21 Oct 2024
- 2024DeepIcon: A Hierarchical Network for Layer-wise Icon Vectorization21 Oct 2024
- 2024Action abstractions for amortized sampling19 Oct 2024
- 2024DiffCSG: Differentiable CSG via Rasterization2 Sep 2024
- 2024Procedural Synthesis of Synthesizable Molecules24 Aug 2024
- 2024Relational decomposition for program synthesis22 Aug 2024
- 2024Can Large Language Models Understand Symbolic Graphics Programs?15 Aug 2024
- 2024Is Programming by Example solved by LLMs?12 Jun 2024
- 2024When Do Skills Help Reinforcement Learning? A Theoretical Analysis of Temporal Abstractions12 Jun 2024
- 2024Learning to Edit Visual Programs with Self-Supervision4 Jun 2024
- 2024Diffusion On Syntax Trees For Program Synthesis30 May 2024
- 2024AbstractBeam: Enhancing Bottom-Up Program Synthesis using Library Learning27 May 2024
- 2024PS-CAD: Local Geometry Guidance via Prompting and Selection for CAD Reconstruction24 May 2024
- 2024Learning to Infer Generative Template Programs for Visual Concepts20 Mar 2024
- 2024Learn to Code Sustainably: An Empirical Study on LLM-based Green Code Generation5 Mar 2024
- 2024Pix2Code: Learning to Compose Neural Visual Concepts as Programs13 Feb 2024
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometry28 Jan 2024
- 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents1 Jan 2024
- 2023B-Coder: Value-Based Deep Reinforcement Learning for Program Synthesis4 Oct 2023
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Models2 Oct 2023
- 2023Improving Unsupervised Visual Program Inference with Code Rewriting Families26 Sep 2023
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep 2023
- 2023Hypothesis Search: Inductive Reasoning with Language Models11 Sep 2023
- 2023ExeDec: Execution Decomposition for Compositional Generalization in Neural Program Synthesis26 Jul 2023
- 2023Reinforcement Learning and Data-Generation for Syntax-Guided Synthesis13 Jul 2023
- 2023Hierarchical Neural Coding for Controllable CAD Model Generation30 Jun 2023
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback26 Jun 2023
- 2023LambdaBeam: Neural Program Search with Higher-Order Functions and Lambdas3 Jun 2023
- 2023Coarse-Tuning Models of Code with Reinforcement Learning Feedback25 May 2023
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Models25 May 2023
- 2023Neural Machine Translation for Code Generation22 May 2023
50 newest of 92 All 92 (JSON)
- 2023Hypothesis Search: Inductive Reasoning with Language Modelscited by 119
- 2022Reasoning Like Program Executorscited by 45
- 2022Learning Math Reasoning from Self-Sampled Correct and Partially-Correct Solutionscited by 38
- 2025Neurosymbolic Decision Treescited by 0
- 2025Neurosymbolic Decision Trees11 Mar 2025
- 2023Hypothesis Search: Inductive Reasoning with Language Models11 Sep 2023
- 2022Learning Math Reasoning from Self-Sampled Correct and Partially-Correct Solutions28 May 2022
- 2022Reasoning Like Program Executors27 Jan 2022
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
- 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agentscited by 77
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 101
- 2024Diffusion On Syntax Trees For Program Synthesiscited by 10
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2022CodeT: Code Generation with Generated Testscited by 369
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 229
- 2023Planning with Large Language Models for Code Generationcited by 179
- 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 121
- 2023Execution-based Code Generation using Deep Reinforcement Learningcited by 95
- 2023Hierarchical Neural Coding for Controllable CAD Model Generationcited by 84
- 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 78
- 2022Language Models Can Teach Themselves to Program Bettercited by 75
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 74
- 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Surveycited by 72
12 most cited of 79 All 79 (JSON)
- 2026Autoregressive B-Rep Shape Generation with Parametric Surfaces19 Jul 2026
- 2026HiDiGen: Hierarchical Diffusion for B-Rep Generation with Explicit Topological Constraints3 Apr 2026
- 2026CADReasoner: Iterative Program Editing for CAD Reverse Engineering18 Feb 2026
- 2026PLLM: Pseudo-Labeling Large Language Models for CAD Program Synthesis13 Feb 2026
- 2025AutoBrep: Autoregressive B-Rep Generation with Unified Topology and Geometry2 Dec 2025
- 2025BrepGPT: Autoregressive B-rep Generation with Voronoi Half-Patch27 Nov 2025
- 2025Out-of-Distribution Generalization in the ARC-AGI Domain: Comparing Execution-Guided Neural Program Synthesis and Test-Time Fine-Tuning17 Jul 2025
- 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learning28 May 2025
- 2025Beyond Either-Or Reasoning: Transduction and Induction as Cooperative Problem-Solving Paradigms20 May 2025
- 2025HoLa: B-Rep Generation using a Holistic Latent Representation19 Apr 2025
- 2025DTGBrepGen: A Novel B-rep Generative Model through Decoupling Topology and Geometry17 Mar 2025
- 2025TikZero: Zero-Shot Text-Guided Graphics Program Synthesis14 Mar 2025
12 newest of 79 All 79 (JSON)