mlsanityData to 7 Oct 2026

NAPS: Natural Program Synthesis Dataset

arXiv 1807.03168 ↗First posted 6 Jul 2018cs.LG cs.AI cs.PLcited by 14

Not on the map. Why?

Abstract (arXiv)

We present a program synthesis-oriented dataset consisting of human written problem statements and solutions for these problems. The problem statements were collected via crowdsourcing and the program solutions were extracted from human-written solutions in programming competitions, accompanied by input/output examples. We propose using this dataset for the program synthesis tasks aimed for working with real user-generated data. As a baseline we present few models, with the best model achieving 8.8% accuracy, showcasing both the complexity of the dataset and large room for future research.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jul 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 4; 2022: 4; 2023: 1; 2024: 3; 2025: 2.

14 papers.

Sort:

By area:

  1. 2021Program Synthesis with Large Language Modelscited by 3,509
  2. 2021Measuring Coding Challenge Competence With APPScited by 879
  3. 2022Language Models Can Teach Themselves to Program Bettercited by 75
  4. 2022Execution-based Evaluation for Data Science Code Generation Modelscited by 31
  5. 2023Fully Autonomous Programming with Large Language Modelscited by 31
  6. 2021Programming Puzzlescited by 25
  7. 2024Efficacy of Various Large Language Models in Generating Smart Contractscited by 4
  8. 2021On Adversarial Robustness of Synthetic Code Generationcited by 3
  9. 2022A Survey on Artificial Intelligence for Source Code: A Dialogue Systems Perspectivecited by 3
  10. 2024RoCode: A Dataset for Measuring Code Intelligence from Problem Definitions in Romaniancited by 3
  11. 2025Benchmarking AI Models in Software Engineering: A Review, Search Tool, and Unified Approach for Elevating Benchmark Qualitycited by 3
  12. 2025Fully Autonomous Programming using Iterative Multi-Agent Debugging with Large Language Modelscited by 3
2 more
  1. 2022JEMMA: An Extensible Java Dataset for ML4Code Applicationscited by 2
  2. 2024Generating Unseen Code Tests In Infinitumcited by 0