mlsanityData to 14 Oct 2026

PandasCorpus: A Resource of Real-World Pandas Workflows and Usage Patterns

arXiv 2608.14742 ↗First posted 13 Aug 2026cs.SE cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Pandas has emerged as the de facto library for data processing and machine learning, widely used for tasks, such as data loading, transformation, and analysis. Despite its ubiquity, there has been limited systematic investigation into how Pandas is used in real-world projects and how typical workflows are composed in practice. To address this gap, we introduce PandasCorpus, a dataset curated from GitHub repositories that captures real-world Pandas workflows at scale. In this work, a workflow refers to Pandas-based code contained in Jupyter notebooks, a prevalent medium for writing, executing, and sharing data analysis code. The dataset comprises 139k notebooks from approximately 100k repositories and captures more than 4M Pandas API calls spanning 136 distinct operations. Beyond dataset construction, we characterize workflows using structural and Pandas-specific features and analyze notebook evolution between 2015 and 2025. Our study examines code executability, notebook size, and recurring sequences of Pandas operations, providing empirical insights into how Pandas is used in practice. The resulting corpus offers a reusable resource for studying data analysis workflows, Pandas usage patterns, and library-aware code composition. Both the dataset and the extraction pipeline are publicly available via GitHub and Zenodo.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 26 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

5 of 26 references.

References · 5

  1. 2020Towards Scalable Dataframe Systemscited by 17
  2. 2019Better Code, Better Sharing:On the Need of Analyzing Jupyter Notebookscited by 13
  3. 2021KGTorrent: A Dataset of Python Jupyter Notebooks from Kagglecited by 10
  4. 2023Evaluation of Dataframe Libraries for Data Preparation on a Single Machinecited by 3
  5. 2023Xorbits: Automating Operator Tiling for Distributed Data Sciencecited by 2

Built on by

Not cited yet.