mlsanityData to 7 Oct 2026

CodeSCAN: ScreenCast ANalysis for Video Programming Tutorials

arXiv 2409.18556 ↗First posted 27 Sep 2024cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Programming tutorials in the form of coding screencasts play a crucial role in programming education, serving both novices and experienced developers. However, the video format of these tutorials presents a challenge due to the difficulty of searching for and within videos. Addressing the absence of large-scale and diverse datasets for screencast analysis, we introduce the CodeSCAN dataset. It comprises 12,000 screenshots captured from the Visual Studio Code environment during development, featuring 24 programming languages, 25 fonts, and over 90 distinct themes, in addition to diverse layout changes and realistic user interactions. Moreover, we conduct detailed quantitative and qualitative evaluations to benchmark the performance of Integrated Development Environment (IDE) element detection, color-to-black-and-white conversion, and Optical Character Recognition (OCR). We hope that our contributions facilitate more research in coding screencast analysis, and we make the source code for creating the dataset and the benchmark publicly available on this website.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 35 references that are in the map. First posted on arXiv 27 Sep 2024.

Builds on

15 of 35 references.

References · 15

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2017Mask R-CNNcited by 7,259
  4. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  7. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  8. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
  9. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
  10. 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 254
  11. 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
  12. 2018Show, Attend and Read: A Simple and Strong Baseline for Irregular Text Recognitioncited by 130
3 more
  1. 2014Reading Text in the Wild with Convolutional Neural Networkscited by 122
  2. 2019MASTER: Multi-Aspect Non-local Network for Scene Text Recognitioncited by 65
  3. 2022Efficient Search of Live-Coding Screencasts from Online Videoscited by 1

Built on by

Not cited yet.