Plot2API: Recommending Graphic API from Plot via Semantic Parsing Guided Neural Network
Not on the map. Why?
Abstract (arXiv)
Plot-based Graphic API recommendation (Plot2API) is an unstudied but meaningful issue, which has several important applications in the context of software engineering and data visualization, such as the plotting guidance of the beginner, graphic API correlation analysis, and code conversion for plotting. Plot2API is a very challenging task, since each plot is often associated with multiple APIs and the appearances of the graphics drawn by the same API can be extremely varied due to the different settings of the parameters. Additionally, the samples of different APIs also suffer from extremely imbalanced. Considering the lack of technologies in Plot2API, we present a novel deep multi-task learning approach named Semantic Parsing Guided Neural Network (SPGNN) which translates the Plot2API issue as a multi-label image classification and an image semantic parsing tasks for the solution. In SPGNN, the recently advanced Convolutional Neural Network (CNN) named EfficientNet is employed as the backbone network for API recommendation. Meanwhile, a semantic parsing module is complemented to exploit the semantic relevant visual information in feature learning and eliminate the appearance-relevant visual information which may confuse the visual-information-based API recommendation. Moreover, the recent data augmentation technique named random erasing is also applied for alleviating the imbalance of API categories. We collect plots with the graphic APIs used to drawn them from Stack Overflow, and release three new Plot2API datasets corresponding to the graphic APIs of R and Python programming languages for evaluating the effectiveness of Plot2API techniques. Extensive experimental results not only demonstrate the superiority of our method over the recent deep learning baselines but also show the practicability of our method in the recommendation of graphic APIs.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 2 Apr 2021.
Builds on
29 of 46 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2014Going Deeper with Convolutionscited by 4,231
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2017Random Erasing Data Augmentationcited by 1,235
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
- 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
- 2016Cross-stitch Networks for Multi-task Learningcited by 466
17 more
- 2019Multi-Task Deep Neural Networks for Natural Language Understandingcited by 349
- 2019Multi-Label Image Recognition with Graph Convolutional Networkscited by 320
- 201912-in-1: Multi-Task Vision and Language Representation Learningcited by 278
- 2016CNN-RNN: A Unified Framework for Multi-label Image Classificationcited by 189
- 2017Learning Spatial Regularization with Image-level Supervisions for Multi-label Image Classificationcited by 85
- 2018A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Taskscited by 54
- 2019Many Task Learning with Task Routingcited by 50
- 2019Stochastic Filter Groups for Multi-Task CNNs: Learning Specialist and Generalist Convolution Kernelscited by 42
- 2016Deep API Learningcited by 41
- 2018Joint Learning for Pulmonary Nodule Segmentation, Attributes and Malignancy Predictioncited by 16
- 2017Risk Stratification of Lung Nodules Using 3D CNN-Based Multi-task Learningcited by 14
- 2015Learning Structured Inference Neural Networks with Label Relationscited by 13
- 2018RACK: Automatic API Recommendation using Crowdsourced Knowledgecited by 12
- 2015SWIM: Synthesizing What I Meancited by 10
- 2019Multi-Task Driven Feature Models for Thermal Infrared Trackingcited by 10
- 2018Semi-supervised multi-task learning for lung cancer diagnosiscited by 6
- 2017NLP2Code: Code Snippet Content Assist via Natural Language Taskscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.