A Unified Active Learning Framework for Annotating Graph Data with Application to Software Source Code Performance Prediction
Not on the map. Why?
Abstract (arXiv)
Most machine learning and data analytics applications, including performance engineering in software systems, require a large number of annotations and labelled data, which might not be available in advance. Acquiring annotations often requires significant time, effort, and computational resources, making it challenging. We develop a unified active learning framework specializing in software performance prediction to address this task. We begin by parsing the source code to an Abstract Syntax Tree (AST) and augmenting it with data and control flow edges. Then, we convert the tree representation of the source code to a Flow Augmented-AST graph (FA-AST) representation. Based on the graph representation, we construct various graph embeddings (unsupervised and supervised) into a latent space. Given such an embedding, the framework becomes task agnostic since active learning can be performed using any regression method and query strategy suited for regression. Within this framework, we investigate the impact of using different levels of information for active and passive learning, e.g., partially available labels and unlabeled test data. Our approach aims to improve the investment in AI models for different software performance predictions (execution time) based on the structure of the source code. Our real-world experiments reveal that respectable performance can be achieved by querying labels for only a small subset of all the data.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 33 of its 68 references that are in the map. First posted on arXiv 6 Apr 2023.
Builds on
33 of 68 references.
References · 33
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2017graph2vec: Learning Distributed Representations of Graphscited by 228
- 2020Machine Learning on Graphs: A Model and Comprehensive Taxonomycited by 156
- 2017Deep Active Learning for Named Entity Recognitioncited by 108
- 2017Learning Active Learning from Datacited by 100
21 more
- 2021RETRIEVE: Coreset Selection for Efficient and Robust Semi-Supervised Learningcited by 72
- 2020Reinforced active learning for image segmentationcited by 56
- 2017Active Learning for Graph Embeddingcited by 53
- 2020Towards Robust and Reproducible Active Learning Using Neural Networkscited by 53
- 2020Active Feature Acquisition with Generative Surrogate Modelscited by 53
- 2020Graph Policy Network for Transferable Active Learning on Graphscited by 49
- 2019Active Learning for Graph Neural Networks via Node Feature Propagationcited by 37
- 2020Active Learning for Sound Event Detectioncited by 14
- 2019ActiveHNE: Active Heterogeneous Network Embeddingcited by 11
- 2017A Variance Maximization Criterion for Active Learningcited by 9
- 2020Learning to map source code to software vulnerability using code-as-a-graphcited by 9
- 2018Active Learning with Logged Datacited by 7
- 2021Active Learning of Driving Scenario Trajectoriescited by 7
- 2021An Efficient Procedure for Mining Egocentric Temporal Motifscited by 7
- 2020Model-Centric and Data-Centric Aspects of Active Learning for Deep Neural Networkscited by 5
- 2022Generating Synthetic Mobility Networks with Generative Adversarial Networkscited by 5
- 2022TEP-GNN: Accurate Execution Time Prediction of Functional Tests using Graph Neural Networkscited by 5
- 2019Regional based query in graph active learningcited by 3
- 2022Emotion Analysis using Multi-Layered Networks for Graphical Representation of Tweetscited by 3
- 2022SMARTQUERY: An Active Learning Framework for Graph Neural Networks through Hybrid Uncertainty Reductioncited by 3
- 2022Passive and Active Learning of Driver Behavior from Electric Vehiclescited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 2.
4 papers.
- 2024Deep Configuration Performance Learning: A Systematic Survey and Taxonomycited by 8
- 2023PACE: A Program Analysis Framework for Continuous Performance Predictioncited by 3
- 2023Reducing Computational Costs in Sentiment Analysis: Tensorized Recurrent Networks vs. Recurrent Networkscited by 0
- 2024Analysing the Behaviour of Tree-Based Neural Networks in Regression Taskscited by 0
- 2024Analysing the Behaviour of Tree-Based Neural Networks in Regression Tasks17 Jun 2024
- 2024Deep Configuration Performance Learning: A Systematic Survey and Taxonomy5 Mar 2024
- 2023PACE: A Program Analysis Framework for Continuous Performance Prediction1 Dec 2023
- 2023Reducing Computational Costs in Sentiment Analysis: Tensorized Recurrent Networks vs. Recurrent Networks16 Jun 2023