KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learning
Not on the map. Why?
Abstract (arXiv)
While hyper-parameters (HPs) are important for knowledge graph (KG) learning, existing methods fail to search them efficiently. To solve this problem, we first analyze the properties of different HPs and measure the transfer ability from small subgraph to the full graph. Based on the analysis, we propose an efficient two-stage search algorithm KGTuner, which efficiently explores HP configurations on small subgraph at the first stage and transfers the top-performed configurations for fine-tuning on the large full graph at the second stage. Experiments show that our method can consistently find better HPs than the baseline algorithms within the same time budget, which achieves 9.1% average relative improvement for four embedding models on the large-scale KGs in open graph benchmark.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 29 of its 62 references that are in the map. First posted on arXiv 5 May 2022.
Builds on
29 of 62 references.
References · 29
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2017Visualizing the Loss Landscape of Neural Netscited by 1,126
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 395
- 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
- 2019Inductive Relation Prediction by Subgraph Reasoningcited by 237
17 more
- 2018SimplE Embedding for Link Prediction in Knowledge Graphscited by 195
- 2020Design Space for Graph Neural Networkscited by 182
- 2018Canonical Tensor Decomposition for Knowledge Base Completioncited by 150
- 2018Tunability: Importance of Hyperparameters of Machine Learning Algorithmscited by 98
- 2021Knowledge Graph Reasoning with Relational Digraphcited by 91
- 2020Knowledge Graph Embedding for Link Prediction: A Comparative Analysiscited by 85
- 2019Learning to Exploit Long-term Relational Dependencies in Knowledge Graphscited by 83
- 2017Knowledge Graph Completion via Complex Tensor Factorizationcited by 80
- 2019A Re-evaluation of Knowledge Graph Completion Methodscited by 73
- 2020Bringing Light Into the Dark: A Large-scale Evaluation of Knowledge Graph Embedding Models Under a Unified Frameworkcited by 70
- 2017KBGAN: Adversarial Learning for Knowledge Graph Embeddingscited by 62
- 2014Question Answering with Subgraph Embeddingscited by 56
- 2019AutoSF: Searching Scoring Functions for Knowledge Graph Embeddingcited by 34
- 2015Hyperparameter Search in Machine Learningcited by 33
- 2020Duality-Induced Regularizer for Tensor Factorization Based Knowledge Graph Completioncited by 28
- 2021BORE: Bayesian Optimization by Density-Ratio Estimationcited by 26
- 2017On Multi-Relational Link Prediction with Bilinear Modelscited by 17
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 1; 2025: 1.
7 papers.
- 2023Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sourcescited by 31
- 2025GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environmentscited by 18
- 2022Comprehensive Analysis of Negative Sampling in Knowledge Graph Representation Learningcited by 12
- 2023Neural Atoms: Propagating Long-range Interaction in Molecular Graphs through Efficient Communication Channelcited by 10
- 2023Efficient and Joint Hyperparameter and Architecture Search for Collaborative Filteringcited by 3
- 2022Start Small, Think Big: On Hyperparameter Optimization for Large-Scale Knowledge Graph Embeddingscited by 1
- 2024Towards Versatile Graph Learning Approach: from the Perspective of Large Language Modelscited by 1
- 2025GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environments1 Apr 2025
- 2024Towards Versatile Graph Learning Approach: from the Perspective of Large Language Models18 Feb 2024
- 2023Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sources6 Nov 2023
- 2023Neural Atoms: Propagating Long-range Interaction in Molecular Graphs through Efficient Communication Channel2 Nov 2023
- 2023Efficient and Joint Hyperparameter and Architecture Search for Collaborative Filtering12 Jul 2023
- 2022Start Small, Think Big: On Hyperparameter Optimization for Large-Scale Knowledge Graph Embeddings11 Jul 2022
- 2022Comprehensive Analysis of Negative Sampling in Knowledge Graph Representation Learning21 Jun 2022