mlsanityData to 14 Oct 2026

Knowledge-Graph-Driven Data Synthesis for Low-Resource Software Development: A HarmonyOS Case Study

arXiv 2512.00380 ↗First posted 29 Nov 2025cs.SEcited by 1

On the map: Synthetic data and self-improvement for LLMs → Code and instruction data synthesis

Abstract (arXiv)

In low-resource framework development (e.g., HarmonyOS), large language models (LLMs) often lack sufficient pre-training exposure, resulting in poor code generation performance. Although they generally preserve programming logic across languages, they frequently fail on framework-specific APIs and syntax, revealing a gap between learned algorithmic knowledge and unfamiliar framework conventions. Consequently, even advanced models such as GPT-4o struggle to produce correct code without prior exposure. Inspired by these challenges, we propose APIKG4Syn, a framework that leverages API knowledge graphs to synthesize API-oriented question-code pairs without requiring executable environments. It incorporates both single-API and multi-API information, with the latter guided by uncertainty estimation (UE) and Monte Carlo Tree Search (MCTS), to construct high-quality fine-tuning data. For evaluation, we select HarmonyOS as a case study due to its accessible documentation and growing ecosystem, and build the first benchmark for its code generation. Experimental results show that fine-tuning Qwen2.5-Coder-7B with APIKG4Syn achieves a pass@1 of 25.00%, outperforming untuned GPT-4o (17.59%). We further observe that larger volumes of data generated by APIKG4Syn consistently lead to better fine-tuning performance, and that the optimal Single-API to Multi-API ratio is 8:2. Ablation studies also confirm the necessity and effectiveness of each component in our framework. These findings highlight the effectiveness of API-oriented data in enhancing LLM performance for low-resource software development scenarios.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Code and instruction data synthesis, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 30 of its 57 references that are in the map. First posted on arXiv 29 Nov 2025.

Builds on

30 of 57 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Case2Code: Scalable Synthetic Data for Code Generation17 Jul

Other references · 29

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  4. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
  5. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 421
  6. 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 256
  7. 2020DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learningcited by 161
  8. 2023Self-planning Code Generation with Large Language Modelscited by 124
  9. 2023LongCoder: A Long-Range Pre-trained Language Model for Code Completioncited by 112
  10. 2023Large Language Models for Test-Free Fault Localizationcited by 67
  11. 2022When Language Model Meets Private Librarycited by 54
  12. 2023SkCoder: A Sketch-based Approach for Automatic Code Generationcited by 40
17 more
  1. 2023AceCoder: Utilizing Existing Code to Enhance Code Generationcited by 25
  2. 2024Genetic Instruct: Scaling up Synthetic Generation of Coding Instructions for Large Language Modelscited by 19
  3. 2023Fixing Large Language Models' Specification Misunderstanding for Better Code Generationcited by 17
  4. 2024ROCODE: Integrating Backtracking Mechanism and Program Analysis in Large Language Models for Code Generationcited by 13
  5. 2024Can Large Language Models Serve as Evaluators for Code Summarization?cited by 12
  6. 2024ExploraCoder: Advancing code generation for multiple unseen APIs via planning and chained explorationcited by 11
  7. 2025Enhancing Code Generation for Low-Resource Languages: No Silver Bulletcited by 10
  8. 2025LoRA-MGPO: Mitigating Double Descent in Low-Rank Adaptation via Momentum-Guided Perturbation Optimizationcited by 10
  9. 2025UnitCoder: Scalable Iterative Code Synthesis with Unit Test Guidancecited by 7
  10. 2023Bridging Code Semantic and LLMs: Semantic Chain-of-Thought Prompting for Code Generationcited by 6
  11. 2025ASTRA: Autonomous Spatial-Temporal Red-teaming for AI Software Assistantscited by 6
  12. 2024ADC: Enhancing Function Calling Via Adversarial Datasets and Code Line-Level Feedbackcited by 5
  13. 2025Improved IR-based Bug Localization with Intelligent Relevance Feedbackcited by 5
  14. 2025Enhancing Code Generation via Bidirectional Comment-Level Mutual Groundingcited by 3
  15. 2025ArkAnalyzer: The Static Analysis Framework for OpenHarmonycited by 2
  16. 2025SynthCoder: A Synthetical Strategy to Tune LLMs for Code Completioncited by 2
  17. 2025Towards LLM-generated explanations for Component-based Knowledge Graph Question Answering Systemscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025CodeChemist: Test-Time Scaling for Low-Resource Code Generation via Functional Knowledge Transfer
  2. 2026Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition
  3. 2026Towards Knowledge Alignment in Code LLMs: Contrastive Unlearning for Evolving APIs
  4. 2025Infinite-Instruct: Synthesizing Scaling Code instruction Data with Bidirectional Synthesis and Static Verification
  5. 2026Are you Synthesizing or Recalling? Evaluating LLMs on Algorithmic Code Retrieval
  6. 2026When LLMs Lag Behind: Knowledge Conflicts from Evolving APIs in Code Generation
  7. 2026Code-on-Graph: Iterative Programmatic Reasoning via Large Language Models on Knowledge Graphs
  8. 2026KOCO-BENCH: Can Large Language Models Leverage Domain Knowledge in Software Development?