FMI_SU_Yotkova_Kastreva at SemEval-2026 Task 13: Lightweight Detection of LLM-Generated Code via Stylometric Signals
Not on the map. Why?
Abstract (arXiv)
SemEval-2026 Task 13 investigates machine-generated code detection across multiple programming languages and application scenarios, asking participating systems to generalize to unseen languages and domains. This paper describes our participation in Subtask A (binary classification) and explores both pretrained code encoders and lightweight feature-based methods. We design ratio-based features that are less sensitive to snippet length. To support the extraction of descriptiveness-related signals, we use parsing engines and a programming-language classifier. Additionally, we train a separate code-vs-text line classifier to identify raw natural language segments embedded within samples. We combine a shallow decision tree with heuristic rules derived from data analysis to produce the final predictions. Our approach is computationally efficient, requires only CPU resources for training, and achieves near-instant inference time, offering a lightweight alternative to large pretrained models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
10 of 21 references.
References · 10
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
- 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 417
- 2022Efficient Training of Language Models to Fill in the Middlecited by 248
- 2024TestGenEval: A Real World Unit Test Generation and Test Completion Benchmarkcited by 49
- 2024CoRNStack: High-Quality Contrastive Data for Better Code Retrieval and Rerankingcited by 37
- 2014A Comparative Study of Programming Languages in Rosetta Codecited by 19
- 2025CoDet-M4: Detecting Machine-Generated Code in Multi-Lingual, Multi-Generator and Multi-Domain Settingscited by 11
- 2025textttDroid: A Resource Suite for AI-Generated Code Detectioncited by 9
- 2025CodeVision: Detecting LLM-Generated Code Using 2D Token Probability Maps and Vision Modelscited by 3
- 2024Automatic Detection of LLM-Generated Code: A Comparative Case Study of Contemporary Models Across Function and Class Granularitiescited by 1
Built on by
Not cited yet.