mlsanityData to 7 Oct 2026

FMI_SU_Yotkova_Kastreva at SemEval-2026 Task 13: Lightweight Detection of LLM-Generated Code via Stylometric Signals

arXiv 2605.04157 ↗First posted 5 May 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

SemEval-2026 Task 13 investigates machine-generated code detection across multiple programming languages and application scenarios, asking participating systems to generalize to unseen languages and domains. This paper describes our participation in Subtask A (binary classification) and explores both pretrained code encoders and lightweight feature-based methods. We design ratio-based features that are less sensitive to snippet length. To support the extraction of descriptiveness-related signals, we use parsing engines and a programming-language classifier. Additionally, we train a separate code-vs-text line classifier to identify raw natural language segments embedded within samples. We combine a shallow decision tree with heuristic rules derived from data analysis to produce the final predictions. Our approach is computationally efficient, requires only CPU resources for training, and achieves near-instant inference time, offering a lightweight alternative to large pretrained models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

10 of 21 references.

References · 10

  1. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  2. 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 417
  3. 2022Efficient Training of Language Models to Fill in the Middlecited by 248
  4. 2024TestGenEval: A Real World Unit Test Generation and Test Completion Benchmarkcited by 49
  5. 2024CoRNStack: High-Quality Contrastive Data for Better Code Retrieval and Rerankingcited by 37
  6. 2014A Comparative Study of Programming Languages in Rosetta Codecited by 19
  7. 2025CoDet-M4: Detecting Machine-Generated Code in Multi-Lingual, Multi-Generator and Multi-Domain Settingscited by 11
  8. 2025textttDroid: A Resource Suite for AI-Generated Code Detectioncited by 9
  9. 2025CodeVision: Detecting LLM-Generated Code Using 2D Token Probability Maps and Vision Modelscited by 3
  10. 2024Automatic Detection of LLM-Generated Code: A Comparative Case Study of Contemporary Models Across Function and Class Granularitiescited by 1

Built on by

Not cited yet.