mlsanityData to 14 Oct 2026

The Hidden DNA of LLM-Generated JavaScript: Structural Patterns Enable High-Accuracy Authorship Attribution

arXiv 2510.10493 ↗First posted 12 Oct 2025cs.CR cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

In this paper, we present the first large-scale study exploring whether JavaScript code generated by Large Language Models (LLMs) can reveal which model produced it, enabling reliable authorship attribution and model fingerprinting. With the rapid rise of AI-generated code, attribution is playing a critical role in detecting vulnerabilities, flagging malicious content, and ensuring accountability. While AI-vs-human detection usually treats AI as a single category we show that individual LLMs leave unique stylistic signatures, even among models belonging to the same family or parameter size. To this end, we introduce LLM-NodeJS, a dataset of 50,000 Node.js back-end programs from 20 large language models. Each has four transformed variants, yielding 250,000 unique JavaScript samples and two additional representations (JSIR and AST) for diverse research applications. Using this dataset, we benchmark traditional machine learning classifiers against fine-tuned Transformer encoders and introduce CodeT5-JSA, a custom architecture derived from the 770M-parameter CodeT5 model with its decoder removed and a modified classification head. It achieves 95.8% accuracy on five-class attribution, 94.6% on ten-class, and 88.5% on twenty-class tasks, surpassing other tested models such as BERT, CodeBERT, and Longformer. We demonstrate that classifiers capture deeper stylistic regularities in program dataflow and structure, rather than relying on surface-level features. As a result, attribution remains effective even after mangling, comment removal, and heavy code transformations. To support open science and reproducibility, we release the LLM-NodeJS dataset, Google Colab training scripts, and all related materials on GitHub: https://github.com/LLM-NodeJS-dataset.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 43 references that are in the map. First posted on arXiv 12 Oct 2025.

Builds on

15 of 43 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
  3. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
  4. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 609
  5. 2022The Stack: 3 TB of permissively licensed source codecited by 359
  6. 2024Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challengescited by 47
  7. 2019Misleading Authorship Attribution of Source Code using Adversarial Learningcited by 33
  8. 2024How secure is AI-generated Code: A Large-Scale Comparison of Large Language Modelscited by 24
  9. 2024Assessing AI Detectors in Identifying AI-Generated Code: Implications for Educationcited by 18
  10. 2024Whodunit: Classifying Code as Human Authored or GPT-4 Generated -- A case study on CodeChef problemscited by 13
  11. 2015When Coding Style Survives Compilation: De-anonymizing Programmers from Executable Binariescited by 11
  12. 2020Authorship Attribution of Source Code: A Language-Agnostic Approach and Applicability in Software Engineeringcited by 9
3 more
  1. 2025I Know Which LLM Wrote Your Code Last Summer: LLM generated Code Stylometry for Authorship Attributioncited by 9
  2. 2022BinMLM: Binary Authorship Verification with Flow-aware Mixture-of-Shared Language Modelcited by 6
  3. 2025I Can Find You in Seconds! Leveraging Large Language Models for Code Authorship Attributioncited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.