mlsanityData to 14 Oct 2026

Revisiting Code Similarity Evaluation with Abstract Syntax Tree Edit Distance

arXiv 2404.08817 ↗First posted 12 Apr 2024cs.CL cs.PL cs.SEcited by 26

Not on the map. Why?

Abstract (arXiv)

This paper revisits recent code similarity evaluation metrics, particularly focusing on the application of Abstract Syntax Tree (AST) editing distance in diverse programming languages. In particular, we explore the usefulness of these metrics and compare them to traditional sequence similarity metrics. Our experiments showcase the effectiveness of AST editing distance in capturing intricate code structures, revealing a high correlation with established metrics. Furthermore, we explore the strengths and weaknesses of AST editing distance and prompt-based GPT similarity scores in comparison to BLEU score, execution match, and Jaccard Similarity. We propose, optimize, and publish an adaptable metric that demonstrates effectiveness across all tested languages, representing an enhanced version of Tree Similarity of Edit Distance (TSED).

Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 9 of its 21 references that are in the map. First posted on arXiv 12 Apr 2024.

Builds on

9 of 21 references.

References · 9

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
  4. 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 238
  5. 2023Software Testing with Large Language Models: Survey, Landscape, and Visioncited by 166
  6. 2018Learning to Mine Aligned Code and Natural Language Pairs from Stack Overflowcited by 165
  7. 2022Multi-lingual Evaluation of Code Generation Modelscited by 159
  8. 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?cited by 76
  9. 2023Enhancing Text-to-SQL Translation for Financial System Designcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 13; 2026: 9.

26 papers.

Sort:

By area:

  1. 2024CraftRTL: High-quality Synthetic Data Generation for Verilog Code Models with Correct-by-Construction Non-Textual Representations and Targeted Code Repaircited by 42
  2. 2025cAST: Enhancing Code Retrieval-Augmented Generation with Structural Chunking via Abstract Syntax Treecited by 17
  3. 2025Sherlock: Reliable and Efficient Agentic Workflow Executioncited by 11
  4. 2024Sometimes I am a Tree: Data Drives Unstable Hierarchical Generalizationcited by 10
  5. 2025Detection of LLM-Paraphrased Code and Identification of the Responsible LLM Using Coding Style Featurescited by 4
  6. 2025Code Roulette: How Prompt Variability Affects LLM Code Generationcited by 4
  7. 2025Dynamic Stability of LLM-Generated Codecited by 4
  8. 2026Correctness isnt Efficiency: Runtime Memory Divergence in LLM-Generated Codecited by 4
  9. 2024CodeRefine: A Pipeline for Enhancing LLM-Generated Code Implementations of Research Paperscited by 3
  10. 2025LLM-Supported Natural Language to Bash Translationcited by 3
  11. 2025OpenClassGen: A Large-Scale Corpus of Real-World Python Classes for LLM Researchcited by 3
  12. 2026TIDE: Tuning-Integrated Dynamic Evolution for LLM-Based Automated Heuristic Designcited by 3
14 more
  1. 2025NES: An Instruction-Free, Low-Latency Next Edit Suggestion Framework Powered by Learned Historical Editing Trajectoriescited by 2
  2. 2025Measuring LLM Code Generation Stability via Structural Entropycited by 2
  3. 2025SLMFix: Leveraging Small Language Models for Domain Specific Language Error Fixing with Reinforcement Learningcited by 2
  4. 2025Beyond Query-Level Comparison: Fine-Grained Reinforcement Learning for Text-to-SQL with Automated Interpretable Critiquescited by 2
  5. 2024CAP: Data Contamination Detection via Consistency Amplificationcited by 1
  6. 2025How Small Transformation Expose the Weakness of Semantic Similarity Measurescited by 1
  7. 2026CSSG: Measuring Code Similarity with Semantic Graphscited by 1
  8. 2026MATA: Multi-Agent Framework for Reliable and Flexible Table Question Answeringcited by 1
  9. 2026Breaking Validity-Induced Boundaries to Expand Algorithm Search Space: A Two-Stage AST-Based Operator for LLM-Driven Automated Heuristic Evolutioncited by 1
  10. 2026Rethinking Automated Program Repair: The Impact of Bug Complexity, Fault Localization, and LLM Cost-efficiencycited by 1
  11. 2025Skeletons Matter: Dynamic Data Augmentation for Text-to-Querycited by 0
  12. 2026Structure-BiEval: A Self-Supervised, Dual-Track Framework for Decoupling Structure and Content in LLM Evaluation for Web Information Systemscited by 0
  13. 2026Can Code Evaluation Metrics Detect Code Plagiarism?cited by 0
  14. 2026Animation2Code: Evaluating Temporal Visual Reasoning in Video-to-Code Generationcited by 0