Backdoors in Neural Models of Source Code
Not on the map. Why?
Abstract (arXiv)
Deep neural networks are vulnerable to a range of adversaries. A particularly pernicious class of vulnerabilities are backdoors, where model predictions diverge in the presence of subtle triggers in inputs. An attacker can implant a backdoor by poisoning the training data to yield a desired target prediction on triggered inputs. We study backdoors in the context of deep-learning for source code. (1) We define a range of backdoor classes for source-code tasks and show how to poison a dataset to install such backdoors. (2) We adapt and improve recent algorithms from robust statistics for our setting, showing that backdoors leave a spectral signature in the learned representation of source code, thus enabling detection of poisoned data. (3) We conduct a thorough evaluation on different architectures and languages, showing the ease of injecting backdoors and our ability to eliminate them.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 9; 2024: 9; 2025: 5; 2026: 2.
27 papers.
Sort:
By area:
- 2023Privacy in Large Language Models: Attacks, Defenses and Future Directionscited by 48
- 2021CoProtector: Protect Open-Source Code against Unauthorized Training Usage with Data Poisoningcited by 39
- 2023Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attackscited by 29
- 2024Compromising Embodied Agents with Contextual Backdoor Attackscited by 29
- 2023Large Language Models of Code Fail at Completing Code with Potential Bugscited by 28
- 2023CodeMark: Imperceptible Watermarking for Code Datasets against Neural Code Completion Modelscited by 28
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2023Multi-target Backdoor Attacks for Code Pre-trained Modelscited by 19
- 2022BagFlip: A Certified Defense against Data Poisoningcited by 18
- 2023Backdooring Neural Code Searchcited by 13
- 2025A Systematic Review of Poisoning Attacks Against Large Language Modelscited by 8
- 2023Efficient Backdoor Attacks for Deep Neural Networks in Real-world Scenarioscited by 7
15 more
- 2023A Proxy Attack-Free Strategy for Practically Improving the Poisoning Efficiency in Backdoor Attackscited by 5
- 2024Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Codecited by 5
- 2024Flatness-aware Sequential Learning Generates Resilient Backdoorscited by 3
- 2025Show Me Your Code! Kill Code Poisoning: A Lightweight Method Based on Code Naturalnesscited by 3
- 2024EaTVul: ChatGPT-based Evasion Attack Against Software Vulnerability Detectioncited by 2
- 2024Eliminating Backdoors in Neural Code Models for Secure Code Understandingcited by 2
- 2024Trojans in Large Language Models of Code: A Critical Review through a Trigger-Based Taxonomycited by 1
- 2025Beyond Natural Language Perplexity: Detecting Dead Code Poisoning in Code Generation Datasetscited by 1
- 2024On Trojan Signatures in Large Language Models of Codecited by 0
- 2024A Disguised Wolf Is More Harmful Than a Toothless Tiger: Adaptive Malicious Code Injection Backdoor Attack Leveraging User Behavior as Triggerscited by 0
- 2024CodePurify: Defend Backdoor Attacks on Neural Code Models via Entropy-based Purificationcited by 0
- 2025Localizing Malicious Outputs from CodeLLMcited by 0
- 2025Signature in Code Backdoor Detection, how far are we?cited by 0
- 2026ALIBI: Adaptive Agentic Attacks on LLM-Based Vulnerability Detectors via Adversarial Code Commentscited by 0
- 2026Adversarial Testing of Automated Program Repair Agents for Security Vulnerabilitiescited by 0
- 2026Adversarial Testing of Automated Program Repair Agents for Security Vulnerabilities14 Sep 2026
- 2026ALIBI: Adaptive Agentic Attacks on LLM-Based Vulnerability Detectors via Adversarial Code Comments27 Jul 2026
- 2025Signature in Code Backdoor Detection, how far are we?15 Oct 2025
- 2025Localizing Malicious Outputs from CodeLLM21 Sep 2025
- 2025A Systematic Review of Poisoning Attacks Against Large Language Models6 Jun 2025
- 2025Beyond Natural Language Perplexity: Detecting Dead Code Poisoning in Code Generation Datasets27 Feb 2025
- 2025Show Me Your Code! Kill Code Poisoning: A Lightweight Method Based on Code Naturalness20 Feb 2025
- 2024CodePurify: Defend Backdoor Attacks on Neural Code Models via Entropy-based Purification26 Oct 2024
- 2024A Disguised Wolf Is More Harmful Than a Toothless Tiger: Adaptive Malicious Code Injection Backdoor Attack Leveraging User Behavior as Triggers19 Aug 2024
- 2024Eliminating Backdoors in Neural Code Models for Secure Code Understanding8 Aug 2024
- 2024Compromising Embodied Agents with Contextual Backdoor Attacks6 Aug 2024
- 2024EaTVul: ChatGPT-based Evasion Attack Against Software Vulnerability Detection27 Jul 2024
15 more
- 2024Flatness-aware Sequential Learning Generates Resilient Backdoors20 Jul 2024
- 2024Trojans in Large Language Models of Code: A Critical Review through a Trigger-Based Taxonomy5 May 2024
- 2024Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Code11 Mar 2024
- 2024On Trojan Signatures in Large Language Models of Code23 Feb 2024
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit30 Dec 2023
- 2023Privacy in Large Language Models: Attacks, Defenses and Future Directions16 Oct 2023
- 2023CodeMark: Imperceptible Watermarking for Code Datasets against Neural Code Completion Models28 Aug 2023
- 2023Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attacks4 Aug 2023
- 2023Efficient Backdoor Attacks for Deep Neural Networks in Real-world Scenarios14 Jun 2023
- 2023Multi-target Backdoor Attacks for Code Pre-trained Models14 Jun 2023
- 2023A Proxy Attack-Free Strategy for Practically Improving the Poisoning Efficiency in Backdoor Attacks14 Jun 2023
- 2023Large Language Models of Code Fail at Completing Code with Potential Bugs6 Jun 2023
- 2023Backdooring Neural Code Search27 May 2023
- 2022BagFlip: A Certified Defense against Data Poisoning26 May 2022
- 2021CoProtector: Protect Open-Source Code against Unauthorized Training Usage with Data Poisoning25 Oct 2021
- 2021CoProtector: Protect Open-Source Code against Unauthorized Training Usage with Data Poisoningcited by 39
- 2023Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attackscited by 29
- 2023CodeMark: Imperceptible Watermarking for Code Datasets against Neural Code Completion Modelscited by 28
- 2023Multi-target Backdoor Attacks for Code Pre-trained Modelscited by 19
- 2022BagFlip: A Certified Defense against Data Poisoningcited by 18
- 2023Backdooring Neural Code Searchcited by 13
- 2024Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Codecited by 5
- 2024Flatness-aware Sequential Learning Generates Resilient Backdoorscited by 3
- 2025Show Me Your Code! Kill Code Poisoning: A Lightweight Method Based on Code Naturalnesscited by 3
- 2024Eliminating Backdoors in Neural Code Models for Secure Code Understandingcited by 2
- 2024A Disguised Wolf Is More Harmful Than a Toothless Tiger: Adaptive Malicious Code Injection Backdoor Attack Leveraging User Behavior as Triggerscited by 0
- 2024CodePurify: Defend Backdoor Attacks on Neural Code Models via Entropy-based Purificationcited by 0
12 most cited of 14 All 14 (JSON)
- 2025Signature in Code Backdoor Detection, how far are we?15 Oct 2025
- 2025Localizing Malicious Outputs from CodeLLM21 Sep 2025
- 2025Show Me Your Code! Kill Code Poisoning: A Lightweight Method Based on Code Naturalness20 Feb 2025
- 2024CodePurify: Defend Backdoor Attacks on Neural Code Models via Entropy-based Purification26 Oct 2024
- 2024A Disguised Wolf Is More Harmful Than a Toothless Tiger: Adaptive Malicious Code Injection Backdoor Attack Leveraging User Behavior as Triggers19 Aug 2024
- 2024Eliminating Backdoors in Neural Code Models for Secure Code Understanding8 Aug 2024
- 2024Flatness-aware Sequential Learning Generates Resilient Backdoors20 Jul 2024
- 2024Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Code11 Mar 2024
- 2023CodeMark: Imperceptible Watermarking for Code Datasets against Neural Code Completion Models28 Aug 2023
- 2023Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attacks4 Aug 2023
- 2023Multi-target Backdoor Attacks for Code Pre-trained Models14 Jun 2023
- 2023Backdooring Neural Code Search27 May 2023
12 newest of 14 All 14 (JSON)
- 2023Privacy in Large Language Models: Attacks, Defenses and Future Directionscited by 48
- 2023Large Language Models of Code Fail at Completing Code with Potential Bugscited by 28
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2025A Systematic Review of Poisoning Attacks Against Large Language Modelscited by 8
- 2023Efficient Backdoor Attacks for Deep Neural Networks in Real-world Scenarioscited by 7
- 2023A Proxy Attack-Free Strategy for Practically Improving the Poisoning Efficiency in Backdoor Attackscited by 5
- 2024EaTVul: ChatGPT-based Evasion Attack Against Software Vulnerability Detectioncited by 2
- 2024Trojans in Large Language Models of Code: A Critical Review through a Trigger-Based Taxonomycited by 1
- 2025Beyond Natural Language Perplexity: Detecting Dead Code Poisoning in Code Generation Datasetscited by 1
- 2024On Trojan Signatures in Large Language Models of Codecited by 0
- 2025A Systematic Review of Poisoning Attacks Against Large Language Models6 Jun 2025
- 2025Beyond Natural Language Perplexity: Detecting Dead Code Poisoning in Code Generation Datasets27 Feb 2025
- 2024EaTVul: ChatGPT-based Evasion Attack Against Software Vulnerability Detection27 Jul 2024
- 2024Trojans in Large Language Models of Code: A Critical Review through a Trigger-Based Taxonomy5 May 2024
- 2024On Trojan Signatures in Large Language Models of Code23 Feb 2024
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit30 Dec 2023
- 2023Privacy in Large Language Models: Attacks, Defenses and Future Directions16 Oct 2023
- 2023Efficient Backdoor Attacks for Deep Neural Networks in Real-world Scenarios14 Jun 2023
- 2023A Proxy Attack-Free Strategy for Practically Improving the Poisoning Efficiency in Backdoor Attacks14 Jun 2023
- 2023Large Language Models of Code Fail at Completing Code with Potential Bugs6 Jun 2023