mlsanityData to 13 Oct 2026

Position: Intelligent Coding Systems Should Write Programs with Justifications

arXiv 2508.06017 ↗First posted 8 Aug 2025cs.SE cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Intelligent coding systems are transforming software development by enabling users to specify code behavior in natural language. However, the opaque decision-making of AI-driven coders raises trust and usability concerns, particularly for non-expert users who cannot inspect low-level implementations. We argue that these systems should not only generate code but also produce clear, consistent justifications that bridge model reasoning and user understanding. To this end, we identify two critical justification properties-cognitive alignment and semantic faithfulness-and highlight the limitations of existing methods, including formal verification, static analysis, and post-hoc explainability. We advocate exploring neuro-symbolic approaches for justification generation, where symbolic constraints guide model behavior during training and program semantics are enriched through neural representations, enabling automated consistency checks at inference time.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 34 of its 72 references that are in the map. First posted on arXiv 8 Aug 2025.

Builds on

34 of 72 references.

References · 34

  1. 2023GPT-4 Technical Reportcited by 18,278
  2. 2022Training language models to follow instructions with human feedbackcited by 15,856
  3. 2023Code Llama: Open Foundation Models for Codecited by 2,130
  4. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 977
  5. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 414
  6. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 363
  7. 2023Explainability for Large Language Models: A Surveycited by 333
  8. 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 251
  9. 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 169
  10. 2024ProSA: Assessing and Understanding the Prompt Sensitivity of LLMscited by 147
  11. 2023An Empirical Study of the Non-determinism of ChatGPT in Code Generationcited by 136
  12. 2024The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinismcited by 115
22 more
  1. 2024What Did I Do Wrong? Quantifying LLMs' Sensitivity and Consistency to Prompt Engineeringcited by 88
  2. 2024Lingma SWE-GPT: An Open Development-Process-Centric Language Model for Automated Software Improvementcited by 59
  3. 2020QED: A Framework and Dataset for Explanations in Question Answeringcited by 55
  4. 2025RepoAudit: An Autonomous LLM-Agent for Repository-Level Code Auditingcited by 47
  5. 2023A Perspective on Explainable Artificial Intelligence Methods: SHAP and LIMEcited by 42
  6. 2019Do Explanations Reflect Decisions? A Machine-centric Strategy to Quantify the Performance of Explainability Algorithmscited by 32
  7. 2025What Prompts Don't Say: Understanding and Managing Underspecification in LLM Promptscited by 32
  8. 2024ProSec: Fortifying Code LLMs with Proactive Security Alignmentcited by 24
  9. 2023Rationalization for Explainable NLP: A Surveycited by 22
  10. 2022Passport: Improving Automated Formal Verification Using Identifierscited by 19
  11. 2024Learning Code Preference via Synthetic Evolutioncited by 19
  12. 2024SecCoder: Towards Generalizable and Robust Secure Code Generationcited by 14
  13. 2024CoqPilot, a plugin for LLM-based generation of proofscited by 11
  14. 2019Interpretable Question Answering on Knowledge Bases and Textcited by 8
  15. 2024SAFE-RL: Saliency-Aware Counterfactual Explainer for Deep Reinforcement Learning Policiescited by 8
  16. 2025Validating Network Protocol Parsers with Traceable RFC Document Interpretationcited by 7
  17. 2016Skeletal Program Enumeration for Rigorous Compiler Testingcited by 6
  18. 20243DGen: AI-Assisted Generation of Provably Correct Binary Format Parserscited by 6
  19. 2025xai_evals : A Framework for Evaluating Post-Hoc Local Explanation Methodscited by 3
  20. 2025Beyond External Monitors: Enhancing Transparency of Large Language Models for Easier Monitoringcited by 2
  21. 2018Narcissus: Deriving Correct-By-Construction Decoders and Encoders from Binary Formatscited by 1
  22. 2022Tai-e: A Static Analysis Framework for Java by Harnessing the Best Designs of Classicscited by 1

Built on by

Not cited yet.