Position: Vibe Coding Needs Vibe Reasoning: Improving Vibe Coding with Formal Verification
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
``Vibe coding'' -- the practice of developing software through iteratively conversing with a large language model (LLM) -- has exploded in popularity within the last year. However, developers report key limitations including the accumulation of technical debt, security issues, and code churn to achieve satisfactory results. We argue that these pitfalls result from LLMs' inability to reconcile accumulating human-imposed constraints during vibe coding, with developers inadvertently failing to resolve contradictions because LLMs prioritize user commands over code consistency. Given LLMs' receptiveness to verification-based feedback, we argue that formal methods can mitigate these pitfalls, making vibe coding more reliable. However, we posit that integrating formal methods must transcend existing approaches that combine formal methods and LLMs. We advocate for a side-car system throughout the vibe coding process which: (1) Autoformalizes specifications (2) Validates against targets, (3) Delivers actionable feedback to the LLM, and (4) Allows intuitive developer influence on specifications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 18 of its 26 references that are in the map. First posted on arXiv 31 Oct 2025.
Builds on
18 of 26 references.
References · 18
- 2025Self-Challenging Language Model Agentscited by 59
- 2023Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repaircited by 55
- 2025LLM Agents Making Agent Toolscited by 48
- 2025Flexible and Efficient Grammar-Constrained Decodingcited by 43
- 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AIcited by 42
- 2024Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistencycited by 41
- 2025Type-Constrained Code Generation with Language Modelscited by 35
- 2023Towards Autoformalization of Mathematics and Code Correctness: Experiments with Elementary Proofscited by 27
- 2024Advancing Agentic Systems: Dynamic Task Decomposition, Tool Integration and Evaluation using Novel Metrics and Datasetcited by 24
- 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planningcited by 20
- 2025CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generationcited by 17
- 2024LLM Security Guard for Codecited by 15
6 more
- 2025Training Language Models to Generate Quality Code with Program Analysis Feedbackcited by 12
- 2025Unsupervised Elicitation of Language Modelscited by 11
- 2024Probabilistic Consensus through Ensemble Validation: A Framework for LLM Reliabilitycited by 9
- 2025Dissecting the SWE-Bench Leaderboards: Profiling Submitters and Architectures of LLM- and Agent-Based Repair Systemscited by 8
- 2024Enhancing Automated Loop Invariant Generation for Complex Programs with Large Language Modelscited by 7
- 2024From Defects to Demands: A Unified, Iterative, and Heuristically Guided LLM-Based Framework for Automated Software Repair and Requirement Realizationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025A Survey of Vibe Coding with Large Language Models
- 2026VIBEPASS: Can Vibe Coders Really Pass the Vibe Check?
- 2025SWE-IF: Aligning Code Evaluation with Human Preference
- 2025Vibe Coding: Toward an AI-Native Paradigm for Semantic and Intent-Driven Programming ↗
- 2025Is Vibe Coding Safe? Benchmarking Vulnerability of Agent-Generated Code in Real-World Tasks
- 2026Early Evidence of Vibe-Proving with Consumer LLMs: A Case Study on Spectral Region Characterization with ChatGPT-5.2 (Thinking)
- 2026Vibe Coding: An Experiment with Test-Driven Development
- 2025Are Large Language Models Robust in Understanding Code Against Semantics-Preserving Mutations?