mlsanityData to 7 Oct 2026

Position: Natural Language Should Not Fully Replace Formal Languages

arXiv 2607.20432 ↗First posted 10 May 2026cs.CL cs.PLcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent advances in large language models and their widespread adoption have prompted claims that natural language could entirely replace formal languages, such as programming languages for software design. In this position paper, we argue that this perspective overlooks fundamental linguistic properties of natural language, specifically that it is optimized for underspecification in open-ended contexts. We introduce a formal framework centered on *task specificity*, defining it as the information-theoretic reduction of uncertainty in an output space -- such as all possible images -- given a user's specific requirements. We prove a *specificity crossover theorem*, showing the existence of a threshold beyond which the cost to express formal requirements into natural language exceeds the cost of direct formal specification. By analyzing case studies across modalities, such as image generation, code synthesis, and audio production, we demonstrate that natural language excels at low specificity tasks, while formal languages are advantageous on tasks with stricter requirements. We conclude that natural and formal languages are complementary tools and advocate the development of hybrid systems that allow users to move across the specificity spectrum.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 85 references that are in the map. First posted on arXiv 10 May 2026.

Builds on

28 of 85 references.

References · 28

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  2. 2024A Survey on Large Language Models for Code Generationcited by 646
  3. 2023MusicLM: Generating Music From Textcited by 442
  4. 2023Language Modeling Is Compressioncited by 225
  5. 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 216
  6. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
  7. 2022Optimizing Prompts for Text-to-Image Generationcited by 204
  8. 2021Gender Bias in Machine Translationcited by 116
  9. 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivitycited by 93
  10. 2024A Survey on LLM-based Code Generation for Low-Resource and Domain-Specific Programming Languagescited by 65
  11. 2020Artificial Intelligence in the Creative Industries: A Reviewcited by 61
  12. 2022A Taxonomy of Prompt Modifiers for Text-To-Image Generationcited by 54
16 more
  1. 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
  2. 2024Understanding the Impact of Negative Prompts: When and How Do They Take Effect?cited by 50
  3. 2021The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Colorcited by 32
  4. 2021SketchEdit: Mask-Free Local Image Manipulation with Partial Sketchescited by 32
  5. 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
  6. 2018Studying the Difference Between Natural and Programming Language Corporacited by 13
  7. 2024Exploring the Impact of AI-generated Image Tools on Professional and Non-professional Users in the Art and Design Fieldscited by 10
  8. 2025Survey on the Evaluation of Generative Models in Musiccited by 10
  9. 2025The Hidden Risks of LLM-Generated Web Application Code: A Security-Centric Evaluation of Code Generation Capabilities in Large Language Modelscited by 7
  10. 2023Human Learning by Model Feedback: The Dynamics of Iterative Prompting with Midjourneycited by 5
  11. 2025R2: A LLM Based Novel-to-Screenplay Generation Framework with Causal Plot Graphscited by 5
  12. 2025Guiding What Not to Generate: Automated Negative Prompting for Text-Image Alignmentcited by 4
  13. 2015The evolution of lossy compressioncited by 2
  14. 2018Efficient human-like semantic representations via the Information Bottleneck principlecited by 2
  15. 2025NaturalEdit: Code Modification through Direct Interaction with Adaptive Natural Language Representationcited by 2
  16. 2026Lessons from the Field: An Adaptable Lifecycle Approach to Applied Dialogue Summarizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.