mlsanityData to 7 Oct 2026

Shaping Schema via Language Representation as the Next Frontier for LLM Intelligence Expanding

arXiv 2605.09271 ↗First posted 10 May 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Although natural language is the default medium for Large Language Models (LLMs), its limited expressive capacity creates a profound bottleneck for complex problem-solving. While recent advancements in AI have relied heavily on scaling, merely internalizing knowledge does not guarantee its effective application. Defining language representation as the linguistic and symbolic constructs used to map and model the real world, this paper argues that shaping schemas through advanced language representation is the next frontier for expanding LLM intelligence. We posit that an LLM's knowledge activation and organization -- its schema -- depends heavily on the structural and symbolic sophistication of the language used to represent a given task. This paper contributes both a formalization of this claim and the empirical evidence to support it. With a new formalization, we present multiple lines of evidence to support our position: Firstly, we review recent empirical practices and emerging methodologies that demonstrate the substantial performance gains achievable through deliberate language representation design, even without modifying model parameters or scale. Secondly, we conduct controlled experiments showing that LLM performance and its internal feature activations vary under different language representations of the same underlying task. Together, these findings highlight language representation design as a promising direction for future research.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 90 of its 128 references that are in the map. First posted on arXiv 10 May 2026.

Builds on

90 of 128 references.

References · 90

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2020Scaling Laws for Neural Language Modelscited by 6,411
  7. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  8. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  9. 2022Emergent Abilities of Large Language Modelscited by 2,483
  10. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  11. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  12. 2019Language Models as Knowledge Bases?cited by 1,922
38 more
  1. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  2. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  3. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  4. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  5. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  6. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  7. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  8. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
  9. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  10. 2020Quantifying Attention Flow in Transformerscited by 759
  11. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
  12. 2022PAL: Program-aided Language Modelscited by 635
  13. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
  14. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
  15. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
  16. 2023Scaling Data-Constrained Language Modelscited by 391
  17. 2022Using cognitive psychology to understand GPT-3cited by 389
  18. 2020Generative Language Modeling for Automated Theorem Provingcited by 379
  19. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
  20. 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 352
  21. 2021True Few-Shot Learning with Language Modelscited by 343
  22. 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speakingcited by 292
  23. 2019Analyzing the Structure of Attention in a Transformer Language Modelcited by 241
  24. 2020Experience Grounds Languagecited by 241
  25. 2024VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documentscited by 237
  26. 2022Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matterscited by 221
  27. 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 218
  28. 2018Stress Test Evaluation for Natural Language Inferencecited by 211
  29. 2021Constrained Language Models Yield Few-Shot Semantic Parserscited by 162
  30. 2023Stabilizing Transformer Training by Preventing Attention Entropy Collapsecited by 154
  31. 2024Observational Scaling Laws and the Predictability of Language Model Performancecited by 128
  32. 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 120
  33. 2024Faithful Logical Reasoning via Symbolic Chain-of-Thoughtcited by 99
  34. 2024The Butterfly Effect of Altering Prompts: How Small Changes and Jailbreaks Affect Large Language Model Performancecited by 97
  35. 2024Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Modelscited by 91
  36. 2022Meaning without reference in large language modelscited by 76
  37. 2023Grammar Prompting for Domain-Specific Language Generation with Large Language Modelscited by 58
  38. 2023When Brain-inspired AI Meets AGIcited by 54

50 most cited of 90 All 90 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.