mlsanityData to 7 Oct 2026

A Perspective on Large Language Models, Intelligent Machines, and Knowledge Acquisition

arXiv 2408.06598 ↗First posted 13 Aug 2024cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are known for their remarkable ability to generate synthesized 'knowledge', such as text documents, music, images, etc. However, there is a huge gap between LLM's and human capabilities for understanding abstract concepts and reasoning. We discuss these issues in a larger philosophical context of human knowledge acquisition and the Turing test. In addition, we illustrate the limitations of LLMs by analyzing GPT-4 responses to questions ranging from science and math to common sense reasoning. These examples show that GPT-4 can often imitate human reasoning, even though it lacks understanding. However, LLM responses are synthesized from a large LLM model trained on all available data. In contrast, human understanding is based on a small number of abstract concepts. Based on this distinction, we discuss the impact of LLMs on acquisition of human knowledge and education.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 13 Aug 2024.

Builds on

19 of 28 references.

References · 19

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  6. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  7. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  8. 2023PaLM 2 Technical Reportcited by 1,154
  9. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  10. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 246
  11. 2024A Careful Examination of Large Language Model Performance on Grade School Arithmeticcited by 188
  12. 2022Talking About Large Language Modelscited by 174
7 more
  1. 2023Evaluating Cognitive Maps and Planning in Large Language Models with CogEvalcited by 77
  2. 2023Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Modelscited by 76
  3. 2023Evaluating Language Models for Mathematics through Interactionscited by 69
  4. 2022Large Language Models and the Reverse Turing Testcited by 38
  5. 2023Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understandingcited by 20
  6. 2023Getting from Generative AI to Trustworthy AI: What LLMs might learn from Cyccited by 19
  7. 2024FineMath: A Fine-Grained Mathematical Evaluation Benchmark for Chinese Large Language Modelscited by 10

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.