Can ChatGPT-like Generative Models Guarantee Factual Accuracy? On the Mistakes of New Generation Search Engines
Not on the map. Why?
Abstract (arXiv)
Although large conversational AI models such as OpenAI's ChatGPT have demonstrated great potential, we question whether such models can guarantee factual accuracy. Recently, technology companies such as Microsoft and Google have announced new services which aim to combine search engines with conversational AI. However, we have found numerous mistakes in the public demonstrations that suggest we should not easily trust the factual claims of the AI models. Rather than criticizing specific models or companies, we hope to call on researchers and developers to improve AI models' transparency and factual correctness.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 4 of its 23 references that are in the map. First posted on arXiv 3 Mar 2023.
Builds on
4 of 23 references.
References · 4
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2017Toward Controlled Generation of Textcited by 271
- 2022Is GPT-3 a Good Data Annotator?cited by 208
Built on by
Citing papers per year: 2023: 11; 2024: 2; 2025: 1.
14 papers.
Sort:
By area:
- 2023Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Frameworkcited by 139
- 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sourcescited by 121
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
- 2023Consistency Analysis of ChatGPTcited by 37
- 2023Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operationcited by 33
- 2024Can We Further Elicit Reasoning in LLMs? Critic-Guided Planning with Retrieval-Augmentation for Solving Challenging Taskscited by 22
- 2023ReelFramer: Human-AI Co-Creation for News-to-Video Translationcited by 19
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?cited by 15
- 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligencecited by 13
- 2023Evaluating Generative Ad Hoc Information Retrievalcited by 11
- 2024Enhanced Multimodal RAG-LLM for Accurate Visual Question Answeringcited by 10
- 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligence23 Nov 2025
- 2024Enhanced Multimodal RAG-LLM for Accurate Visual Question Answering30 Dec 2024
- 2024Can We Further Elicit Reasoning in LLMs? Critic-Guided Planning with Retrieval-Augmentation for Solving Challenging Tasks2 Oct 2024
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?28 Nov 2023
- 2023Evaluating Generative Ad Hoc Information Retrieval8 Nov 2023
- 2023LUNA: A Model-Based Universal Analysis Framework for Large Language Models22 Oct 2023
- 2023Ladder-of-Thought: Using Knowledge as Steps to Elevate Stance Detection31 Aug 2023
- 2023Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operation16 Aug 2023
- 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sources22 May 2023
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation19 May 2023
- 2023Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Framework5 May 2023
- 2023ReelFramer: Human-AI Co-Creation for News-to-Video Translation19 Apr 2023
2 more
- 2023Retrieving Multimodal Information for Augmented Generation: A Survey20 Mar 2023
- 2023Consistency Analysis of ChatGPT11 Mar 2023
- 2023Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Frameworkcited by 139
- 2024Can We Further Elicit Reasoning in LLMs? Critic-Guided Planning with Retrieval-Augmentation for Solving Challenging Taskscited by 22
- 2023Ladder-of-Thought: Using Knowledge as Steps to Elevate Stance Detectioncited by 4
- 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sourcescited by 121
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
- 2023Consistency Analysis of ChatGPTcited by 37
- 2023ReelFramer: Human-AI Co-Creation for News-to-Video Translationcited by 19
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?cited by 15
- 2023Evaluating Generative Ad Hoc Information Retrievalcited by 11
- 2023LUNA: A Model-Based Universal Analysis Framework for Large Language Modelscited by 4
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?28 Nov 2023
- 2023Evaluating Generative Ad Hoc Information Retrieval8 Nov 2023
- 2023LUNA: A Model-Based Universal Analysis Framework for Large Language Models22 Oct 2023
- 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sources22 May 2023
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation19 May 2023
- 2023ReelFramer: Human-AI Co-Creation for News-to-Video Translation19 Apr 2023
- 2023Retrieving Multimodal Information for Augmented Generation: A Survey20 Mar 2023
- 2023Consistency Analysis of ChatGPT11 Mar 2023