Unveiling Security, Privacy, and Ethical Concerns of ChatGPT
Not on the map. Why?
Abstract (arXiv)
This paper delves into the realm of ChatGPT, an AI-powered chatbot that utilizes topic modeling and reinforcement learning to generate natural responses. Although ChatGPT holds immense promise across various industries, such as customer service, education, mental health treatment, personal productivity, and content creation, it is essential to address its security, privacy, and ethical implications. By exploring the upgrade path from GPT-1 to GPT-4, discussing the model's features, limitations, and potential applications, this study aims to shed light on the potential risks of integrating ChatGPT into our daily lives. Focusing on security, privacy, and ethics issues, we highlight the challenges these concerns pose for widespread adoption. Finally, we analyze the open problems in these areas, calling for concerted efforts to ensure the development of secure and ethically sound large language models.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). Builds on 20 of its 38 references that are in the map. First posted on arXiv 26 Jul 2023.
Builds on
20 of 38 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022Generative Adversarial Networkscited by 5,603
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
- 2019Text Summarization with Pretrained Encoderscited by 553
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
- 2019Hidden Trigger Backdoor Attackscited by 359
8 more
- 2023A Categorical Archive of ChatGPT Failurescited by 167
- 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 157
- 2020MetaPoison: Practical General-purpose Clean-label Data Poisoningcited by 114
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
- 2018iFair: Learning Individually Fair Data Representations for Algorithmic Decision Makingcited by 64
- 2022PUMA: Performance Unchanged Model Augmentation for Training Data Removalcited by 56
- 2022Deepfake Text Detection: Limitations and Opportunitiescited by 37
- 2023Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraintscited by 31
Built on by
Citing papers per year: 2023: 5; 2024: 21; 2025: 24; 2026: 3.
53 papers.
Sort:
By area:
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
- 2024LLM Dataset Inference: Did you train on my dataset?cited by 107
- 2024NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Securitycited by 90
- 2024A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systemscited by 74
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
- 2023Towards Possibilities & Impossibilities of AI-generated Text Detection: A Surveycited by 28
- 2024Navigating LLM Ethics: Advancements, Challenges, and Future Directionscited by 28
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
- 2025D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive Securitycited by 19
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
38 more
- 2025CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Executioncited by 14
- 2025Using Vision Language Models for Safety Hazard Identification in Constructioncited by 12
- 2023Are Chatbots Reliable Text Annotators? Sometimescited by 9
- 2024The Phantom Menace: Unmasking Privacy Leakages in Vision-Language Modelscited by 8
- 2024Risks, Causes, and Mitigations of Widespread Deployments of Large Language Models (LLMs): A Surveycited by 8
- 2024LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMscited by 8
- 2025Unlocking Post-hoc Dataset Inference with Synthetic Datacited by 7
- 2025Student Perspectives on the Benefits and Risks of AI in Educationcited by 6
- 2023SoK: Access Control Policy Generation from High-level Natural Language Requirementscited by 5
- 2024RAGent: Retrieval-based Access Control Policy Generationcited by 5
- 2024SoK: Prompt Hacking of Large Language Modelscited by 5
- 2024Exactly Minimax-Optimal Locally Differentially Private Samplingcited by 5
- 2025Tag&Tab: Pretraining Data Detection in Large Language Models Using Keyword-Based Membership Inference Attackcited by 5
- 2025EfficientNav: Towards On-Device Object-Goal Navigation with Navigation Map Caching and Retrievalcited by 5
- 2024Generative AI Security: Challenges and Countermeasurescited by 4
- 2025Function-to-Style Guidance of LLMs for Code Translationcited by 4
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Surveycited by 4
- 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulnesscited by 3
- 2025Can Media Act as a Soft Regulator of Safe AI Development? A Game Theoretical Analysiscited by 3
- 2025A Statistical Hypothesis Testing Framework for Data Misappropriation Detection in Large Language Modelscited by 2
- 2025SOK: Exploring Hallucinations and Security Risks in AI-Assisted Software Development with Insights for LLM Deploymentcited by 2
- 2025Automatic Calibration for Membership Inference Attack on Large Language Modelscited by 2
- 2025A Survey on Foundation Models for Personalized Federated Intelligencecited by 2
- 2025When There Is No Decoder: Removing Watermarks from Stable Diffusion Models in a No-box Settingcited by 2
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessmentcited by 2
- 2025Universal and Transferable Adversarial Attack on Large Language Models Using Exponentiated Gradient Descentcited by 2
- 2025Direct Token Optimization: A Self-contained Approach to Large Language Model Unlearningcited by 2
- 2025A Longitudinal Measurement of Privacy Policy Evolution for Large Language Modelscited by 2
- 2023Are You Worthy of My Trust?: A Socioethical Perspective on the Impacts of Trustworthy AI Systems on the Environment and Human Societycited by 1
- 2024The Evolution of Learning: Assessing the Transformative Impact of Generative AI on Higher Educationcited by 1
- 2024An Empirical Design Justice Approach to Identifying Ethical Considerations in the Intersection of Large Language Models and Social Roboticscited by 1
- 2024Evaluating the capability of large language models to personalize science texts for diverse middle-school-age learnerscited by 1
- 2025LexiMark: Robust Watermarking via Lexical Substitutions to Enhance Membership Verification of an LLM's Textual Training Datacited by 1
- 2024AI-Empowered Human Research Integrating Brain Science and Social Sciences Insightscited by 0
- 2025Large Language Models' Accuracy in Emulating Human Experts' Evaluation of Public Sentiments about Heated Tobacco Products on Social Mediacited by 0
- 2025Contextual Embedding-based Clustering to Identify Topics for Healthcare Service Improvementcited by 0
- 2025When Explainability Meets Privacy: An Investigation at the Intersection of Post-hoc Explainability and Differential Privacy in the Context of Natural Language Processingcited by 0
- 2025Generative AI in Heritage Practice: Improving the Accessibility of Heritage Guidancecited by 0
50 most cited of 53 All 53 (JSON)
- 2026Quantize with Confidence? An Empirical Study of Quantization for Code Generation15 Jul 2026
- 2026When Visual Privacy Protection Meets Multimodal Large Language Models14 Mar 2026
- 2026FeedAIde: Guiding App Users to Submit Rich Feedback Reports by Asking Context-Aware Follow-Up Questions4 Mar 2026
- 2025A Longitudinal Measurement of Privacy Policy Evolution for Large Language Models24 Nov 2025
- 2025EfficientNav: Towards On-Device Object-Goal Navigation with Navigation Map Caching and Retrieval21 Oct 2025
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Survey30 Sep 2025
- 2025Direct Token Optimization: A Self-contained Approach to Large Language Model Unlearning30 Sep 2025
- 2025Generative AI in Heritage Practice: Improving the Accessibility of Heritage Guidance3 Sep 2025
- 2025Can Media Act as a Soft Regulator of Safe AI Development? A Game Theoretical Analysis2 Sep 2025
- 2025Universal and Transferable Adversarial Attack on Large Language Models Using Exponentiated Gradient Descent20 Aug 2025
- 2025When Explainability Meets Privacy: An Investigation at the Intersection of Post-hoc Explainability and Differential Privacy in the Context of Natural Language Processing14 Aug 2025
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessment12 Aug 2025
38 more
- 2025Function-to-Style Guidance of LLMs for Code Translation15 Jul 2025
- 2025When There Is No Decoder: Removing Watermarks from Stable Diffusion Models in a No-box Setting4 Jul 2025
- 2025Unlocking Post-hoc Dataset Inference with Synthetic Data18 Jun 2025
- 2025LexiMark: Robust Watermarking via Lexical Substitutions to Enhance Membership Verification of an LLM's Textual Training Data17 Jun 2025
- 2025CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Execution21 May 2025
- 2025A Survey on Foundation Models for Personalized Federated Intelligence11 May 2025
- 2025Automatic Calibration for Membership Inference Attack on Large Language Models6 May 2025
- 2025Student Perspectives on the Benefits and Risks of AI in Education4 May 2025
- 2025Contextual Embedding-based Clustering to Identify Topics for Healthcare Service Improvement18 Apr 2025
- 2025Using Vision Language Models for Safety Hazard Identification in Construction12 Apr 2025
- 2025D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive Security15 Feb 2025
- 2025SOK: Exploring Hallucinations and Security Risks in AI-Assisted Software Development with Insights for LLM Deployment31 Jan 2025
- 2025Large Language Models' Accuracy in Emulating Human Experts' Evaluation of Public Sentiments about Heated Tobacco Products on Social Media31 Jan 2025
- 2025Tag&Tab: Pretraining Data Detection in Large Language Models Using Keyword-Based Membership Inference Attack14 Jan 2025
- 2025A Statistical Hypothesis Testing Framework for Data Misappropriation Detection in Large Language Models5 Jan 2025
- 2024AI-Empowered Human Research Integrating Brain Science and Social Sciences Insights16 Nov 2024
- 2024Exactly Minimax-Optimal Locally Differentially Private Sampling30 Oct 2024
- 2024SoK: Prompt Hacking of Large Language Models16 Oct 2024
- 2024RAGent: Retrieval-based Access Control Policy Generation8 Sep 2024
- 2024LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs24 Aug 2024
- 2024Evaluating the capability of large language models to personalize science texts for diverse middle-school-age learners9 Aug 2024
- 2024The Phantom Menace: Unmasking Privacy Leakages in Vision-Language Models2 Aug 2024
- 2024Risks, Causes, and Mitigations of Widespread Deployments of Large Language Models (LLMs): A Survey1 Aug 2024
- 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulness3 Jul 2024
- 2024LLM Dataset Inference: Did you train on my dataset?10 Jun 2024
- 2024An Empirical Design Justice Approach to Identifying Ethical Considerations in the Intersection of Large Language Models and Social Robotics10 Jun 2024
- 2024NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security8 Jun 2024
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges24 May 2024
- 2024Navigating LLM Ethics: Advancements, Challenges, and Future Directions14 May 2024
- 2024The Evolution of Learning: Assessing the Transformative Impact of Generative AI on Higher Education16 Apr 2024
- 2024A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systems28 Feb 2024
- 2024A Survey on Knowledge Distillation of Large Language Models20 Feb 2024
- 2024Generative AI Security: Challenges and Countermeasures20 Feb 2024
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Review13 Feb 2024
- 2024Security and Privacy Challenges of Large Language Models: A Survey30 Jan 2024
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems11 Jan 2024
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly4 Dec 2023
- 2023Are Chatbots Reliable Text Annotators? Sometimes9 Nov 2023
50 newest of 53 All 53 (JSON)
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
- 2024LLM Dataset Inference: Did you train on my dataset?cited by 107
- 2025Tag&Tab: Pretraining Data Detection in Large Language Models Using Keyword-Based Membership Inference Attackcited by 5
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Surveycited by 4
- 2025Automatic Calibration for Membership Inference Attack on Large Language Modelscited by 2
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessmentcited by 2
- 2025Direct Token Optimization: A Self-contained Approach to Large Language Model Unlearningcited by 2
- 2025LexiMark: Robust Watermarking via Lexical Substitutions to Enhance Membership Verification of an LLM's Textual Training Datacited by 1
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Survey30 Sep 2025
- 2025Direct Token Optimization: A Self-contained Approach to Large Language Model Unlearning30 Sep 2025
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessment12 Aug 2025
- 2025LexiMark: Robust Watermarking via Lexical Substitutions to Enhance Membership Verification of an LLM's Textual Training Data17 Jun 2025
- 2025Automatic Calibration for Membership Inference Attack on Large Language Models6 May 2025
- 2025Tag&Tab: Pretraining Data Detection in Large Language Models Using Keyword-Based Membership Inference Attack14 Jan 2025
- 2024LLM Dataset Inference: Did you train on my dataset?10 Jun 2024
- 2024Security and Privacy Challenges of Large Language Models: A Survey30 Jan 2024
- 2025D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive Securitycited by 19
- 2025CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Executioncited by 14
- 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulnesscited by 3
- 2025A Longitudinal Measurement of Privacy Policy Evolution for Large Language Modelscited by 2
- 2025A Longitudinal Measurement of Privacy Policy Evolution for Large Language Models24 Nov 2025
- 2025CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Execution21 May 2025
- 2025D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive Security15 Feb 2025
- 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulness3 Jul 2024
- 2025Unlocking Post-hoc Dataset Inference with Synthetic Datacited by 7
- 2025Unlocking Post-hoc Dataset Inference with Synthetic Data18 Jun 2025
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
- 2024NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Securitycited by 90
- 2024A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systemscited by 74
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
- 2023Towards Possibilities & Impossibilities of AI-generated Text Detection: A Surveycited by 28
- 2024Navigating LLM Ethics: Advancements, Challenges, and Future Directionscited by 28
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2023Are Chatbots Reliable Text Annotators? Sometimescited by 9
- 2024Risks, Causes, and Mitigations of Widespread Deployments of Large Language Models (LLMs): A Surveycited by 8
- 2024LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMscited by 8
12 most cited of 35 All 35 (JSON)
- 2026Quantize with Confidence? An Empirical Study of Quantization for Code Generation15 Jul 2026
- 2026FeedAIde: Guiding App Users to Submit Rich Feedback Reports by Asking Context-Aware Follow-Up Questions4 Mar 2026
- 2025EfficientNav: Towards On-Device Object-Goal Navigation with Navigation Map Caching and Retrieval21 Oct 2025
- 2025Generative AI in Heritage Practice: Improving the Accessibility of Heritage Guidance3 Sep 2025
- 2025Can Media Act as a Soft Regulator of Safe AI Development? A Game Theoretical Analysis2 Sep 2025
- 2025When Explainability Meets Privacy: An Investigation at the Intersection of Post-hoc Explainability and Differential Privacy in the Context of Natural Language Processing14 Aug 2025
- 2025Function-to-Style Guidance of LLMs for Code Translation15 Jul 2025
- 2025A Survey on Foundation Models for Personalized Federated Intelligence11 May 2025
- 2025Student Perspectives on the Benefits and Risks of AI in Education4 May 2025
- 2025Contextual Embedding-based Clustering to Identify Topics for Healthcare Service Improvement18 Apr 2025
- 2025SOK: Exploring Hallucinations and Security Risks in AI-Assisted Software Development with Insights for LLM Deployment31 Jan 2025
- 2025Large Language Models' Accuracy in Emulating Human Experts' Evaluation of Public Sentiments about Heated Tobacco Products on Social Media31 Jan 2025
12 newest of 35 All 35 (JSON)