mlsanityData to 7 Oct 2026

Co-Writing with Opinionated Language Models Affects Users' Views

arXiv 2302.00560 ↗First posted 1 Feb 2023cs.HC cs.AI cs.CLcited by 145

Not on the map. Why?

Abstract (arXiv)

If large language models like GPT-3 preferably produce a particular point of view, they may influence people's opinions on an unknown scale. This study investigates whether a language-model-powered writing assistant that generates some opinions more often than others impacts what users write - and what they think. In an online experiment, we asked participants (N=1,506) to write a post discussing whether social media is good for society. Treatment group participants used a language-model-powered writing assistant configured to argue that social media is good or bad for society. Participants then completed a social media attitude survey, and independent judges (N=500) evaluated the opinions expressed in their writing. Using the opinionated language model affected the opinions expressed in participants' writing and shifted their opinions in the subsequent attitude survey. We discuss the wider implications of our results and argue that the opinions built into AI language technologies need to be monitored and engineered more carefully.

Key facts. Cited by 145 papers in the map (data through 7 Oct 2026). Builds on 27 of its 115 references that are in the map. First posted on arXiv 1 Feb 2023.

Builds on

27 of 115 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  4. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  5. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  6. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  7. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
  8. 2021Ethical and social risks of harm from Language Modelscited by 957
  9. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  10. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  11. 2019Defending Against Neural Fake Newscited by 553
  12. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
15 more
  1. 2019Reducing Sentiment Bias in Language Models via Counterfactual Evaluationcited by 148
  2. 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
  3. 2022Human heuristics for AI-generated language are flawedcited by 104
  4. 2019Gmail Smart Compose: Real-Time Assisted Writingcited by 97
  5. 2014The Rise of Social Botscited by 96
  6. 2021Language Models are Few-shot Multilingual Learnerscited by 92
  7. 2021The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writerscited by 61
  8. 2016Smart Reply: Automated Response Suggestion for Emailcited by 54
  9. 2022How Different Groups Prioritize Ethical Values for Responsible AIcited by 49
  10. 2022Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summariescited by 47
  11. 2022Interacting with next-phrase suggestions: How suggestion systems aid and influence the cognitive processes of writingcited by 27
  12. 2018The anatomy of Reddit: An overview of academic researchcited by 12
  13. 2021Persuasive Natural Language Generation -- A Literature Reviewcited by 10
  14. 2022Suggestion Lists vs. Continuous Generation: Interaction Design for Writing with Generative Models on Mobile Devices Affect Text Length, Wording and Perceived Authorshipcited by 7
  15. 2021Spinning Sequence-to-Sequence Models with Meta-Backdoorscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 30; 2024: 44; 2025: 33; 2026: 38.

145 papers.

Sort:

By area:

  1. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
  2. 2023Does Writing with Language Models Reduce Content Diversity?cited by 190
  3. 2024A Roadmap to Pluralistic Alignmentcited by 175
  4. 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
  5. 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
  6. 2023Evaluating and Mitigating Discrimination in Language Model Decisionscited by 117
  7. 2023Generative Language Models Exhibit Social Identity Biasescited by 107
  8. 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 100
  9. 2023Art and the science of generative AI: A deeper divecited by 93
  10. 2023Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibrationcited by 90
  11. 2023The Robots are Here: Navigating the Generative AI Revolution in Computing Educationcited by 85
  12. 2024Visibility into AI Agentscited by 77
38 more
  1. 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
  2. 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 59
  3. 2024Fairness in Large Language Models: A Taxonomic Surveycited by 57
  4. 2023Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generationcited by 55
  5. 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Modelscited by 51
  6. 2023LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Pluginscited by 49
  7. 2024Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Editscited by 49
  8. 2025Modifying Large Language Model Post-Training for Diverse Creative Writingcited by 39
  9. 2023Writer-Defined AI Personas for On-Demand Feedback Generationcited by 36
  10. 2025The Homogenizing Effect of Large Language Models on Human Expression and Thoughtcited by 35
  11. 2024The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmerscited by 28
  12. 2025An Evaluation of Cultural Value Alignment in LLMcited by 28
  13. 2023Accuracy and Political Bias of News Source Credibility Ratings by Large Language Modelscited by 25
  14. 2023The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authorscited by 22
  15. 2023Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Languagecited by 22
  16. 2023How Far Can We Extract Diverse Perspectives from Large Language Models?cited by 22
  17. 2024The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Modelscited by 19
  18. 2023From Text to Self: Users' Perceptions of Potential of AI on Interpersonal Communication and Selfcited by 18
  19. 2024Holistic Safety and Responsibility Evaluations of Advanced AI Modelscited by 18
  20. 2023Influence of External Information on Large Language Models Mirrors Social Cognitive Patternscited by 16
  21. 2024Multi-Agents are Social Groups: Investigating Social Influence of Multiple Agents in Human-Agent Interactionscited by 16
  22. 2025Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Reviewcited by 16
  23. 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
  24. 2024ExpressEdit: Video Editing with Natural Language and Sketchingcited by 14
  25. 2024The LLM Effect: Are Humans Truly Using LLMs, or Are They Being Influenced By Them Instead?cited by 14
  26. 2024"It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Modelscited by 14
  27. 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Processcited by 14
  28. 2025What and Whose Knowledge? Measuring Epistemic Diversity in Large Language Modelscited by 14
  29. 2025Taxonomy of User Needs and Actionscited by 13
  30. 2024Bias in Opinion Summarisation from Pre-training to Adaptation: A Case Study in Political Biascited by 12
  31. 2024The Call for Socially Aware Language Technologiescited by 12
  32. 2024How Does the Disclosure of AI Assistance Affect the Perceptions of Writing?cited by 12
  33. 2023Exploring Perspectives on the Impact of Artificial Intelligence on the Creativity of Knowledge Work: Beyond Mechanised Plagiarism and Stochastic Parrotscited by 11
  34. 2025The Lock-in Hypothesis: Stagnation by Algorithmcited by 11
  35. 2024OmniActions: Predicting Digital Actions in Response to Real-World Multimodal Sensory Inputs with LLMscited by 10
  36. 2024MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checkingcited by 10
  37. 2023Human-AI Interactions and Societal Pitfallscited by 9
  38. 2023Multilingual Coarse Political Stance Classification of Media. The Editorial Line of a ChatGPT and Bard Newspapercited by 9

50 most cited of 145 All 145 (JSON)