mlsanityData to 14 Oct 2026

What Large Language Models Do Not Talk About: An Empirical Study of Moderation and Censorship Practices

arXiv 2504.03803 ↗First posted 4 Apr 2025cs.CL cs.CY cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are increasingly deployed as gateways to information, yet their content moderation practices remain underexplored. This work investigates the extent to which LLMs refuse to answer or omit information when prompted on political topics. To do so, we distinguish between hard censorship (i.e., generated refusals, error messages, or canned denial responses) and soft censorship (i.e., selective omission or downplaying of key elements), which we identify in LLMs' responses when asked to provide information on a broad range of political figures. Our analysis covers 14 state-of-the-art models from Western countries, China, and Russia, prompted in all six official United Nations (UN) languages. Our analysis suggests that although censorship is observed across the board, it is predominantly tailored to an LLM provider's domestic audience and typically manifests as either hard censorship or soft censorship (though rarely both concurrently). These findings underscore the need for ideological and geographic diversity among publicly available LLMs, and greater transparency in LLM moderation strategies to facilitate informed user choices. All data are made freely available.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 4 Apr 2025.

Builds on

20 of 33 references.

References · 20

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  3. 2024A Survey on LLM-as-a-Judgecited by 1,423
  4. 2023Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMscited by 184
  5. 2024The Political Preferences of LLMscited by 84
  6. 2025LLM4SR: A Survey on Large Language Models for Scientific Researchcited by 83
  7. 2024Large Language Models Reflect the Ideology of their Creatorscited by 57
  8. 2023LLM Censorship: A Machine Learning Challenge or a Computer Security Problem?cited by 49
  9. 2024Assessing Political Bias in Large Language Modelscited by 32
  10. 2024Securing Large Language Models: Addressing Bias, Misinformation, and Prompt Attackscited by 26
  11. 2025IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistancecited by 26
  12. 2024The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligencecited by 23
8 more
  1. 2025A Survey on Responsible LLMs: Inherent Risk, Malicious Use, and Mitigation Strategycited by 20
  2. 2024Privacy in Fine-tuning Large Language Models: Attacks, Defenses, and Future Directionscited by 14
  3. 2024Cannot or Should Not? Automatic Analysis of Refusal Composition in IFT/RLHF Datasets and Refusal Behavior of Black-Box LLMscited by 11
  4. 2015Pantheon 1.0, a manually verified dataset of globally famous biographiescited by 8
  5. 2024Comparative Global AI Regulation: Policy Perspectives from the EU, China, and the UScited by 5
  6. 2023Large Language Model Soft Ideologization via AI-Self-Consciousnesscited by 2
  7. 2023Red AI? Inconsistent Responses from GPT3.5 Models on Political Issues in the US and Chinacited by 2
  8. 2024Assessing Large Language Models for Online Extremism Research: Identification, Explanation, and New Knowledgecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 5.

11 papers.