mlsanityData to 7 Oct 2026

Small edits, large models: How Wikipedia advocacy shapes LLM values

arXiv 2606.24890 ↗First posted 30 Apr 2026cs.CL cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Can a small group of volunteers shape how AI systems discuss animal welfare, just by editing Wikipedia? We show that they can. Wikipedia appears in nearly every major language model training dataset and is weighted more heavily than web-crawled text. The Pro-Animal Wikipedians (PAW), a group of advocates who add sourced animal welfare content to relevant articles, have made 125 edits across 115 pages. Using gradient-based data attribution (Bergson; MAGIC), we traced how these edits influence language model behavior. TrackStar retrieval attribution on Llama 3.1 8B found that PAW-edited sections made up 68 percent of the highest-attributed documents for animal welfare queries (p < 0.0001) but only 52 percent for unrelated queries about the same companies (p = 0.53): the model links PAW content specifically to animal welfare topics, not to the entities in general. MAGIC counterfactual influence estimation on Llama-3.2-1B, run across five random training-order seeds, gave the same picture even more sharply: in every seed, the top-10 most influential documents on animal welfare queries were all PAW edits (10 of 10, 5 of 5 seeds), while on general queries the same top-10 sat at chance (4 to 6 of 10). Mean PAW influence exceeded mean control influence on animal welfare queries with p < 0.0001 in every seed, an effect 6 to 30 times larger than on general queries. Leave-subset-out validation gave Spearman rho = 1.00 for all 10 runs. When we fine-tuned separate models on PAW content versus control content, each model performed better specifically on the type of text it was trained on: the PAW-trained model cut perplexity on animal welfare text from 12.4 to 8.4, while the control-trained model cut perplexity on control text from 16.1 to 11.4. A small, coordinated Wikipedia editing campaign therefore measurably shapes how language models handle the topics those edits address.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 17 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

12 of 17 references.

References · 12

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  4. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  5. 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 475
  6. 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
  7. 2023TRAK: Attributing Model Behavior at Scalecited by 273
  8. 2022Datamodels: Predicting Predictions from Training Datacited by 186
  9. 2024RedPajama: an Open Dataset for Training Large Language Modelscited by 178
  10. 2024Scalable Influence and Fact Tracing for Large Language Model Pretrainingcited by 40
  11. 2025MAGIC: Near-Optimal Data Attribution for Deep Learningcited by 20
  12. 2023Governance Capture in a Self-Governing Community: A Qualitative Comparison of the Serbo-Croatian Wikipediascited by 4

Built on by

Not cited yet.