Political Depolarization of News Articles Using Attribute-aware Word Embeddings
Not on the map. Why?
Abstract (arXiv)
Political polarization in the US is on the rise. This polarization negatively affects the public sphere by contributing to the creation of ideological echo chambers. In this paper, we focus on addressing one of the factors that contributes to this polarity, polarized media. We introduce a framework for depolarizing news articles. Given an article on a certain topic with a particular ideological slant (eg., liberal or conservative), the framework first detects polar language in the article and then generates a new article with the polar language replaced with neutral expressions. To detect polar words, we train a multi-attribute-aware word embedding model that is aware of ideology and topics on 360k full-length media articles. Then, for text generation, we propose a new algorithm called Text Annealing Depolarization Algorithm (TADA). TADA retrieves neutral expressions from the word embedding model that not only decrease ideological polarity but also preserve the original argument of the text, while maintaining grammatical correctness. We evaluate our framework by comparing the depolarized output of our model in two modes, fully-automatic and semi-automatic, on 99 stories spanning 11 topics. Based on feedback from 161 human testers, our framework successfully depolarized 90.1% of paragraphs in semi-automatic mode and 78.3% of paragraphs in fully-automatic mode. Furthermore, 81.2% of the testers agree that the non-polar content information is well-preserved and 79% agree that depolarization does not harm semantic correctness when they compare the original text and the depolarized text. Our work shows that data-driven methods can help to locate political polarity and aid in the depolarization of articles.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 24 of its 60 references that are in the map. First posted on arXiv 5 Jan 2021.
Builds on
24 of 60 references.
References · 24
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2015Generating Sentences from a Continuous Spacecited by 607
- 2018Generating Natural Language Adversarial Examplescited by 422
- 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 246
- 2018Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfercited by 191
- 2018Disentangled Representation Learning for Non-Parallel Text Style Transfercited by 127
- 2018Style Transfer Through Back-Translationcited by 124
- 2017Generating Sentences by Editing Prototypescited by 88
- 2019Style Transformer: Unpaired Text Style Transfer without Disentangled Latent Representationcited by 84
- 2018Unpaired Sentiment-to-Sentiment Translation: A Cycled Reinforcement Learning Approachcited by 55
12 more
- 2018Content preserving text generation with attribute controlscited by 47
- 2019Reinforcement Learning Based Text Style Transfer without Parallel Training Corpuscited by 38
- 2018Adversarial Text Generation via Feature-Mover's Distancecited by 27
- 2015Overcoming Language Variation in Sentiment Analysis with Social Attentioncited by 23
- 2018Multiple-Attribute Text Style Transfercited by 20
- 2019A Hierarchical Reinforced Sequence Operation Method for Unsupervised Text Style Transfercited by 20
- 2018Structured Content Preservation for Unsupervised Text Style Transfercited by 10
- 2017Multi-space Variational Encoder-Decoders for Semi-supervised Labeled Sequence Transductioncited by 9
- 2017Adversarial Multi-Criteria Learning for Chinese Word Segmentationcited by 7
- 2019Simple dynamic word embeddings for mapping perceptions in the public spherecited by 7
- 2018Sentiment Transfer using Seq2Seq Adversarial Autoencoderscited by 4
- 2018Dictionary-Guided Editing Networks for Paraphrase Generationcited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 3; 2024: 1; 2025: 1; 2026: 1.
9 papers.
- 2022Mind's Eye: Grounded Language Model Reasoning through Simulationcited by 83
- 2021Mitigating Political Bias in Language Models Through Reinforced Calibrationcited by 73
- 2023Second Thoughts are Best: Learning to Re-Align With Human Values from Text Editscited by 27
- 2022Non-Parallel Text Style Transfer with Self-Parallel Supervisioncited by 11
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Biascited by 11
- 2023Connecting the Dots in News Analysis: Bridging the Cross-Disciplinary Disparities in Media Bias and Framingcited by 6
- 2024Analyzing Sentiment Polarity Reduction in News Presentation through Contextual Perturbation and Large Language Modelscited by 1
- 2025Tracing Partisan Bias to Its Emotional Fingerprints: A Computational Approach to Mitigationcited by 0
- 2026Balancing Domestic and Global Perspectives: Evaluating Dual-Calibration and LLM-Generated Nudges for Diverse News Recommendationcited by 0
- 2026Balancing Domestic and Global Perspectives: Evaluating Dual-Calibration and LLM-Generated Nudges for Diverse News Recommendation6 Mar 2026
- 2025Tracing Partisan Bias to Its Emotional Fingerprints: A Computational Approach to Mitigation2 Jan 2025
- 2024Analyzing Sentiment Polarity Reduction in News Presentation through Contextual Perturbation and Large Language Models3 Feb 2024
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Bias26 Dec 2023
- 2023Connecting the Dots in News Analysis: Bridging the Cross-Disciplinary Disparities in Media Bias and Framing14 Sep 2023
- 2023Second Thoughts are Best: Learning to Re-Align With Human Values from Text Edits1 Jan 2023
- 2022Mind's Eye: Grounded Language Model Reasoning through Simulation11 Oct 2022
- 2022Non-Parallel Text Style Transfer with Self-Parallel Supervision18 Apr 2022
- 2021Mitigating Political Bias in Language Models Through Reinforced Calibration30 Apr 2021