Designing Recommender Systems to Depolarize
Not on the map. Why?
Abstract (arXiv)
Polarization is implicated in the erosion of democracy and the progression to violence, which makes the polarization properties of large algorithmic content selection systems (recommender systems) a matter of concern for peace and security. While algorithm-driven social media does not seem to be a primary driver of polarization at the country level, it could be a useful intervention point in polarized societies. This paper examines algorithmic depolarization interventions with the goal of conflict transformation: not suppressing or eliminating conflict but moving towards more constructive conflict. Algorithmic intervention is considered at three stages: which content is available (moderation), how content is selected and personalized (ranking), and content presentation and controls (user interface). Empirical studies of online conflict suggest that the exposure diversity intervention proposed as an antidote to "filter bubbles" can be improved and can even worsen polarization under some conditions. Using civility metrics in conjunction with diversity in content selection may be more effective. However, diversity-based interventions have not been tested at scale and may not work in the diverse and dynamic contexts of real platforms. Instead, intervening in platform polarization dynamics will likely require continuous monitoring of polarization metrics, such as the widely used "feeling thermometer." These metrics can be used to evaluate product features, and potentially engineered as algorithmic objectives. It may further prove necessary to include polarization measures in the objective functions of recommender algorithms to prevent optimization processes from creating conflict as a side effect.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jul 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 5; 2025: 0; 2026: 1.
11 papers.
- 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systemscited by 94
- 2022Estimating and Penalizing Induced Preference Shifts in Recommender Systemscited by 29
- 2024Reranking partisan animosity in algorithmic social media feeds alters affective polarizationcited by 7
- 2024AI and the Future of Digital Public Squarescited by 6
- 2022Manifestations of Xenophobia in AI Systemscited by 4
- 2024Recommender Systems for Good (RS4Good): Survey of Use Cases and a Call to Action for Research that Matterscited by 2
- 2023Measuring and Controlling Divisiveness in Rank Aggregationcited by 1
- 2024Content-Agnostic Moderation for Stance-Neutral Recommendationcited by 1
- 2022Explicit User Manipulation in Reinforcement Learning Based Recommender Systemscited by 0
- 2023All Polarized but Still Different: a Multi-factorial Metric to Discriminate between Polarization Behaviors on Social Mediacited by 0
- 2026LLM-Assisted Reranking to Operationalize Nuanced Objectives in Recommender Systemscited by 0
- 2026LLM-Assisted Reranking to Operationalize Nuanced Objectives in Recommender Systems1 Jun 2026
- 2024AI and the Future of Digital Public Squares13 Dec 2024
- 2024Recommender Systems for Good (RS4Good): Survey of Use Cases and a Call to Action for Research that Matters25 Nov 2024
- 2024Reranking partisan animosity in algorithmic social media feeds alters affective polarization22 Nov 2024
- 2024Content-Agnostic Moderation for Stance-Neutral Recommendation29 May 2024
- 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems10 May 2024
- 2023All Polarized but Still Different: a Multi-factorial Metric to Discriminate between Polarization Behaviors on Social Media7 Dec 2023
- 2023Measuring and Controlling Divisiveness in Rank Aggregation14 Jun 2023
- 2022Manifestations of Xenophobia in AI Systems15 Dec 2022
- 2022Estimating and Penalizing Induced Preference Shifts in Recommender Systems25 Apr 2022
- 2022Explicit User Manipulation in Reinforcement Learning Based Recommender Systems20 Mar 2022