Explaining Search Result Stances to Opinionated People
Not on the map. Why?
Abstract (arXiv)
People use web search engines to find information before forming opinions, which can lead to practical decisions with different levels of impact. The cognitive effort of search can leave opinionated users vulnerable to cognitive biases, e.g., the confirmation bias. In this paper, we investigate whether stance labels and their explanations can help users consume more diverse search results. We automatically classify and label search results on three topics (i.e., intellectual property rights, school uniforms, and atheism) as against, neutral, and in favor, and generate explanations for these labels. In a user study (N =203), we then investigate whether search result stance bias (balanced vs biased) and the level of explanation (plain text, label only, label and explanation) influence the diversity of search results clicked. We find that stance labels and explanations lead to a more diverse search result consumption. However, we do not find evidence for systematic opinion change among users in this context. We believe these results can help designers of search engines to make more informed design decisions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 53 references that are in the map. First posted on arXiv 15 Sep 2023.
Builds on
21 of 53 references.
References · 21
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 155
- 2020Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representationscited by 97
- 2016Stance Detection with Bidirectional Conditional Encodingcited by 93
- 2020Stance Detection on Social Media: State of the Art and Trendscited by 93
- 2016Measuring Fairness in Ranked Outputscited by 81
- 2018A Retrospective Analysis of the Fake News Challenge Stance Detection Taskcited by 49
- 2018Cross-Target Stance Classification with Self-Attention Networkscited by 40
- 2021Fairness in Ranking: A Surveycited by 33
- 2021Explainable AI: current status and future directionscited by 32
9 more
- 2021Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-Trainingcited by 28
- 2019Your Stance is Exposed! Analysing Possible Factors for Stance Detection on Social Mediacited by 18
- 2020Compositional and Lexical Semantics in RoBERTa, BERT and DistilBERT: A Case Study on CoQAcited by 12
- 2022Evaluation Metrics for Measuring Bias in Search Engine Resultscited by 12
- 2021Extractive Explanations for Interpretable Text Rankingcited by 9
- 2021Is Stance Detection Topic-Independent and Cross-topic Generalizable? -- A Reproduction Studycited by 9
- 2020Adapting Security Warnings to Counter Online Disinformationcited by 7
- 2020Exploiting stance hierarchies for cost-sensitive stance detection of Web documentscited by 1
- 2022A multi-model-based deep learning framework for short text multiclass classification with the imbalanced and extremely small data setcited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.