mlsanityData to 14 Oct 2026

Conflicts in Texts: Data, Implications and Challenges

arXiv 2504.19472 ↗First posted 28 Apr 2025cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

As NLP models become increasingly integrated into real-world applications, it becomes clear that there is a need to address the fact that models often rely on and generate conflicting information. Conflicts could reflect the complexity of situations, changes that need to be explained and dealt with, difficulties in data annotation, and mistakes in generated outputs. In all cases, disregarding the conflicts in data could result in undesired behaviors of models and undermine NLP models' reliability and trustworthiness. This survey categorizes these conflicts into three key areas: (1) natural texts on the web, where factual inconsistencies, subjective biases, and multiple perspectives introduce contradictions; (2) human-annotated data, where annotator disagreements, mistakes, and societal biases impact model training; and (3) model interactions, where hallucinations and knowledge conflicts emerge during deployment. While prior work has addressed some of these conflicts in isolation, we unify them under the broader concept of conflicting information, analyze their implications, and discuss mitigation strategies. We highlight key challenges and future directions for developing conflict-aware NLP systems that can reason over and reconcile conflicting information more effectively.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 68 of its 110 references that are in the map. First posted on arXiv 28 Apr 2025.

Builds on

68 of 110 references.

References · 68

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  4. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  5. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  6. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
  7. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
  8. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 564
  9. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
  10. 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 390
  11. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 378
  12. 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 356
38 more
  1. 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 341
  2. 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 327
  3. 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 314
  4. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
  5. 2021Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metricscited by 287
  6. 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Modelscited by 283
  7. 2024Knowledge Conflicts for LLMs: A Surveycited by 283
  8. 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 264
  9. 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 257
  10. 2022RealTime QA: What's the Answer Right Now?cited by 244
  11. 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 230
  12. 2021The Curious Case of Hallucinations in Neural Machine Translationcited by 161
  13. 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 156
  14. 2021A Dataset for Answering Time-Sensitive Questionscited by 154
  15. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  16. 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
  17. 2022Rich Knowledge Sources Bring Complex Knowledge Conflicts: Recalibrating Models to Reflect Conflicting Evidencecited by 144
  18. 2024Investigating Cultural Alignment of Large Language Modelscited by 143
  19. 2021A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generationcited by 138
  20. 2021Q2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answeringcited by 132
  21. 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 126
  22. 2022DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answeringcited by 96
  23. 2021Time Waits for No One! Analysis and Challenges of Temporal Misalignmentcited by 91
  24. 2024What Evidence Do Language Models Find Convincing?cited by 75
  25. 2019Seeing Things from a Different Angle: Discovering Diverse Perspectives about Claimscited by 74
  26. 2023Mitigating Large Language Model Hallucinations via Autonomous Knowledge Graph-based Retrofittingcited by 70
  27. 2019In Plain Sight: Media Bias Through the Lens of Factual Reportingcited by 68
  28. 2023Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual Noisecited by 54
  29. 2023Everyone's Voice Matters: Quantifying Annotation Disagreement Using Demographic Informationcited by 52
  30. 2023When Do Annotator Demographics Matter? Measuring the Influence of Annotator Demographics with the POPQUORN Datasetcited by 52
  31. 2022POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detectioncited by 51
  32. 2023Do Large Language Models Know about Facts?cited by 51
  33. 2023Knowing What LLMs DO NOT Know: A Simple Yet Effective Self-Detection Methodcited by 51
  34. 2023GeoDE: a Geographically Diverse Evaluation Dataset for Object Recognitioncited by 50
  35. 2024Context-DPO: Aligning Language Models for Context-Faithfulnesscited by 50
  36. 2024Blinded by Generated Contexts: How Language Models Merge Generated and Retrieved Contexts When Knowledge Conflicts?cited by 48
  37. 2023BoardgameQA: A Dataset for Natural Language Reasoning with Contradictory Informationcited by 44
  38. 2021Attacking Open-domain Question Answering by Injecting Misinformationcited by 41

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.