mlsanityData to 7 Oct 2026

SHARP: Unlocking Interactive Hallucination via Stance Transfer in Role-Playing LLMs

arXiv 2411.07965 ↗First posted 12 Nov 2024cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

The advanced role-playing capabilities of Large Language Models (LLMs) have enabled rich interactive scenarios, yet existing research in social interactions neglects hallucination while struggling with poor generalizability and implicit character fidelity judgments. To bridge this gap, motivated by human behaviour, we introduce a generalizable and explicit paradigm for uncovering interactive patterns of LLMs across diverse worldviews. Specifically, we first define interactive hallucination through stance transfer, then construct SHARP, a benchmark built by extracting relations from commonsense knowledge graphs and utilizing LLMs' inherent hallucination properties to simulate multi-role interactions. Extensive experiments confirm our paradigm's effectiveness and stability, examine the factors that influence these metrics, and challenge conventional hallucination mitigation solutions. More broadly, our work reveals a fundamental limitation in popular post-training methods for role-playing LLMs: the tendency to obscure knowledge beneath style, resulting in monotonous yet human-like behaviors - interactive hallucination.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 63 references that are in the map. First posted on arXiv 12 Nov 2024.

Builds on

35 of 63 references.

References · 35

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2024Qwen2 Technical Reportcited by 2,076
  5. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  6. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  7. 2023LIMA: Less Is More for Alignmentcited by 1,080
  8. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  9. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  10. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  11. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
  12. 2022A Survey on In-context Learningcited by 717
23 more
  1. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  2. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  3. 2018AI safety via debatecited by 384
  4. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
  5. 2024Self-Preference Bias in LLM-as-a-Judgecited by 248
  6. 2024Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?cited by 227
  7. 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 220
  8. 2023Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMscited by 175
  9. 2024CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluationcited by 139
  10. 2024Analyzing the Generalization and Reliability of Steering Vectorscited by 130
  11. 2024Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignmentcited by 104
  12. 2023Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysiscited by 91
  13. 2022How would Stance Detection Techniques Evolve after the Launch of ChatGPT?cited by 76
  14. 2024Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agentcited by 52
  15. 2024From Yes-Men to Truth-Tellers: Addressing Sycophancy in Large Language Models with Pinpoint Tuningcited by 51
  16. 2024From Role-Play to Drama-Interaction: An LLM Solutioncited by 42
  17. 2024Understanding Finetuning for Factual Knowledge Extractioncited by 31
  18. 2024Prompt Leakage effect and defense strategies for multi-turn LLM interactionscited by 23
  19. 2024Mitigating Hallucination in Fictional Character Role-Playcited by 17
  20. 2023Building Persona Consistent Dialogue Agents with Offline Reinforcement Learningcited by 13
  21. 2024Self-Prompt Tuning: Enable Autonomous Role-Playing in LLMscited by 12
  22. 2023PIPPA: A Partially Synthetic Conversational Datasetcited by 6
  23. 2024Stance Detection on Social Media with Fine-Tuned Large Language Modelscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.