IRC-Bench: Recognizing Entities from Contextual Cues in First-Person Reminiscences
Not on the map. Why?
Abstract (arXiv)
When people recount personal memories, they often refer to people, places, and events indirectly, relying on con-textual cues rather than explicit names. Such implicit references are central to reminiscence narratives: first-person accounts of lived experience used in therapeutic, archival, and social settings. They pose a difficult computational problem because the intended entity must be inferred from dispersed narrative evidence rather than from a local mention. We introduce IRC-Bench, the Implicit Reminiscence Context Benchmark, for evaluating implicit entity recognition in reminiscence transcripts. The benchmark targets non-locality: entity-identifying cues are distributed across multiple, non-contiguous clauses, unlike named entity recognition, entity linking, or coreference resolution. IRC-Bench comprises 25,136 samples constructed from 12,337 Wikidata-linked entities across 1,994 transcripts spanning 11 thematic domains. Each sample pairs an Entity-Grounded Narrative, in which the target entity is ex-plicitly mentioned, with an Entity-Elided Narrative, in which direct mentions are removed. We evaluate 19 config-urations across LLM generation, dense retrieval, RAG, and fine-tuning. QLoRA-adapted Llama 3.1 8B performs best in the open-world setting (38.94% exact match; 51.59% Jaccard), while fine-tuned DPR leads closed-world retrieval (35.38% Hit@1; 71.49% Hit@10). We release IRC-Bench with data, code, and evaluation tools.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 53 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
34 of 53 references.
References · 34
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024GPT-4o System Cardcited by 4,588
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
22 more
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
- 2016Neural Architectures for Named Entity Recognitioncited by 550
- 2020Autoregressive Entity Retrievalcited by 334
- 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
- 2017End-to-end Neural Coreference Resolutioncited by 241
- 2024BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystackcited by 215
- 2025NoLiMa: Long-Context Evaluation Beyond Literal Matchingcited by 126
- 2021Unified Named Entity Recognition as Word-Word Relation Classificationcited by 90
- 2018End-to-End Neural Entity Linkingcited by 85
- 2017Deep Joint Entity Disambiguation with Local Neural Attentioncited by 79
- 2022ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linkingcited by 74
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 72
- 2023Empirical Study of Zero-Shot NER with ChatGPTcited by 60
- 2020Entity Linking in 100 Languagescited by 52
- 2023PromptNER: Prompting For Named Entity Recognitioncited by 35
- 2022MultiCoNER: A Large-scale Multilingual dataset for Complex Named Entity Recognitioncited by 19
- 2024LLMAEL: Large Language Models are Good Context Augmenters for Entity Linkingcited by 19
- 2020Bridging Anaphora Resolution as Question Answeringcited by 14
- 2024ChatEL: Entity Linking with Chatbotscited by 8
- 2018Smart Conversational Agents for Reminiscencecited by 3
- 2024Speech Technology Services for Oral History Researchcited by 2
- 2025Large Language Models for Oral History Understanding with Text Classification and Sentiment Analysiscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026KnowMe-Bench: Benchmarking Person Understanding for Lifelong Digital Companions
- 2026To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archives
- 2026Emotion-Attended Stateful Memory (EASM):The Architecture for Hyper-Personalization at Scale
- 2026Narrative World Model: Narratology-Grounded Writer Memory for Long-Form Fiction
- 2023M-SENSE: Modeling Narrative Structure in Short Personal Narratives Using Protagonist's Mental Representations
- 2026PRAGMA: Evaluating Personalized Guidance with Memory Alignment in Lifelong Conversations
- 2025ADAM: A Diverse Archive of Mankind for Evaluating and Enhancing LLMs in Biographical Reasoning
- 2026Have You Ever Seen Them? Entity-level Membership Inference through Interrogating Large Language Models