Dynamic Entity Representations in Neural Language Models
Not on the map. Why?
Abstract (arXiv)
Understanding a long document requires tracking how entities are introduced and evolve over time. We present a new type of language model, EntityNLM, that can explicitly model entities, dynamically update their representations, and contextually generate their mentions. Our model is generative and flexible; it can model an arbitrary number of entities in context while generating each entity mention at an arbitrary length. In addition, it can be used for several different tasks such as language modeling, coreference resolution, and entity prediction. Experimental results with all these tasks demonstrate that our model consistently outperforms strong baselines and prior work.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 7; 2023: 3; 2024: 1; 2025: 1.
19 papers.
Sort:
By area:
- 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
- 2021Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extractioncited by 68
- 2023Entity Tracking in Language Modelscited by 44
- 2021Automatic Story Generation: Challenges and Attemptscited by 28
- 2022Relational Memory Augmented Language Modelscited by 24
- 2024Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?cited by 17
- 2022Persona-Guided Planning for Controlling the Protagonist's Persona in Story Generationcited by 15
- 2022Towards Coherent and Consistent Use of Entities in Narrative Generationcited by 10
- 2021Paired Examples as Indirect Supervision in Latent Decision Modelscited by 6
- 2022Generating Coherent Narratives by Learning Dynamic and Discrete Entity States with a Contrastive Frameworkcited by 6
- 2022Does Entity Abstraction Help Generative Transformers Reason?cited by 3
- 2023Weakly Supervised Reasoning by Neuro-Symbolic Approachescited by 3
7 more
- 2025Stick to Facts: Towards Fidelity-oriented Product Description Generationcited by 2
- 2021Changing the Narrative Perspective: From Deictic to Anaphoric Point of Viewcited by 1
- 2021Modeling Human Mental States with an Entity-based Narrative Graphcited by 1
- 2021Measuring Context-Word Biases in Lexical Semantic Datasetscited by 1
- 2023A Data Source for Reasoning Embodied Agentscited by 1
- 2021CoreLM: Coreference-aware Language Model Fine-Tuningcited by 0
- 2022A Benchmark for Understanding and Generating Dialogue between Characters in Storiescited by 0
- 2025Stick to Facts: Towards Fidelity-oriented Product Description Generation11 Mar 2025
- 2024Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?4 Apr 2024
- 2023Weakly Supervised Reasoning by Neuro-Symbolic Approaches19 Sep 2023
- 2023A Data Source for Reasoning Embodied Agents14 Sep 2023
- 2023Entity Tracking in Language Models3 May 2023
- 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs24 Oct 2022
- 2022A Benchmark for Understanding and Generating Dialogue between Characters in Stories18 Sep 2022
- 2022Generating Coherent Narratives by Learning Dynamic and Discrete Entity States with a Contrastive Framework8 Aug 2022
- 2022Persona-Guided Planning for Controlling the Protagonist's Persona in Story Generation22 Apr 2022
- 2022Towards Coherent and Consistent Use of Entities in Narrative Generation3 Feb 2022
- 2022Relational Memory Augmented Language Models24 Jan 2022
- 2022Does Entity Abstraction Help Generative Transformers Reason?5 Jan 2022
7 more
- 2021Measuring Context-Word Biases in Lexical Semantic Datasets13 Dec 2021
- 2021CoreLM: Coreference-aware Language Model Fine-Tuning4 Nov 2021
- 2021Modeling Human Mental States with an Entity-based Narrative Graph14 Apr 2021
- 2021Paired Examples as Indirect Supervision in Latent Decision Models5 Apr 2021
- 2021Changing the Narrative Perspective: From Deictic to Anaphoric Point of View6 Mar 2021
- 2021Automatic Story Generation: Challenges and Attempts25 Feb 2021
- 2021Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction20 Feb 2021
- 2021Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extractioncited by 68
- 2023Entity Tracking in Language Modelscited by 44
- 2021Automatic Story Generation: Challenges and Attemptscited by 28
- 2022Relational Memory Augmented Language Modelscited by 24
- 2022Persona-Guided Planning for Controlling the Protagonist's Persona in Story Generationcited by 15
- 2022Towards Coherent and Consistent Use of Entities in Narrative Generationcited by 10
- 2021Paired Examples as Indirect Supervision in Latent Decision Modelscited by 6
- 2022Generating Coherent Narratives by Learning Dynamic and Discrete Entity States with a Contrastive Frameworkcited by 6
- 2023Weakly Supervised Reasoning by Neuro-Symbolic Approachescited by 3
- 2025Stick to Facts: Towards Fidelity-oriented Product Description Generationcited by 2
- 2021Changing the Narrative Perspective: From Deictic to Anaphoric Point of Viewcited by 1
- 2021Modeling Human Mental States with an Entity-based Narrative Graphcited by 1
12 most cited of 15 All 15 (JSON)
- 2025Stick to Facts: Towards Fidelity-oriented Product Description Generation11 Mar 2025
- 2023Weakly Supervised Reasoning by Neuro-Symbolic Approaches19 Sep 2023
- 2023Entity Tracking in Language Models3 May 2023
- 2022A Benchmark for Understanding and Generating Dialogue between Characters in Stories18 Sep 2022
- 2022Generating Coherent Narratives by Learning Dynamic and Discrete Entity States with a Contrastive Framework8 Aug 2022
- 2022Persona-Guided Planning for Controlling the Protagonist's Persona in Story Generation22 Apr 2022
- 2022Towards Coherent and Consistent Use of Entities in Narrative Generation3 Feb 2022
- 2022Relational Memory Augmented Language Models24 Jan 2022
- 2021Measuring Context-Word Biases in Lexical Semantic Datasets13 Dec 2021
- 2021CoreLM: Coreference-aware Language Model Fine-Tuning4 Nov 2021
- 2021Modeling Human Mental States with an Entity-based Narrative Graph14 Apr 2021
- 2021Paired Examples as Indirect Supervision in Latent Decision Models5 Apr 2021
12 newest of 15 All 15 (JSON)