mlsanityData to 7 Oct 2026

Deep Reinforcement Learning for Mention-Ranking Coreference Models

arXiv 1609.08667 ↗First posted 27 Sep 2016cs.CLcited by 63

Not on the map. Why?

Abstract (arXiv)

Coreference resolution systems are typically trained with heuristic loss functions that require careful tuning. In this paper we instead apply reinforcement learning to directly optimize a neural mention-ranking model for coreference evaluation metrics. We experiment with two approaches: the REINFORCE policy gradient algorithm and a reward-rescaled max-margin objective. We find the latter to be more effective, resulting in significant improvements over the current state-of-the-art on the English and Chinese portions of the CoNLL 2012 Shared Task.

Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Sep 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 29; 2022: 14; 2023: 10; 2024: 6; 2025: 3; 2026: 1.

63 papers.

Sort:

By area:

  1. 2021GenIE: Generative Information Extractioncited by 53
  2. 2023VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolutioncited by 52
  3. 2024CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreferencecited by 51
  4. 2021ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collectionscited by 30
  5. 2021Automatic Story Generation: Challenges and Attemptscited by 28
  6. 2022Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Surveycited by 21
  7. 2021Moving on from OntoNotes: Coreference Resolution Model Transfercited by 18
  8. 2021OntoGUM: Evaluating Contextualized SOTA Coreference Resolution on 12 More Genrescited by 18
  9. 2021Towards Socially Intelligent Agents with Mental State Transition and Human Utilitycited by 14
  10. 2021CREAD: Combined Resolution of Ellipses and Anaphora in Dialoguescited by 13
  11. 2022Machine Reading, Fast and Slow: When Do Models "Understand" Language?cited by 13
  12. 2021Sequential Cross-Document Coreference Resolutioncited by 12
38 more
  1. 2021To Protect and To Serve? Analyzing Entity-Centric Framing of Police Violencecited by 12
  2. 2022Discovering Differences in the Representation of People using Contextualized Semantic Axescited by 12
  3. 2023AmbiCoref: Evaluating Human and Model Sensitivity to Ambiguous Coreferencecited by 12
  4. 2021Learning Reasoning Paths over Semantic Graphs for Video-grounded Dialoguescited by 11
  5. 2021VGNMN: Video-grounded Neural Module Network to Video-Grounded Language Taskscited by 11
  6. 2021A Survey on Deep Reinforcement Learning for Data Processing and Analyticscited by 10
  7. 2022DEArt: Dataset of European Artcited by 9
  8. 2024[Lions: 1] and [Tigers: 2] and [Bears: 3], Oh My! Literary Coreference Annotation with LLMscited by 8
  9. 2021Reinforcement Learning based Collective Entity Alignment with Adaptive Featurescited by 7
  10. 2021End-to-end Neural Coreference Resolution Revisited: A Simple yet Effective Baselinecited by 7
  11. 2022The Dialog Must Go On: Improving Visual Dialog via Generative Self-Trainingcited by 7
  12. 2023FRAMM: Fair Ranking with Missing Modalities for Clinical Trial Site Selectioncited by 6
  13. 2021Proto: A Neural Cocktail for Generating Appealing Conversationscited by 5
  14. 2021Better Call the Plumber: Orchestrating Dynamic Information Extraction Pipelinescited by 4
  15. 2021Can we Fix the Scope for Coreference? Problems and Solutions for Benchmarks beyond OntoNotescited by 4
  16. 2022Stylized Knowledge-Grounded Dialogue Generation via Disentangled Template Rewritingcited by 4
  17. 2022The KITMUS Test: Evaluating Knowledge Integration from Multiple Sources in Natural Language Understanding Systemscited by 4
  18. 2023A Case Study for Compliance as Code with Graphs and Language Models: Public release of the Regulatory Knowledge Graphcited by 4
  19. 2021Stay Together: A System for Single and Split-antecedent Anaphora Resolutioncited by 3
  20. 2021Anatomy of OntoGUM--Adapting GUM to the OntoNotes Scheme to Evaluate Robustness of SOTA Coreference Algorithmscited by 3
  21. 2025Coreference Resolution for Vietnamese Narrative Textscited by 3
  22. 2026See Further, Think Deeper: Advancing VLM's Reasoning Ability with Low-level Visual Cues and Reflectioncited by 3
  23. 2021Situation and Behavior Understanding by Trope Detection on Filmscited by 2
  24. 2021A Coarse to Fine Question Answering System based on Reinforcement Learningcited by 2
  25. 2021C3: Compositional Counterfactual Contrastive Learning for Video-grounded Dialoguescited by 2
  26. 2022Knowledge is Power: Understanding Causality Makes Legal judgment Prediction Models More Generalizable and Robustcited by 2
  27. 2022VER: Unifying Verbalizing Entities and Relationscited by 2
  28. 2023PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corporacited by 2
  29. 2021Secure Bayesian Federated Analytics for Privacy-Preserving Trend Detectioncited by 1
  30. 2021MAIR: Framework for mining relationships between research articles, strategies, and regulations in the field of explainable artificial intelligencecited by 1
  31. 2021Knowledge-Grounded Dialogue with Reward-Driven Knowledge Selectioncited by 1
  32. 2021Newsalyze: Effective Communication of Person-Targeting Biases in News Articlescited by 1
  33. 2022Hybrid Rule-Neural Coreference Resolution System based on Actor-Critic Learningcited by 1
  34. 2023Spelling convention sensitivity in neural language modelscited by 1
  35. 2023Radar de Parit'e: An NLP system to measure gender representation in French news storiescited by 1
  36. 2023Towards Transparency in Coreference Resolution: A Quantum-Inspired Approachcited by 1
  37. 2024Asking and Answering Questions to Extract Event-Argument Structurescited by 1
  38. 2021Coreference Resolution: Are the eliminated spans totally worthless?cited by 0

50 most cited of 63 All 63 (JSON)