mlsanityData to 7 Oct 2026

Making Dialogue Grounding Data Rich: A Three-Tier Data Synthesis Framework for Generalized Referring Expression Comprehension

arXiv 2512.02791 ↗First posted 2 Dec 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Dialogue-Based Generalized Referring Expression Comprehension (GREC) requires models to ground the expression and unlimited targets in complex visual scenes while resolving coreference across a long dialogue context. However, existing systems struggle under distribution shift between training and evaluation domains, a gap exacerbated by the scarcity of annotated dialogue grounding data. We address this challenge with a three-tier data-synthesis method that balances realism and controllability to produce scalable supervision for dialogue-conditioned grounding. Fine-tuning on the synthesized data yields consistent, substantial improvements over prior approaches across standard evaluation metrics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 27 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

18 of 27 references.

References · 18

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  2. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,352
  3. 2016Modeling Context in Referring Expressionscited by 1,054
  4. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
  5. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  6. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 724
  7. 2018MAttNet: Modular Attention Network for Referring Expression Comprehensioncited by 427
  8. 2019CLEVR-Ref+: Diagnosing Visual Reasoning with Referring Expressionscited by 73
  9. 2024MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMscited by 72
  10. 2023Jack of All Tasks, Master of Many: Designing General-purpose Coarse-to-Fine Vision-Language Modelcited by 52
  11. 2020Cops-Ref: A new Dataset and Task on Compositional Referring Expression Comprehensioncited by 50
  12. 2023GREC: Generalized Referring Expression Comprehensioncited by 39
6 more
  1. 2022Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 2021cited by 23
  2. 2019What You See is What You Get: Visual Pronoun Coreference Resolution in Dialoguescited by 18
  3. 2023Advancing Visual Grounding with Scene Knowledge: Benchmark and Methodcited by 17
  4. 2020Give Me Something to Eat: Referring Expression Comprehension with Commonsense Knowledgecited by 9
  5. 2024Harlequin: Color-driven Generation of Synthetic Data for Referring Expression Comprehensioncited by 3
  6. 2025MDC-R: The Minecraft Dialogue Corpus with Referencecited by 2

Built on by

Not cited yet.