Making Dialogue Grounding Data Rich: A Three-Tier Data Synthesis Framework for Generalized Referring Expression Comprehension
Not on the map. Why?
Abstract (arXiv)
Dialogue-Based Generalized Referring Expression Comprehension (GREC) requires models to ground the expression and unlimited targets in complex visual scenes while resolving coreference across a long dialogue context. However, existing systems struggle under distribution shift between training and evaluation domains, a gap exacerbated by the scarcity of annotated dialogue grounding data. We address this challenge with a three-tier data-synthesis method that balances realism and controllability to produce scalable supervision for dialogue-conditioned grounding. Fine-tuning on the synthesized data yields consistent, substantial improvements over prior approaches across standard evaluation metrics.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 27 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
18 of 27 references.
References · 18
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,352
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 724
- 2018MAttNet: Modular Attention Network for Referring Expression Comprehensioncited by 427
- 2019CLEVR-Ref+: Diagnosing Visual Reasoning with Referring Expressionscited by 73
- 2024MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMscited by 72
- 2023Jack of All Tasks, Master of Many: Designing General-purpose Coarse-to-Fine Vision-Language Modelcited by 52
- 2020Cops-Ref: A new Dataset and Task on Compositional Referring Expression Comprehensioncited by 50
- 2023GREC: Generalized Referring Expression Comprehensioncited by 39
6 more
- 2022Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 2021cited by 23
- 2019What You See is What You Get: Visual Pronoun Coreference Resolution in Dialoguescited by 18
- 2023Advancing Visual Grounding with Scene Knowledge: Benchmark and Methodcited by 17
- 2020Give Me Something to Eat: Referring Expression Comprehension with Commonsense Knowledgecited by 9
- 2024Harlequin: Color-driven Generation of Synthetic Data for Referring Expression Comprehensioncited by 3
- 2025MDC-R: The Minecraft Dialogue Corpus with Referencecited by 2
Built on by
Not cited yet.