mlsanityData to 7 Oct 2026

History for Visual Dialog: Do we really need it?

arXiv 2005.07493 ↗First posted 8 May 2020cs.CV cs.AI cs.CLcited by 32

Not on the map. Why?

Abstract (arXiv)

Visual Dialog involves "understanding" the dialog history (what has been discussed previously) and the current question (what is asked), in addition to grounding information in the image, to generate the correct response. In this paper, we show that co-attention models which explicitly encode dialog history outperform models that don't, achieving state-of-the-art performance (72 % NDCG on val set). However, we also expose shortcomings of the crowd-sourcing dataset collection procedure by showing that history is indeed only required for a small amount of the data and that the current evaluation metric encourages generic replies. To that end, we propose a challenging subset (VisDialConv) of the VisDial val set and provide a benchmark of 63% NDCG.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 11; 2022: 11; 2023: 4; 2024: 4; 2025: 1; 2026: 1.

32 papers.

Sort:

By area:

  1. 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
  2. 2022META-GUI: Towards Multi-modal Conversational Agents on Mobile GUIcited by 81
  3. 2021Anticipating Safety Issues in E2E Conversational AI: Framework and Toolingcited by 77
  4. 2021Multimodal Dialogue Response Generationcited by 32
  5. 2022UTC: A Unified Transformer with Inter-Task Contrastive Learning for Visual Dialogcited by 19
  6. 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
  7. 2021GoG: Relation-aware Graph-over-Graph Network for Visual Dialogcited by 13
  8. 2021Multimodal Incremental Transformer with Visual Grounding for Visual Dialogue Generationcited by 11
  9. 2021Learning to Ground Visual Objects for Visual Dialogcited by 10
  10. 2024Voices in a Crowd: Searching for Clusters of Unique Perspectivescited by 9
  11. 2022The Dialog Must Go On: Improving Visual Dialog via Generative Self-Trainingcited by 7
  12. 2022VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolutioncited by 7
20 more
  1. 2022Going for GOAL: A Resource for Grounded Football Commentariescited by 7
  2. 2024A Gaze-grounded Visual Question Answering Dataset for Clarifying Ambiguous Japanese Questionscited by 7
  3. 2021Saying the Unseen: Video Descriptions via Dialog Agentscited by 5
  4. 2021Enhancing Visual Dialog Questioner with Entity-based Strategy Learning and Augmented Guessercited by 5
  5. 2022Improving Cross-Modal Understanding in Visual Dialog via Contrastive Learningcited by 5
  6. 2022Unified Multimodal Model with Unlikelihood Training for Visual Dialogcited by 5
  7. 2023Resolving References in Visually-Grounded Dialogue via Text Generationcited by 5
  8. 2022Reasoning with Multi-Structure Commonsense Knowledge in Visual Dialogcited by 4
  9. 2022DC-MBR: Distributional Cooling for Minimum Bayesian Risk Decodingcited by 4
  10. 2023mathbbVD-mathbbGR: Boosting mathbbVisual mathbbDialog with Cascaded Spatial-Temporal Multi-Modal mathbbGRaphscited by 4
  11. 2023'What are you referring to?' Evaluating the Ability of Multi-Modal Dialogue Models to Process Clarificational Exchangescited by 3
  12. 2024Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Modelscited by 3
  13. 2021Digging Errors in NMT: Evaluating and Understanding Model Errors from Partial Hypothesis Spacecited by 2
  14. 2021Modeling Explicit Concerning States for Reinforcement Learning in Visual Dialoguecited by 2
  15. 2022Can Visual Dialogue Models Do Scorekeeping? Exploring How Dialogue Representations Incrementally Encode Shared Knowledgecited by 2
  16. 2023Collecting Visually-Grounded Dialogue with A Game Of Sortscited by 1
  17. 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotationcited by 1
  18. 2022Adversarial Robustness of Visual Dialogcited by 0
  19. 2024Enhancing Visual Dialog State Tracking through Iterative Object-Entity Alignment in Multi-Round Conversationscited by 0
  20. 2025A Framework for Generating Artificial Datasets to Validate Absolute and Relative Position Conceptscited by 0