mlsanityData to 7 Oct 2026

On the Importance of Karaka Framework in Multi-modal Grounding

arXiv 2204.04347 ↗First posted 9 Apr 2022cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Computational Paninian Grammar model helps in decoding a natural language expression as a series of modifier-modified relations and therefore facilitates in identifying dependency relations closer to language (context) semantics compared to the usual Stanford dependency relations. However, the importance of this CPG dependency scheme has not been studied in the context of multi-modal vision and language applications. At IIIT Hyderabad, we plan to perform a novel study to explore the potential advantages and disadvantages of CPG framework in a vision-language navigation task setting, a popular and challenging multi-modal grounding task.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 28 references that are in the map. First posted on arXiv 9 Apr 2022.

Builds on

11 of 28 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015VQA: Visual Question Answeringcited by 2,489
  3. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  4. 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 337
  5. 2021Episodic Transformer for Vision-and-Language Navigationcited by 155
  6. 2020Diagnosing the Environment Bias in Vision-and-Language Navigationcited by 41
  7. 2021Diagnosing Vision-and-Language Navigation: What Really Matterscited by 36
  8. 2019Natural Language Interaction with Explainable AI Modelscited by 8
  9. 2019X-ToM: Explaining with Theory-of-Mind for Gaining Justified Human Trustcited by 8
  10. 2022Effective Representation to Capture Collaboration Behaviors between Explainer and Usercited by 4
  11. 2022Question Generation for Evaluating Cross-Dataset Shifts in Multi-modal Groundingcited by 3

Built on by

Not cited yet.