mlsanityData to 7 Oct 2026

Natural Language for Human-Robot Collaboration: Problems Beyond Language Grounding

arXiv 2110.04441 ↗First posted 9 Oct 2021cs.AI cs.CL cs.ROcited by 5

Not on the map. Why?

Abstract (arXiv)

To enable robots to instruct humans in collaborations, we identify several aspects of language processing that are not commonly studied in this context. These include location, planning, and generation. We suggest evaluations for each task, offer baselines for simple methods, and close by discussing challenges and opportunities in studying language for collaboration.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 9 Oct 2021.

Builds on

17 of 25 references.

References · 17

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  5. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  6. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
  7. 2018On Evaluation of Embodied Navigation Agentscited by 526
  8. 2018Stacked Cross Attention for Image-Text Matchingcited by 414
  9. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
  10. 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 337
  11. 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 304
  12. 2016Image Captioning with Semantic Attentioncited by 260
5 more
  1. 2020Improving Vision-and-Language Navigation with Image-Text Pairs from the Webcited by 177
  2. 2021On the Evaluation of Vision-and-Language Navigation Instructionscited by 45
  3. 2021Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Informationcited by 31
  4. 2020The RobotSlang Benchmark: Dialog-guided Robot Localization and Navigationcited by 26
  5. 2016Navigational Instruction Generation as Inverse Reinforcement Learning with Neural Machine Translationcited by 12

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 1; 2024: 3.

5 papers.

  1. 2023Mask Grounding for Referring Image Segmentationcited by 40
  2. 2022CoupAlign: Coupling Word-Pixel with Sentence-Mask Alignments for Referring Image Segmentationcited by 28
  3. 2024PREDILECT: Preferences Delineated with Zero-Shot Language-based Reasoning in Reinforcement Learningcited by 8
  4. 2024Semantic Map-based Generation of Navigation Instructionscited by 6
  5. 2024Adapting Vision-Language Model with Fine-grained Semantics for Open-Vocabulary Segmentationcited by 0