Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Community
Not on the map. Why?
Abstract (arXiv)
The ability to interact with machines using natural human language is becoming not just commonplace, but expected. The next step is not just text interfaces, but speech interfaces and not just with computers, but with all machines including robots. In this paper, we chronicle the recent history of this growing field of spoken dialogue with robots and offer the community three proposals, the first focused on education, the second on benchmarks, and the third on the modeling of language when it comes to spoken interaction with robots. The three proposals should act as white papers for any researcher to take and build upon.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 48 references that are in the map. First posted on arXiv 1 Apr 2024.
Builds on
32 of 48 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2015VQA: Visual Question Answeringcited by 2,489
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2016Visual Dialogcited by 377
20 more
- 2021An Empirical Study of Training End-to-End Vision-and-Language Transformerscited by 271
- 2021What Will it Take to Fix Benchmarking in Natural Language Understanding?cited by 200
- 2021TEACh: Task-driven Embodied Agents that Chatcited by 194
- 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 166
- 2023Physically Grounded Vision-Language Models for Robotic Manipulationcited by 163
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
- 2021FILM: Following Instructions in Language with Modular Methodscited by 119
- 2023ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalitiescited by 117
- 2021Including Signed Languages in Natural Language Processingcited by 67
- 2022APPDIA: A Discourse-aware Transformer-based Style Transfer Model for Offensive Social Media Conversationscited by 23
- 2023Alexa Arena: A User-Centric Interactive Platform for Embodied AIcited by 18
- 2021Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLUcited by 16
- 2023DisCGen: A Framework for Discourse-Informed Counterspeech Generationcited by 14
- 2022Including Facial Expressions in Contextual Embeddings for Sign Language Generationcited by 12
- 2023D-CALM: A Dynamic Clustering-based Active Learning Approach for Mitigating Biascited by 12
- 2023Learning to Generate Equitable Text in Dialogue from Biased Training Datacited by 12
- 2022Modeling Intensification for Sign Language Generation: A Computational Approachcited by 9
- 2022LEATHER: A Framework for Learning to Generate Human-like Text in Dialoguecited by 4
- 2020Report from the NSF Future Directions Workshop, Toward User-Oriented Agents: Research Directions and Challengescited by 3
- 2021The State of SLIVAR: What's next for robots, human-robot interaction, and (spoken) dialogue systems?cited by 1
Built on by
Not cited yet.