mlsanityData to 14 Oct 2026

Get the Ball Rolling: Alerting Autonomous Robots When to Help to Close the Healthcare Loop

arXiv 2311.02602 ↗First posted 5 Nov 2023cs.RO cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

To facilitate the advancement of research in healthcare robots without human intervention or commands, we introduce the Autonomous Helping Challenge, along with a crowd-sourcing large-scale dataset. The goal is to create healthcare robots that possess the ability to determine when assistance is necessary, generate useful sub-tasks to aid in planning, carry out these plans through a physical robot, and receive feedback from the environment in order to generate new tasks and continue the process. Besides the general challenge in open-ended scenarios, Autonomous Helping focuses on three specific challenges: autonomous task generation, the gap between the current scene and static commonsense, and the gap between language instruction and the real world. Additionally, we propose Helpy, a potential approach to close the healthcare loop in the learning-free setting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 46 references that are in the map. First posted on arXiv 5 Nov 2023.

Builds on

18 of 46 references.

References · 18

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  3. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  4. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  5. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  6. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
  7. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  8. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  9. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  10. 2018VirtualHome: Simulating Household Activities via Programscited by 415
  11. 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 221
  12. 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 150
6 more
  1. 2020Watch-And-Help: A Challenge for Social Perception and Human-AI Collaborationcited by 133
  2. 2021Skill Induction and Planning with Latent Languagecited by 99
  3. 2020In the Eye of the Beholder: Gaze and Actions in First Person Videocited by 69
  4. 2018Task Planning in Robotics: an Empirical Comparison of PDDL-based and ASP-based Systemscited by 40
  5. 2020Visually-Grounded Planning without Vision: Language Models Infer Detailed Plans from High-level Instructionscited by 36
  6. 2015BoWFire: Detection of Fire in Still Images by Integrating Pixel Color and Texture Analysiscited by 16

Built on by

Not cited yet.