mlsanityData to 14 Oct 2026

Bootstrapping Human-Like Planning via LLMs

arXiv 2506.22604 ↗First posted 27 Jun 2025cs.AI cs.HC cs.ROcited by 0

On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents

Abstract (arXiv)

Robot end users increasingly require accessible means of specifying tasks for robots to perform. Two common end-user programming paradigms include drag-and-drop interfaces and natural language programming. Although natural language interfaces harness an intuitive form of human communication, drag-and-drop interfaces enable users to meticulously and precisely dictate the key actions of the robot's task. In this paper, we investigate the degree to which both approaches can be combined. Specifically, we construct a large language model (LLM)-based pipeline that accepts natural language as input and produces human-like action sequences as output, specified at a level of granularity that a human would produce. We then compare these generated action sequences to another dataset of hand-specified action sequences. Although our results reveal that larger models tend to outperform smaller ones in the production of human-like action sequences, smaller models nonetheless achieve satisfactory performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 13 of its 36 references that are in the map. First posted on arXiv 27 Jun 2025.

Builds on

13 of 36 references.

References · 13

  1. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  2. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  3. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  4. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 462
  5. 2018VirtualHome: Simulating Household Activities via Programscited by 415
  6. 2023Generalized Planning in PDDL Domains with Pretrained Large Language Modelscited by 139
  7. 2017Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciencescited by 85
  8. 2024Planning in Strawberry Fields: Evaluating and Improving the Planning and Scheduling Capabilities of LRM o1cited by 17
  9. 2024Cocobo: Exploring Large Language Models as the Engine for End-User Robot Programmingcited by 6
  10. 2024Goal-Oriented End-User Programming of Robotscited by 3
  11. 2021Situated Live Programming for Human-Robot Collaborationcited by 1
  12. 2024Crowdsourcing Task Traces for Service Roboticscited by 1
1 more
  1. 2025ImageInThat: Manipulating Images to Convey User Instructions to Robotscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Reshaping Robot Trajectories Using Natural Language Commands: A Study of Multi-Modal Data Alignment Using Transformers
  2. 2025AuDeRe: Automated Strategy Decision and Realization in Robot Planning and Control via LLMs
  3. 2025Can LLM-Reasoning Models Replace Classical Planning? A Benchmark Study
  4. 2024Natural Language as Policies: Reasoning for Coordinate-Level Embodied Control with LLMs
  5. 2025A Systematic Study of Large Language Models for Task and Motion Planning With PDDLStream
  6. 2026STEP: State-Aware Task Estimation and Planning with Multi-Modal LLMs for Human-Robot Collaboration
  7. 2025RoboInspector: Unveiling the Unreliability of Policy Code for LLM-enabled Robotic Manipulation
  8. 2025Distilling On-device Language Models for Robot Planning with Minimal Human Intervention