mlsanityData to 7 Oct 2026

RoboICL: Embodied In-Context Learning with GPT-6 Astra

arXiv 2609.34261 ↗First posted 28 Sep 2026cs.RO cs.LGcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

General-purpose vision-language models offer a promising way to zero-shot robot control: gptastra excels at open-ended and language- or image-conditioned manipulation but remains substantially weaker on high-precision and long-horizon tasks. We introduce RoboICL, an in-context robot-control framework that narrows these gaps without robot-specific parameter updates or a learned VLA. RoboICL separates demonstration context, which provides recorded examples when available, from interaction memory, which accumulates the model's own actions and observed outcomes. Both use a shared observation--action--receipt--observation grammar. To preserve experience across task stages, RoboICL combines sampled demonstration blocks with bounded anchored memory. Fixed anchors keep earlier rollout interactions available for in-context learning, while the latest interaction supports immediate error correction. Across 30 RoboDojo tasks, using zero shot for Open and one demonstration elsewhere, RoboICL improves on official zero-shot gptastra by 20--27 progress-score points in every category. It leads the leaderboard baselines on Memory and Open, achieves comparable performance to the strongest Precision baseline, and remains competitive on Long-Horizon. Its 30-task Overall score is 50.64, versus 33.68 for the strongest baseline. On a separate ten-task subset, RoboICL scores 60.60, within 2.00 points of the π0.5 + gptastra hybrid approach. On three real-robot tasks, mean progress rises from 14.45 at zero shot to 63.33 at one shot and 78.89 at three shots. On two development tasks, optional Jev-gated action reuse reduces gptastra calls by 33--48%. Code is available at hrefhttps://github.com/Mosi-AI/RoboICLhttps://github.com/Mosi-AI/RoboICL.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 22 of its 27 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

22 of 27 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Show-Harness: Just a VLM Agent Can Play Robots9 Sep

Other references · 21

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  6. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  7. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
  8. 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 657
  9. 2017One-Shot Imitation Learningcited by 232
  10. 2024Keypoint Action Tokens Enable In-Context Imitation Learning in Roboticscited by 71
  11. 2024In-Context Imitation Learning via Next-Token Predictioncited by 65
  12. 2024Instant Policy: In-Context Imitation Learning via Graph Diffusioncited by 38
9 more
  1. 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policiescited by 35
  2. 2024In-Context Learning Enables Robot Action Prediction in LLMscited by 25
  3. 2025RICL: Adding In-Context Adaptability to Pre-Trained Vision-Language-Action Modelscited by 19
  4. 2026G0.5: One Autoregressive Stream for Robot Reasoning and Actioncited by 17
  5. 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalizationcited by 8
  6. 2026An Unexpected Robot Policy: Early Evaluations of GPT-6 Astra on RoboDojo and Beyondcited by 8
  7. 2026In-Context Robot Learning with VLM Agentscited by 4
  8. 2026Reflective VLA: In-Context Action Consequences Make VLAs Generalizecited by 1
  9. 2026Zeva: In-Context Causal Learning for Generalizable Embodied Manipulationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transfer
  2. 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructions
  3. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation
  4. 2026RDT2: Exploring the Scaling Limit of UMI Data Towards Zero-Shot Cross-Embodiment Generalization
  5. 2025RoboBERT: An End-to-end Multimodal Robotic Manipulation Model
  6. 2026RoboTTT: Context Scaling for Robot Policies
  7. 2026RoboInter: A Holistic Intermediate Representation Suite Towards Robotic Manipulation
  8. 2026RoboMME: Benchmarking and Understanding Memory for Robotic Generalist Policies