SlotVLA: Towards Modeling of Object-Relation Representations in Robotic Manipulation
Not on the map. Why?
Abstract (arXiv)
Inspired by how humans reason over discrete objects and their relationships, we explore whether compact object-centric and object-relation representations can form a foundation for multitask robotic manipulation. Most existing robotic multitask models rely on dense embeddings that entangle both object and background cues, raising concerns about both efficiency and interpretability. In contrast, we study object-relation-centric representations as a pathway to more structured, efficient, and explainable visuomotor control. Our contributions are two-fold. First, we introduce LIBERO+, a fine-grained benchmark dataset designed to enable and evaluate object-relation reasoning in robotic manipulation. Unlike prior datasets, LIBERO+ provides object-centric annotations that enrich demonstrations with box- and mask-level labels as well as instance-level temporal tracking, supporting compact and interpretable visuomotor representations. Second, we propose SlotVLA, a slot-attention-based framework that captures both objects and their relations for action decoding. It uses a slot-based visual tokenizer to maintain consistent temporal object representations, a relation-centric decoder to produce task-relevant embeddings, and an LLM-driven module that translates these embeddings into executable actions. Experiments on LIBERO+ demonstrate that object-centric slot and object-relation slot representations drastically reduce the number of required visual tokens, while providing competitive generalization. Together, LIBERO+ and SlotVLA provide a compact, interpretable, and effective foundation for advancing object-relation-centric robotic manipulation.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 39 of its 41 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
39 of 41 references.
References · 39
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2023Qwen Technical Reportcited by 3,273
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2020Object-Centric Learning with Slot Attentioncited by 865
27 more
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 529
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
- 2024LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Modelscited by 394
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2024TokenPacker: Efficient Visual Projector for Multimodal LLMcited by 170
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 146
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2022VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priorscited by 135
- 20226-DoF Pose Estimation of Household Objects for Robotic Manipulation: An Accessible Dataset and Benchmarkcited by 85
- 2022Improving Object-centric Learning with Query Optimizationcited by 60
- 2024Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Drivingcited by 55
- 2017Deep Object-Centric Representations for Generalizable Robot Learningcited by 50
- 2021Learning to See before Learning to Act: Visual Pre-training for Manipulationcited by 50
- 2024Matryoshka Query Transformer for Large Vision-Language Modelscited by 49
- 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Modelscited by 43
- 2024Accelerating Transformers with Spectrum-Preserving Token Mergingcited by 35
- 2021Semantically Grounded Object Matching for Robust Robotic Scene Rearrangementcited by 21
- 2022Visuomotor Control in Multi-Object Scenes Using Object-Aware Representationscited by 21
- 2024Slot State Space Modelscited by 17
- 2024Object-Centric Instruction Augmentation for Robotic Manipulationcited by 16
- 2024Composing Pre-Trained Object-Centric Representations for Robotics From "What" and "Where" Foundation Modelscited by 16
- 2023Action-slot: Visual Action-centric Representations for Multi-label Atomic Activity Recognition in Traffic Scenescited by 12
- 2024Rethinking Image-to-Video Adaptation: An Object-centric Perspectivecited by 8
- 2020Efficient State Abstraction using Object-centered Predicates for Manipulation Planningcited by 3
- 2025UNO: Unifying One-stage Video Scene Graph Generation via Object-Centric Visual Representation Learningcited by 1
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulationcited by 25
- 2026OFlow: Injecting Object-Aware Temporal Flow Matching for Robust Robotic Manipulationcited by 6
- 2026StructSAM: Structure- and Spectrum-Preserving Token Merging for Segment Anything Modelscited by 2
- 2026FOCA: Future-Oriented Conditioning for Data-Efficient Vision-Language-Action Adaptationcited by 2
- 2026Self-Improving VLA Policies: Selected Diffusion Noise for Spurious-Robust Action Smoothingcited by 1
- 2026Look Where It Matters: Adaptive Visual Refinement for Vision-Language-Action Modelscited by 1
- 2026EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectoriescited by 0
- 2026SmoLSTM: A Compact Vision-Language-Action Model with Recurrent Memory that Persistscited by 0
- 2026Object-Centric Conditioning for Visuomotor Flow Matchingcited by 0
- 2026Object-Centric Conditioning for Visuomotor Flow Matching21 Sep 2026
- 2026SmoLSTM: A Compact Vision-Language-Action Model with Recurrent Memory that Persists19 Sep 2026
- 2026Look Where It Matters: Adaptive Visual Refinement for Vision-Language-Action Models3 Aug 2026
- 2026FOCA: Future-Oriented Conditioning for Data-Efficient Vision-Language-Action Adaptation18 Jun 2026
- 2026Self-Improving VLA Policies: Selected Diffusion Noise for Spurious-Robust Action Smoothing12 Jun 2026
- 2026EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectories6 Jun 2026
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May 2026
- 2026OFlow: Injecting Object-Aware Temporal Flow Matching for Robust Robotic Manipulation20 Apr 2026
- 2026StructSAM: Structure- and Spectrum-Preserving Token Merging for Segment Anything Models7 Mar 2026