Whole-Body Semantic-to-Actuation Grounding of Elephant-Inspired Soft-Trunk Motion via Lightweight Flow Matching
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
For close-contact human-robot interaction (HRI), trunk-like continuum manipulators provide a physical channel for diverse whole-body expression, but grounding open-vocabulary responses into such robots is difficult: end-effector motion underspecifies body shape, whereas direct whole-body commands are high-dimensional and hard to keep feasible. We propose a whole-body semantic-to-actuation grounding framework for elephant-inspired soft-trunk HRI based on lightweight flow matching. The framework converts responses from a multimodal large language model into bounded, morphology-aligned intent-intensity tuples, parameterizes tendon-actuation trajectories with compact Catmull-Rom spline controls, and uses a rectified-flow generator to sample feasible whole-body trunk motions. Experiments show that the proposed framework improves held-out grounding correctness from 25.0% to 77.2% over a raw-response dense-regression baseline. Compared with a denoising-diffusion baseline, it improves correctness from 71.9% to 77.2% and reduces inference time from 7.86 ms to 4.87 ms while preserving motion diversity. A 100-participant physical HRI study further shows that adding the generated soft-trunk motion channel increases the positive overall-satisfaction rating from 46% to 82% over the audiovisual-only baseline.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 16 of its 29 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
16 of 29 references.
Closest ancestors · 1
Same direction, newest first
Other references · 15
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2021Implicit Behavioral Cloningcited by 452
- 2021Model Based Control of Soft Robots: A Survey of the State of the Art and Open Challengescited by 20
- 2023SpiRobs: Logarithmic Spiral-shaped Robots for Versatile Grasping Across Scalescited by 6
- 2025A Synergistic Framework for Learning Shape Estimation and Shape-Aware Whole-Body Control Policy for Continuum Robotscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SWIM: Vision-Language-Grounded Soft Whole-Body Interactive Manipulation ↗
- 2026Whole-Body UMI: Transferring UMI Manipulation Skills to Humanoid Whole-Body Manipulation via Real-Time Motion Generation ↗
- 2026Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulation
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation
- 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objects
- 2025TrajBooster: Boosting Humanoid Whole-Body Manipulation via Trajectory-Centric Learning
- 2026FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulation