Bimanual Manipulation Within an 8 GB Budget: Zero-Copy Sensing and Quantized ACT on an Entry-Level Jetson
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Bimanual manipulation policies trained with imitation learning are typically evaluated on workstation or datacenter-class GPUs, leaving the cost of deploying them on embedded hardware largely uncharacterized. We present a bimanual SO-101 system running entirely on an NVIDIA Jetson Orin Nano Super (8 GB), the entry-level tier of NVIDIA's embedded line, using a desktop GPU (RTX 3070) only for offline training, evaluated on pick-and-place of a deformable beanbag. First, we build a GStreamer capture pipeline backed by NVMM buffers that removes redundant host-device copies from three-camera sensing. Contrary to expectation, the conventional path fit the memory budget and dropped no frames; what zero-copy sensing recovers is CPU headroom (peak single-core utilization 98.0% to 77.0%) and worst-case latency (117.31 ms to 101.52 ms). Second, we train ACT and Diffusion Policy on identical demonstrations, each at its own reference budget (100k gradient steps for ACT, 200k for Diffusion Policy). ACT converges to a task-competent policy (19/20 trials) while Diffusion Policy does not converge to a usable one (0/10) even at twice the step count, which we attribute to differing convergence costs rather than an accuracy ceiling. Third, we convert ACT to TensorRT. FP16 reduces mean inference latency from 114.02 ms to 17.93 ms (6.4x) and INT8 to 12.65 ms (9.0x), with task success preserved at all three precisions (19/20, 18/20, 19/20). We report two findings not previously documented for ACT: TensorRT's general-purpose INT8 calibration quantizes the ResNet18 backbone but accepts zero of 145 transformer layers, explaining INT8's negligible size reduction over FP16 (0.9%) despite a further 28% latency gain; and the need for quantization is conditional on ACT's action-chunking configuration, feasible in full precision at n_action_steps = 100 but not at the per-step re-prediction temporal ensembling requires.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 12 of its 15 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
12 of 15 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 189
- 2019A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithmscited by 142
- 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 73
- 2024ALOHA 2: An Enhanced Low-Cost Hardware for Bimanual Teleoperationcited by 63
- 2022Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulationcited by 49
- 2024InterACT: Inter-dependency Aware Action Chunking with Hierarchical Attention Transformers for Bimanual Manipulationcited by 22
- 2024Active Vision Might Be All You Need: Exploring Active Vision in Bimanual Robotic Manipulationcited by 22
- 2025Edge Computing and its Application in Robotics: A Surveycited by 9
- 2025Learning Bimanual Manipulation via Action Chunking and Inter-Arm Coordination with Transformerscited by 8
- 2025Benchmarking Generalizable Bimanual Manipulation: RoboTwin Dual-Arm Collaboration Challenge at CVPR 2025 MEIS Workshopcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Sampling-Based Optimization with Parallelized Physics Simulator for Bimanual Manipulation
- 2026DuoBench: A Reproducible Benchmark for Bimanual Manipulation in Simulation and the Real World
- 2020Deep Imitation Learning for Bimanual Robotic Manipulation
- 2026Active Stereo-Camera Outperforms Multi-Sensor Setup in ACT Imitation Learning for Humanoid Manipulation
- 2026Towards Exploratory and Focused Manipulation with Bimanual Active Perception: A New Problem, Benchmark and Strategy
- 2025One-Shot Real-World Demonstration Synthesis for Scalable Bimanual Manipulation ↗
- 2022A System for Imitation Learning of Contact-Rich Bimanual Manipulation Policies
- 2025Towards a Generalizable Bimanual Foundation Policy via Flow-based Video Prediction