# Robotic Testbed for Rendezvous and Optical Navigation: Multi-Source Calibration and Machine Learning Use Cases

arXiv: https://arxiv.org/abs/2108.05529 · HTML: https://mlsanity.com/paper/2108.05529/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- Builds on 4 of its 35 references that are in the map.
- First posted on arXiv 12 Aug 2021.

## Builds on (most cited first, 4 of 4)

- [Satellite Pose Estimation Challenge: Dataset, Competition Design and Results](https://mlsanity.com/paper/1911.02050/) (2019)
- [Satellite Pose Estimation with Deep Landmark Regression and Nonlinear Pose Refinement](https://mlsanity.com/paper/1908.11542/) (2019)
- [Towards Robust Learning-Based Pose Estimation of Noncooperative Spacecraft](https://mlsanity.com/paper/1909.00392/) (2019)
- [Solving the Robot-World Hand-Eye(s) Calibration Problem with Iterative Methods](https://mlsanity.com/paper/1907.12425/) (2019)

## Built on by (most cited first, 14 of 14)

- [SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gap](https://mlsanity.com/paper/2110.03101/) (2021)
- [Robust Multi-Task Learning and Online Refinement for Spacecraft Pose Estimation across Domain Gap](https://mlsanity.com/paper/2203.04275/) (2022)
- [A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospects](https://mlsanity.com/paper/2305.07348/) (2023)
- [Leveraging Neural Radiance Fields for Pose Estimation of an Unknown Space Object during Proximity Operations](https://mlsanity.com/paper/2405.12728/) (2024)
- [Bridging the Domain Gap for Flight-Ready Spaceborne Vision](https://mlsanity.com/paper/2409.11661/) (2024)
- [Domain Generalization for 6D Pose Estimation Through NeRF-based Image Synthesis](https://mlsanity.com/paper/2407.10762/) (2024)
- [Lessons from a Space Lab -- An Image Acquisition Perspective](https://mlsanity.com/paper/2208.08865/) (2022)
- [Domain Generalization for In-Orbit 6D Pose Estimation](https://mlsanity.com/paper/2406.11743/) (2024)
- [Design, Implementation and Evaluation of an External Pose-Tracking System for Underwater Cameras](https://mlsanity.com/paper/2305.04226/) (2023)
- [Improved 3D Gaussian Splatting of Unknown Spacecraft Structure Using Space Environment Illumination Knowledge](https://mlsanity.com/paper/2512.23998/) (2025)
- [Experimental Evaluation of Pose Initialization Methods for Relative Navigation Between Non-Cooperative Satellites](https://mlsanity.com/paper/2206.10244/) (2022)
- [Digital and Robotic Twinning for Validation of Proximity Operations and Formation Flying](https://mlsanity.com/paper/2507.20034/) (2025)
- [NeRF-based Spacecraft Reconstruction from Monocular Imagery Under Illumination Variability and Pose Uncertainty](https://mlsanity.com/paper/2605.18447/) (2026)
- [CAD-Free Learning of Spacecraft Pose Estimators via NeRF-Based Augmentations](https://mlsanity.com/paper/2605.19649/) (2026)

## Abstract (arXiv)

This work presents the most recent advances of the Robotic Testbed for Rendezvous and Optical Navigation (TRON) at Stanford University - the first robotic testbed capable of validating machine learning algorithms for spaceborne optical navigation. The TRON facility consists of two 6 degrees-of-freedom KUKA robot arms and a set of Vicon motion track cameras to reconfigure an arbitrary relative pose between a camera and a target mockup model. The facility includes multiple Earth albedo light boxes and a sun lamp to recreate the high-fidelity spaceborne illumination conditions. After the overview of the facility, this work details the multi-source calibration procedure which enables the estimation of the relative pose between the object and the camera with millimeter-level position and millidegree-level orientation accuracies. Finally, a comparative analysis of the synthetic and TRON simulated imageries is performed using a Convolutional Neural Network (CNN) pre-trained on the synthetic images. The result shows a considerable gap in the CNN's performance, suggesting the TRON simulated images can be used to validate the robustness of any machine learning algorithms trained on more easily accessible synthetic imagery from computer graphics.
