mlsanityData to 7 Oct 2026

Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction

arXiv 2605.19624 ↗First posted 19 May 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

For camera-based satellite visual sensing, Sim2Real data construction requires images that approach real-domain sensor appearance while retaining the annotations inherited from simulation. Real sensor images of satellite targets with reliable pose labels and component-level masks are difficult to acquire at scale, whereas synthetic rendering provides exact geometric annotations but suffers from a visible appearance gap. This paper presents a component-aware structure-preserving style transfer framework for satellite visual synthetic-to-real data construction. The method builds weakly paired real--synthetic samples from calibrated real acquisition, ArUco-based camera-pose measurement, CAD rendering, and component masks. It then extracts part-wise real-domain style codes from unlabeled real images and injects them into corresponding synthetic satellite regions through mask-aligned modulation. To keep the generated images usable for downstream sensor-data supervision, adversarial training is combined with local contrastive consistency, self-regularization, and edge-preserving constraints. Experiments are conducted on 5,000 rendered satellite images and 100 real images captured in a calibrated setup. The real images provide target-domain appearance references and final evaluation images, while the downstream GDRNet pose estimator is trained only on synthetic or translated synthetic images. Compared with representative image-translation baselines, the proposed method achieves the lowest image distribution discrepancy, with an FID of 54.32 and a KID of 0.048. When the translated data are used to train GDRNet in this target-domain adaptation setting, the ADD pass rate improves to 0.260 and the AUC improves to 0.611. These results indicate that component-level appearance transfer can improve annotation-preserving satellite visual Sim2Real data generation in the considered calibrated setup.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

21 of 37 references.

References · 21

  1. 2023Segment Anythingcited by 8,158
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  5. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  6. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  7. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  8. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
  9. 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 292
  10. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  11. 2018Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objectscited by 237
  12. 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
9 more
  1. 2015Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Viewscited by 94
  2. 2019Satellite Pose Estimation Challenge: Dataset, Competition Design and Resultscited by 62
  3. 2021SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gapcited by 57
  4. 2019Satellite Pose Estimation with Deep Landmark Regression and Nonlinear Pose Refinementcited by 56
  5. 2019Deep Learning for Spacecraft Pose Estimation from Photorealistic Renderingcited by 54
  6. 2022Robust Multi-Task Learning and Online Refinement for Spacecraft Pose Estimation across Domain Gapcited by 44
  7. 2023A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospectscited by 30
  8. 2021Deep Learning-based Spacecraft Relative Navigation Methods: A Surveycited by 17
  9. 2022Sim2Real Instance-Level Style Transfer for 6D Pose Estimationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.