On Pre-Trained Image Features and Synthetic Images for Deep Learning
Not on the map. Why?
Abstract (arXiv)
Deep Learning methods usually require huge amounts of training data to perform at their full potential, and often require expensive manual labeling. Using synthetic images is therefore very attractive to train object detectors, as the labeling comes for free, and several approaches have been proposed to combine synthetic and real images for training. In this paper, we show that a simple trick is sufficient to train very effectively modern object detectors with synthetic images only: We freeze the layers responsible for feature extraction to generic layers pre-trained on real images, and train only the remaining layers with plain OpenGL rendering. Our experiments with very recent deep architectures for object recognition (Faster-RCNN, R-FCN, Mask-RCNN) and image feature extractors (InceptionResnet and Resnet) show this simple approach performs surprisingly well.
Key facts. Cited by 51 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 17; 2023: 10; 2024: 12; 2025: 2; 2026: 3.
51 papers.
Sort:
By area:
- 2023Segment Anything in High Qualitycited by 376
- 2022ZegCLIP: Towards Adapting CLIP for Zero-shot Semantic Segmentationcited by 178
- 2023BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objectscited by 70
- 2021Deep Regression on Manifolds: A 3D Rotation Case Studycited by 67
- 2024BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objectscited by 60
- 2022X-Paste: Revisiting Scalable Copy-Paste for Instance Segmentation using CLIP and StableDiffusioncited by 49
- 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentationcited by 35
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimationcited by 32
- 2022Object Detection Using Sim2Real Domain Randomization for Robotic Applicationscited by 25
- 2023Markerless Camera-to-Robot Pose Estimation via Self-supervised Sim-to-Real Transfercited by 24
- 2022EgoEnv: Human-centric environment representations from egocentric videocited by 22
- 2022DALL-E for Detection: Language-driven Compositional Image Synthesis for Object Detectioncited by 17
38 more
- 2022Tree Detection and Diameter Estimation Based on Deep Learningcited by 12
- 2025Enhancing Vision-Language Compositional Understanding with Multimodal Synthetic Datacited by 12
- 2022Generative Adversarial Networks for Image Super-Resolution: A Surveycited by 11
- 2022COPE: End-to-end trainable Constant Runtime Object Pose Estimationcited by 10
- 2023Beyond Generation: Harnessing Text to Image Models for Object Detection and Segmentationcited by 10
- 2022Evaluating a Synthetic Image Dataset Generated with Stable Diffusioncited by 9
- 2022Analysis of Training Object Detection Models with Synthetic Datacited by 9
- 2022Knock, knock. Who's there? -- Identifying football player jersey numbers with synthetic datacited by 7
- 2024A SAM-guided Two-stream Lightweight Model for Anomaly Detectioncited by 7
- 2022Photo-realistic Neural Domain Randomizationcited by 5
- 2023Object Detector Differences when using Synthetic and Real Training Datacited by 5
- 2023Federated Learning Over Images: Vertical Decompositions and Pre-Trained Backbones Are Difficult to Beatcited by 4
- 2022Label-Free Synthetic Pretraining of Object Detectorscited by 3
- 2023HaDR: Applying Domain Randomization for Generating Synthetic Multimodal Dataset for Hand Instance Segmentation in Cluttered Industrial Environmentscited by 3
- 2024Harnessing Machine Learning for Discerning AI-Generated Synthetic Imagescited by 3
- 2024Transfer learning with generative models for object detection on limited datasetscited by 3
- 2024How Important are Data Augmentations to Close the Domain Gap for Object Detection in Orbit?cited by 3
- 2021A Pipeline for Vision-Based On-Orbit Proximity Operations Using Deep Learning and Synthetic Imagerycited by 2
- 2021Learning from scarce information: using synthetic data to classify Roman fine ware potterycited by 2
- 2021Beyond Classification: Knowledge Distillation using Multi-Object Impressionscited by 2
- 2023Training on Synthetic Data Beats Real Data in Multimodal Relation Extractioncited by 2
- 2025Improvise, Adapt, Overcome -- Telescopic Adapters for Efficient Fine-tuning of Vision Language Models in Medical Imagingcited by 2
- 2021A novel method for object detection using deep learning and CAD modelscited by 1
- 2021DeePaste -- Inpainting for Pastingcited by 1
- 2022Real-time Detection of 2D Tool Landmarks with Synthetic Training Datacited by 1
- 2023HazardNet: Road Debris Detection by Augmentation of Synthetic Modelscited by 1
- 2024Drone Detection using Deep Neural Networks Trained on Pure Synthetic Datacited by 1
- 2024Paint Outside the Box: Synthesizing and Selecting Training Data for Visual Groundingcited by 1
- 2021Learning to Segment Human Body Parts with Synthetically Trained Deep Convolutional Networkscited by 0
- 2022Autoencoder for Synthetic to Real Generalization: From Simple to More Complex Scenescited by 0
- 2022FSID: Fully Synthetic Image Denoising via Procedural Scene Generationcited by 0
- 2024Detection and Pose Estimation of flat, Texture-less Industry Objects on HoloLens using synthetic Trainingcited by 0
- 2024Genetic Learning for Designing Sim-to-Real Data Augmentationscited by 0
- 2024A comparative analysis of deep learning models for lung segmentation on X-ray imagescited by 0
- 2024Mitigating Dimensionality in 2D Rectangle Packing Problem under Reinforcement Learning Schemacited by 0
- 2024Cartesian Genetic Programming Approach for Designing Convolutional Neural Networkscited by 0
- 2026SynMulti: Synthetic-to-Real Learning for Multimodal Video Understandingcited by 0
- 2026The Power of Light: Improving Synthetic-to-Real Domain Adaptation through Physically-Based Indirect Illuminationcited by 0
50 most cited of 51 All 51 (JSON)
- 2026Synthetic and Derived Training Images for Campus Waste Detection: A Multi-Seed Evaluation with YOLOv8n21 Jul 2026
- 2026The Power of Light: Improving Synthetic-to-Real Domain Adaptation through Physically-Based Indirect Illumination21 Jun 2026
- 2026SynMulti: Synthetic-to-Real Learning for Multimodal Video Understanding14 Apr 2026
- 2025Improvise, Adapt, Overcome -- Telescopic Adapters for Efficient Fine-tuning of Vision Language Models in Medical Imaging15 Dec 2025
- 2025Enhancing Vision-Language Compositional Understanding with Multimodal Synthetic Data3 Mar 2025
- 2024Paint Outside the Box: Synthesizing and Selecting Training Data for Visual Grounding1 Dec 2024
- 2024Drone Detection using Deep Neural Networks Trained on Pure Synthetic Data13 Nov 2024
- 2024How Important are Data Augmentations to Close the Domain Gap for Object Detection in Orbit?21 Oct 2024
- 2024Cartesian Genetic Programming Approach for Designing Convolutional Neural Networks30 Sep 2024
- 2024Mitigating Dimensionality in 2D Rectangle Packing Problem under Reinforcement Learning Schema15 Sep 2024
- 2024A comparative analysis of deep learning models for lung segmentation on X-ray images9 Apr 2024
- 2024BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objects14 Mar 2024
38 more
- 2024Genetic Learning for Designing Sim-to-Real Data Augmentations11 Mar 2024
- 2024A SAM-guided Two-stream Lightweight Model for Anomaly Detection29 Feb 2024
- 2024Transfer learning with generative models for object detection on limited datasets9 Feb 2024
- 2024Detection and Pose Estimation of flat, Texture-less Industry Objects on HoloLens using synthetic Training7 Feb 2024
- 2024Harnessing Machine Learning for Discerning AI-Generated Synthetic Images14 Jan 2024
- 2023Training on Synthetic Data Beats Real Data in Multimodal Relation Extraction5 Dec 2023
- 2023Object Detector Differences when using Synthetic and Real Training Data1 Dec 2023
- 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentation22 Sep 2023
- 2023Beyond Generation: Harnessing Text to Image Models for Object Detection and Segmentation12 Sep 2023
- 2023Federated Learning Over Images: Vertical Decompositions and Pre-Trained Backbones Are Difficult to Beat6 Sep 2023
- 2023Segment Anything in High Quality2 Jun 2023
- 2023HaDR: Applying Domain Randomization for Generating Synthetic Multimodal Dataset for Hand Instance Segmentation in Cluttered Industrial Environments12 Apr 2023
- 2023HazardNet: Road Debris Detection by Augmentation of Synthetic Models14 Mar 2023
- 2023Markerless Camera-to-Robot Pose Estimation via Self-supervised Sim-to-Real Transfer28 Feb 2023
- 2023BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objects25 Feb 2023
- 2022FSID: Fully Synthetic Image Denoising via Procedural Scene Generation7 Dec 2022
- 2022X-Paste: Revisiting Scalable Copy-Paste for Instance Segmentation using CLIP and StableDiffusion7 Dec 2022
- 2022ZegCLIP: Towards Adapting CLIP for Zero-shot Semantic Segmentation7 Dec 2022
- 2022Analysis of Training Object Detection Models with Synthetic Data29 Nov 2022
- 2022Evaluating a Synthetic Image Dataset Generated with Stable Diffusion3 Nov 2022
- 2022Tree Detection and Diameter Estimation Based on Deep Learning31 Oct 2022
- 2022Photo-realistic Neural Domain Randomization23 Oct 2022
- 2022Real-time Detection of 2D Tool Landmarks with Synthetic Training Data21 Oct 2022
- 2022COPE: End-to-end trainable Constant Runtime Object Pose Estimation18 Aug 2022
- 2022Label-Free Synthetic Pretraining of Object Detectors8 Aug 2022
- 2022Object Detection Using Sim2Real Domain Randomization for Robotic Applications8 Aug 2022
- 2022EgoEnv: Human-centric environment representations from egocentric video22 Jul 2022
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimation6 Jul 2022
- 2022DALL-E for Detection: Language-driven Compositional Image Synthesis for Object Detection20 Jun 2022
- 2022Generative Adversarial Networks for Image Super-Resolution: A Survey28 Apr 2022
- 2022Autoencoder for Synthetic to Real Generalization: From Simple to More Complex Scenes1 Apr 2022
- 2022Knock, knock. Who's there? -- Identifying football player jersey numbers with synthetic data1 Mar 2022
- 2021DeePaste -- Inpainting for Pasting20 Dec 2021
- 2021Beyond Classification: Knowledge Distillation using Multi-Object Impressions27 Oct 2021
- 2021Learning from scarce information: using synthetic data to classify Roman fine ware pottery3 Jul 2021
- 2021Deep Regression on Manifolds: A 3D Rotation Case Study30 Mar 2021
- 2021A novel method for object detection using deep learning and CAD models12 Feb 2021
- 2021Learning to Segment Human Body Parts with Synthetically Trained Deep Convolutional Networks2 Feb 2021
50 newest of 51 All 51 (JSON)
- 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentationcited by 35
- 2022DALL-E for Detection: Language-driven Compositional Image Synthesis for Object Detectioncited by 17
- 2023Beyond Generation: Harnessing Text to Image Models for Object Detection and Segmentationcited by 10
- 2022Evaluating a Synthetic Image Dataset Generated with Stable Diffusioncited by 9
- 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentation22 Sep 2023
- 2023Beyond Generation: Harnessing Text to Image Models for Object Detection and Segmentation12 Sep 2023
- 2022Evaluating a Synthetic Image Dataset Generated with Stable Diffusion3 Nov 2022
- 2022DALL-E for Detection: Language-driven Compositional Image Synthesis for Object Detection20 Jun 2022
- 2023Segment Anything in High Qualitycited by 376
- 2022ZegCLIP: Towards Adapting CLIP for Zero-shot Semantic Segmentationcited by 178
- 2023BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objectscited by 70
- 2021Deep Regression on Manifolds: A 3D Rotation Case Studycited by 67
- 2024BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objectscited by 60
- 2022X-Paste: Revisiting Scalable Copy-Paste for Instance Segmentation using CLIP and StableDiffusioncited by 49
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimationcited by 32
- 2022Object Detection Using Sim2Real Domain Randomization for Robotic Applicationscited by 25
- 2023Markerless Camera-to-Robot Pose Estimation via Self-supervised Sim-to-Real Transfercited by 24
- 2022EgoEnv: Human-centric environment representations from egocentric videocited by 22
- 2022Tree Detection and Diameter Estimation Based on Deep Learningcited by 12
- 2022Generative Adversarial Networks for Image Super-Resolution: A Surveycited by 11
12 most cited of 42 All 42 (JSON)
- 2026Synthetic and Derived Training Images for Campus Waste Detection: A Multi-Seed Evaluation with YOLOv8n21 Jul 2026
- 2026The Power of Light: Improving Synthetic-to-Real Domain Adaptation through Physically-Based Indirect Illumination21 Jun 2026
- 2024Paint Outside the Box: Synthesizing and Selecting Training Data for Visual Grounding1 Dec 2024
- 2024Drone Detection using Deep Neural Networks Trained on Pure Synthetic Data13 Nov 2024
- 2024How Important are Data Augmentations to Close the Domain Gap for Object Detection in Orbit?21 Oct 2024
- 2024Cartesian Genetic Programming Approach for Designing Convolutional Neural Networks30 Sep 2024
- 2024A comparative analysis of deep learning models for lung segmentation on X-ray images9 Apr 2024
- 2024BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objects14 Mar 2024
- 2024Genetic Learning for Designing Sim-to-Real Data Augmentations11 Mar 2024
- 2024A SAM-guided Two-stream Lightweight Model for Anomaly Detection29 Feb 2024
- 2024Transfer learning with generative models for object detection on limited datasets9 Feb 2024
- 2024Detection and Pose Estimation of flat, Texture-less Industry Objects on HoloLens using synthetic Training7 Feb 2024
12 newest of 42 All 42 (JSON)