mlsanityData to 14 Oct 2026

Neuro-Symbolic Scene Graph Conditioning for Synthetic Image Dataset Generation

arXiv 2503.17224 ↗First posted 21 Mar 2025cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

As machine learning models increase in scale and complexity, obtaining sufficient training data has become a critical bottleneck due to acquisition costs, privacy constraints, and data scarcity in specialised domains. While synthetic data generation has emerged as a promising alternative, a notable performance gap remains compared to models trained on real data, particularly as task complexity grows. Concurrently, Neuro-Symbolic methods, which combine neural networks' learning strengths with symbolic reasoning's structured representations, have demonstrated significant potential across various cognitive tasks. This paper explores the utility of Neuro-Symbolic conditioning for synthetic image dataset generation, focusing specifically on improving the performance of Scene Graph Generation models. The research investigates whether structured symbolic representations in the form of scene graphs can enhance synthetic data quality through explicit encoding of relational constraints. The results demonstrate that Neuro-Symbolic conditioning yields significant improvements of up to +2.59% in standard Recall metrics and +2.83% in No Graph Constraint Recall metrics when used for dataset augmentation. These findings establish that merging Neuro-Symbolic and generative approaches produces synthetic data with complementary structural information that enhances model performance when combined with real data, providing a novel approach to overcome data scarcity limitations even for complex visual reasoning tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 21 Mar 2025.

Builds on

26 of 30 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2022Generative Adversarial Networkscited by 5,627
  6. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  7. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  8. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  9. 2014Conditional Generative Adversarial Netscited by 2,162
  10. 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 414
  11. 2020Unbiased Scene Graph Generation from Biased Trainingcited by 356
  12. 2018Image Generation from Scene Graphscited by 324
14 more
  1. 2018Learning to Compose Dynamic Tree Structures for Visual Contextscited by 259
  2. 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 172
  3. 2023GALIP: Generative Adversarial CLIPs for Text-to-Image Synthesiscited by 85
  4. 2022Diffusion-Based Scene Graph to Image Generation with Masked Contrastive Pre-Trainingcited by 56
  5. 2021Neuro-Symbolic Artificial Intelligence: Current Trendscited by 54
  6. 2023SceneGenie: Scene Graph Guided Diffusion Models for Image Synthesiscited by 41
  7. 2021A Survey on Neural-symbolic Learning Systemscited by 39
  8. 2024SG-Adapter: Enhancing Text-to-Image Generation with Scene Graph Guidancecited by 20
  9. 2023Bridging the Gap: Enhancing the Utility of Synthetic Data via Post-Processing Techniquescited by 11
  10. 2024Groupwise Query Specialization and Quality-Aware Multi-Assignment for Transformer-based Visual Relationship Detectioncited by 11
  11. 2024Stable Diffusion Dataset Generation for Downstream Classification Taskscited by 9
  12. 2023Transformer-based Image Generation from Scene Graphscited by 8
  13. 2024Federated Knowledge Recycling: Privacy-Preserving Synthetic Data Sharingcited by 7
  14. 2024Synthetic Image Learning: Preserving Performance and Preventing Membership Inference Attackscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Zero-Shot Conditioning of Score-Based Diffusion Models by Neuro-Symbolic Constraints
  2. 2024Mind the Gap Between Synthetic and Real: Utilizing Transfer Learning to Probe the Boundaries of Stable Diffusion Generated Data
  3. 2025Can Synthetic Data Improve Symbolic Regression Extrapolation Performance?
  4. 2024Mapping the Neuro-Symbolic AI Landscape by Architectures: A Handbook on Augmenting Deep Learning Through Symbolic Reasoning
  5. 2026Representation-Conditioned Diffusion Models for Guided Training Data Generation
  6. 2024The Unmet Promise of Synthetic Training Images: Using Retrieved Real Images Performs Better
  7. 2023GENOME: GenerativE Neuro-symbOlic visual reasoning by growing and reusing ModulEs
  8. 2025Understanding Trade offs When Conditioning Synthetic Data