Data to 7 Oct 2026

Comprehensive Image Captioning via Scene Graph Decomposition

arXiv 2007.11731 ↗First posted 23 Jul 2020cs.CVcited by 52

Not on the map. Why?

Abstract (arXiv)

We address the challenging problem of image captioning by revisiting the representation of image scene graph. At the core of our method lies the decomposition of a scene graph into a set of sub-graphs, with each sub-graph capturing a semantic component of the input image. We design a deep model to select important sub-graphs, and to decode each selected sub-graph into a single target sentence. By using sub-graphs, our model is able to attend to different components of the image. Our method thus accounts for accurate, diverse, grounded and controllable captioning at the same time. We present extensive experiments to demonstrate the benefits of our comprehensive captioning model. Our method establishes new state-of-the-art results in caption diversity, grounding, and controllability, and compares favourably to latest methods in caption quality. Our project website can be found at http://pages.cs.wisc.edu/~yiwuzhong/Sub-GC.html.

Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jul 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 10; 2022: 16; 2023: 13; 2024: 4; 2025: 5; 2026: 4.

52 papers.

Sort:

By area:

2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 137
2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
2021Let there be a clock on the beach: Reducing Object Hallucination in Image Captioningcited by 74
2022Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generationcited by 67
2021Learning to Generate Scene Graph from Natural Language Supervisioncited by 64
2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
2022Instance Relation Graph Guided Source-Free Domain Adaptive Object Detectioncited by 55
2023FACTUAL: A Benchmark for Faithful and Consistent Textual Scene Graph Parsingcited by 50
2022Deep Learning Approaches on Image Captioning: A Reviewcited by 43
2021Human-like Controllable Image Captioning with Verb-specific Semantic Rolescited by 41
2021Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generationcited by 35

38 more

2021In Defense of Scene Graphs for Image Captioningcited by 31
2023LLM4SGG: Large Language Models for Weakly Supervised Scene Graph Generationcited by 30
2021ReFormer: The Relational Transformer for Image Captioningcited by 23
2023Devil's on the Edges: Selective Quad Attention for Scene Graph Generationcited by 23
2022Resistance Training using Prior Bias: toward Unbiased Scene Graph Generationcited by 22
2022Contextual Modeling for 3D Dense Captioning on Point Cloudscited by 18
2023Pair then Relation: Pair-Net for Panoptic Scene Graph Generationcited by 17
2023Transforming Visual Scene Graphs to Image Captionscited by 15
2023Learning Combinatorial Prompts for Universal Controllable Image Captioningcited by 12
2023Graph Neural Networks in Vision-Language Image Understanding: A Surveycited by 10
2023Environment-Invariant Curriculum Relation Learning for Fine-Grained Scene Graph Generationcited by 9
2022Representing Videos as Discriminative Sub-graphs for Action Recognitioncited by 8
2022Swinv2-Imagen: Hierarchical Vision Transformer Diffusion Models for Text-to-Image Generationcited by 7
2024VeriGraph: Scene Graphs for Execution Verifiable Robot Planningcited by 7
2022Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generationcited by 6
2024ROOT: VLM based System for Indoor Scene Understanding and Beyondcited by 6
2023Open Visual Knowledge Extraction via Relation-Oriented Multimodality Model Promptingcited by 5
2025PRISM-0: A Predicate-Rich Scene Graph Generation Framework for Zero-Shot Open-Vocabulary Taskscited by 5
2022Visual Semantic Parsing: From Images to Abstract Meaning Representationcited by 4
2022CLID: Controlled-Length Image Descriptions with Limited Datacited by 4
2025ESCA: Contextualizing Embodied Agents via Scene-Graph Generationcited by 4
2022Knowledge-enriched Attention Network with Group-wise Semantic for Visual Storytellingcited by 3
2022Taking an Emotional Look at Video Paragraph Captioningcited by 3
2022Context-aware Mixture-of-Experts for Unbiased Scene Graph Generationcited by 3
2025SGDiff: Scene Graph Guided Diffusion Model for Image Collaborative SegCaptioningcited by 3
2021DVCFlow: Modeling Information Flow Towards Human-like Video Captioningcited by 2
2022SGRAM: Improving Scene Graph Parsing via Abstract Meaning Representationcited by 2
2023Fusion-S2iGan: An Efficient and Effective Single-Stage Framework for Speech-to-Image Generationcited by 2
2023Zero-Shot Scene Graph Generation via Triplet Calibration and Reductioncited by 2
2024CIC-BART-SSA: Controllable Image Captioning with Structured Semantic Augmentationcited by 2
2021Goal-driven text descriptions for imagescited by 1
2023Video Captioning with Aggregated Features Based on Dual Graphs and Gated Fusioncited by 1
2025DiscoSG: Towards Discourse-Level Text Scene Graph Parsing through Iterative Graph Refinementcited by 1
2026VIZOR: Viewpoint-Invariant Zero-Shot Scene Graph Generation for 3D Scene Reasoningcited by 1
2023Head-Tail Cooperative Learning Network for Unbiased Scene Graph Generationcited by 0
2024Surveying the Landscape of Image Captioning Evaluation: A Comprehensive Taxonomy, Trends and Metrics Analysiscited by 0
2025SuperCap: Multi-resolution Superpixel-based Image Captioningcited by 0
2026Multi-Modal LLM based Image Captioning in ICT: Bridging the Gap Between General and Industry Domaincited by 0

50 most cited of 52 All 52 (JSON)