mlsanityData to 7 Oct 2026

Dense Relational Captioning: Triple-Stream Networks for Relationship-Based Captioning

arXiv 1903.05942 ↗First posted 14 Mar 2019cs.CV cs.CLcited by 35

Not on the map. Why?

Abstract (arXiv)

Our goal in this work is to train an image captioning model that generates more dense and informative captions. We introduce "relational captioning," a novel image captioning task which aims to generate multiple captions with respect to relational information between objects in an image. Relational captioning is a framework that is advantageous in both diversity and amount of information, leading to image understanding based on relationships. Part-of speech (POS, i.e. subject-object-predicate categories) tags can be assigned to every English word. We leverage the POS as a prior to guide the correct sequence of words in a caption. To this end, we propose a multi-task triple-stream network (MTTSNet) which consists of three recurrent units for the respective POS and jointly performs POS prediction and captioning. We demonstrate more diverse and richer representations generated by the proposed model against several baselines and competing methods.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Mar 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 9; 2022: 12; 2023: 5; 2024: 7; 2025: 1; 2026: 1.

35 papers.

Sort:

By area:

  1. 2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 137
  2. 2022Language Models Can See: Plugging Visual Controls in Text Generationcited by 89
  3. 2022Scene Graph Generation: A Comprehensive Surveycited by 73
  4. 2022X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioningcited by 70
  5. 2021D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Groundingcited by 52
  6. 2022MORE: Multi-Order RElation Mining for Dense Captioning in 3D Scenescited by 46
  7. 2024EGTR: Extracting Graph from Transformer for Scene Graph Generationcited by 45
  8. 2021Human-like Controllable Image Captioning with Verb-specific Semantic Rolescited by 41
  9. 2022Spatiality-guided Transformer for 3D Dense Captioning on Point Cloudscited by 40
  10. 2023ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishingcited by 33
  11. 2024STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagerycited by 31
  12. 2022Category-Aware Transformer Network for Better Human-Object Interaction Detectioncited by 22
23 more
  1. 2023IC3: Image Captioning by Committee Consensuscited by 20
  2. 2022Contextual Modeling for 3D Dense Captioning on Point Cloudscited by 18
  3. 2021Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillationcited by 14
  4. 2022Generative Bias for Robust Visual Question Answeringcited by 12
  5. 2021ACP++: Action Co-occurrence Priors for Human-Object Interaction Detectioncited by 11
  6. 2024IFCap: Image-like Retrieval and Frequency-based Entity Filtering for Zero-shot Captioningcited by 11
  7. 2024A Comprehensive Survey of 3D Dense Captioning: Localizing and Describing Objects in 3D Scenescited by 10
  8. 2025FROSS: Faster-than-Real-Time Online 3D Semantic Scene Graph Generation from RGB-D Imagescited by 10
  9. 2024FlexCap: Describe Anything in Images in Controllable Detailcited by 7
  10. 2021Single-Modal Entropy based Active Learning for Visual Question Answeringcited by 6
  11. 2022Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generationcited by 6
  12. 2023Open Visual Knowledge Extraction via Relation-Oriented Multimodality Model Promptingcited by 5
  13. 2023Generating Context-Aware Natural Answers for Questions in 3D Scenescited by 5
  14. 2022CLID: Controlled-Length Image Descriptions with Limited Datacited by 4
  15. 2023Semi-Supervised Image Captioning by Adversarially Propagating Labeled Datacited by 4
  16. 2021Topic Scene Graph Generation by Attention Distillation from Captioncited by 3
  17. 2021Dependent Multi-Task Learning with Causal Intervention for Image Captioningcited by 2
  18. 2021Scene Graph Generation for Better Image Captioning?cited by 1
  19. 2022Bypass Network for Semantics Driven Image Paragraph Captioningcited by 0
  20. 2022Multi-Task Edge Prediction in Temporally-Dynamic Video Graphscited by 0
  21. 2024Surveying the Landscape of Image Captioning Evaluation: A Comprehensive Taxonomy, Trends and Metrics Analysiscited by 0
  22. 2024A transition towards virtual representations of visual scenescited by 0
  23. 2026NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Drivingcited by 0