mlsanityData to 7 Oct 2026

Fluency-Guided Cross-Lingual Image Captioning

arXiv 1708.04390 ↗First posted 15 Aug 2017cs.CLcited by 33

Not on the map. Why?

Abstract (arXiv)

Image captioning has so far been explored mostly in English, as most available datasets are in this language. However, the application of image captioning should not be restricted by language. Only few studies have been conducted for image captioning in a cross-lingual setting. Different from these works that manually build a dataset for a target language, we aim to learn a cross-lingual captioning model fully from machine-translated sentences. To conquer the lack of fluency in the translated sentences, we propose in this paper a fluency-guided learning framework. The framework comprises a module to automatically estimate the fluency of the sentences and another module to utilize the estimated fluency scores to effectively train an image captioning model for the target language. As experiments on two bilingual (English-Chinese) datasets show, our approach improves both fluency and relevance of the generated captions in Chinese, but without using any manually written sentences from the target language.

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Aug 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 9; 2023: 6; 2024: 6; 2025: 4; 2026: 4.

33 papers.

Sort:

By area:

  1. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  2. 2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 137
  3. 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
  4. 2022Chinese CLIP: Contrastive Vision-Language Pretraining in Chinesecited by 108
  5. 2024Video ReCap: Recursive Captioning of Hour-Long Videoscited by 88
  6. 2022AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilitiescited by 84
  7. 2022IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languagescited by 54
  8. 2022Cross-Lingual Cross-Modal Retrieval with Noise-Robust Learningcited by 22
  9. 2022CCMB: A Large-scale Chinese Cross-modal Benchmarkcited by 21
  10. 2023Cross2StrA: Unpaired Cross-lingual Image Captioning with Cross-lingual Cross-modal Structure-pivoted Alignmentcited by 15
  11. 2022Aligning Source Visual and Target Language Domains for Unpaired Video Captioningcited by 14
  12. 2024Multilingual Diversity Improves Vision-Language Representationscited by 14
21 more
  1. 2024LLM2CLIP: Powerful Language Model Unlocks Richer Cross-Modality Representationcited by 11
  2. 2022CLEAR: Improving Vision-Language Navigation with Cross-Lingual, Environment-Agnostic Representationscited by 10
  3. 2021Object-Centric Unsupervised Image Captioningcited by 9
  4. 2023Translation-Enhanced Multilingual Text-to-Image Generationcited by 9
  5. 2021MTVR: Multilingual Moment Retrieval in Videoscited by 8
  6. 2024CVLUE: A New Benchmark Dataset for Chinese Vision-Language Understanding Evaluationcited by 8
  7. 2021Bornon: Bengali Image Captioning with Transformer-based Deep learning approachcited by 5
  8. 2023ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language Generationcited by 4
  9. 2024M2-Encoder: Advancing Bilingual Image-Text Understanding by Large-scale Efficient Pretrainingcited by 4
  10. 2025Towards Cross-modal Retrieval in Chinese Cultural Heritage Documents: Dataset and Solutioncited by 4
  11. 2023Enhancing Dynamic Image Advertising with Vision-Language Pre-trainingcited by 2
  12. 2022Multilingual Multimodality: A Taxonomical Survey of Datasets, Techniques, Challenges and Opportunitiescited by 1
  13. 2023Embedded Heterogeneous Attention Transformer for Cross-lingual Image Captioningcited by 1
  14. 2025GRAPE: Let GRPO Supervise Query Rewriting by Ranking for Retrievalcited by 1
  15. 2024Image captioning in different languagescited by 0
  16. 2025A Benchmark for Multi-Lingual Vision-Language Learning in Remote Sensing Image Captioningcited by 0
  17. 2025Pre-Trained CNN Architecture for Transformer-Based Image Caption Generation Modelcited by 0
  18. 2026DanQing: An Up-to-Date Large-Scale Chinese Vision-Language Pre-training Datasetcited by 0
  19. 2026ObjEmbed: Towards Universal Multimodal Object Embeddingscited by 0
  20. 2026Arbitrary Ratio Feature Compression via Next Token Predictioncited by 0
  21. 2026Using Deep Learning to Generate Semantically Correct Hindi Captionscited by 0