mlsanityData to 7 Oct 2026

Multi-task Prompt Words Learning for Social Media Content Generation

arXiv 2407.07771 ↗First posted 10 Jul 2024cs.CL cs.CV cs.MMcited by 1

Not on the map. Why?

Abstract (arXiv)

The rapid development of the Internet has profoundly changed human life. Humans are increasingly expressing themselves and interacting with others on social media platforms. However, although artificial intelligence technology has been widely used in many aspects of life, its application in social media content creation is still blank. To solve this problem, we propose a new prompt word generation framework based on multi-modal information fusion, which combines multiple tasks including topic classification, sentiment analysis, scene recognition and keyword extraction to generate more comprehensive prompt words. Subsequently, we use a template containing a set of prompt words to guide ChatGPT to generate high-quality tweets. Furthermore, in the absence of effective and objective evaluation criteria in the field of content generation, we use the ChatGPT tool to evaluate the results generated by the algorithm, making large-scale evaluation of content generation algorithms possible. Evaluation results on extensive content generation demonstrate that our cue word generation framework generates higher quality content compared to manual methods and other cueing techniques, while topic classification, sentiment analysis, and scene recognition significantly enhance content clarity and its consistency with the image.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 10 Jul 2024.

Builds on

31 of 47 references.

References · 31

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  7. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  9. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  10. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  11. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  12. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
19 more
  1. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  2. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
  3. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  4. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,021
  5. 2021Transformers in Vision: A Surveycited by 1,009
  6. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  7. 2023Instruction Tuning with GPT-4cited by 676
  8. 2020A Survey on Visual Transformercited by 653
  9. 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 530
  10. 2022Prompt-aligned Gradient for Prompt Tuningcited by 339
  11. 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 279
  12. 2022Prompt Distribution Learningcited by 235
  13. 2022Synchromesh: Reliable code generation from pre-trained language modelscited by 156
  14. 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trendscited by 117
  15. 2022CLIP-Event: Connecting Text and Images with Event Structurescited by 86
  16. 2023Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPTcited by 78
  17. 2015Multi-scale recognition with DAG-CNNscited by 23
  18. 2018Scene recognition with CNNs: objects, scales and dataset biascited by 18
  19. 2016Hybrid CNN and Dictionary-Based Models for Scene Recognition and Domain Adaptationcited by 8

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.