mlsanityData to 14 Oct 2026

Preliminary Explorations with GPT-4o(mni) Native Image Generation

arXiv 2505.05501 ↗First posted 6 May 2025cs.CV cs.AI eess.IVcited by 5

Not on the map. Why?

Abstract (arXiv)

Recently, the visual generation ability by GPT-4o(mni) has been unlocked by OpenAI. It demonstrates a very remarkable generation capability with excellent multimodal condition understanding and varied task instructions. In this paper, we aim to explore the capabilities of GPT-4o across various tasks. Inspired by previous study, we constructed a task taxonomy along with a carefully curated set of test samples to conduct a comprehensive qualitative test. Benefiting from GPT-4o's powerful multimodal comprehension, its image-generation process demonstrates abilities surpassing those of traditional image-generation tasks. Thus, regarding the dimensions of model capabilities, we evaluate its performance across six task categories: traditional image generation tasks, discriminative tasks, knowledge-based generation, commonsense-based generation, spatially-aware image generation, and temporally-aware image generation. These tasks not only assess the quality and conditional alignment of the model's outputs but also probe deeper into GPT-4o's understanding of real-world concepts. Our results reveal that GPT-4o performs impressively well in general-purpose synthesis tasks, showing strong capabilities in text-to-image generation, visual stylization, and low-level image processing. However, significant limitations remain in its ability to perform precise spatial reasoning, instruction-grounded generation, and consistent temporal prediction. Furthermore, when faced with knowledge-intensive or domain-specific scenarios, such as scientific illustrations or mathematical plots, the model often exhibits hallucinations, factual errors, or structural inconsistencies. These findings suggest that while GPT-4o marks a substantial advancement in unified multimodal generation, there is still a long way to go before it can be reliably applied to professional or safety-critical domains.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 May 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generation
  2. 2025An Empirical Study of GPT-4o Image Generation Capabilities
  3. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation
  4. 2025Why Compress What You Can Generate? When GPT-4o Generation Ushers in Image Compression Fields
  5. 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generation
  6. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)
  7. 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Tasks
  8. 2024Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency