Preliminary Explorations with GPT-4o(mni) Native Image Generation
Not on the map. Why?
Abstract (arXiv)
Recently, the visual generation ability by GPT-4o(mni) has been unlocked by OpenAI. It demonstrates a very remarkable generation capability with excellent multimodal condition understanding and varied task instructions. In this paper, we aim to explore the capabilities of GPT-4o across various tasks. Inspired by previous study, we constructed a task taxonomy along with a carefully curated set of test samples to conduct a comprehensive qualitative test. Benefiting from GPT-4o's powerful multimodal comprehension, its image-generation process demonstrates abilities surpassing those of traditional image-generation tasks. Thus, regarding the dimensions of model capabilities, we evaluate its performance across six task categories: traditional image generation tasks, discriminative tasks, knowledge-based generation, commonsense-based generation, spatially-aware image generation, and temporally-aware image generation. These tasks not only assess the quality and conditional alignment of the model's outputs but also probe deeper into GPT-4o's understanding of real-world concepts. Our results reveal that GPT-4o performs impressively well in general-purpose synthesis tasks, showing strong capabilities in text-to-image generation, visual stylization, and low-level image processing. However, significant limitations remain in its ability to perform precise spatial reasoning, instruction-grounded generation, and consistent temporal prediction. Furthermore, when faced with knowledge-intensive or domain-specific scenarios, such as scientific illustrations or mathematical plots, the model often exhibits hallucinations, factual errors, or structural inconsistencies. These findings suggest that while GPT-4o marks a substantial advancement in unified multimodal generation, there is still a long way to go before it can be reliably applied to professional or safety-critical domains.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 May 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026PosterHarness: Turning Scientific Poster Generation into an Auditable Instruction-Following Benchmarkcited by 3
- 2025MultiEdit: Advancing Instruction-based Image Editing on Diverse and Challenging Taskscited by 2
- 2026Purify Once, Edit Freely: Breaking Image Protections under Model Mismatchcited by 2
- 2026MemCoT: Test-Time Scaling through Memory-Driven Chain-of-Thoughtcited by 2
- 2026Benchmarking and Enhancing Text-to-Image Models for Generating Visual Representations in Early Arithmetic Educationcited by 0
- 2026PosterHarness: Turning Scientific Poster Generation into an Auditable Instruction-Following Benchmark3 Jul 2026
- 2026Benchmarking and Enhancing Text-to-Image Models for Generating Visual Representations in Early Arithmetic Education29 May 2026
- 2026MemCoT: Test-Time Scaling through Memory-Driven Chain-of-Thought9 Apr 2026
- 2026Purify Once, Edit Freely: Breaking Image Protections under Model Mismatch13 Mar 2026
- 2025MultiEdit: Advancing Instruction-based Image Editing on Diverse and Challenging Tasks18 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generation
- 2025An Empirical Study of GPT-4o Image Generation Capabilities
- 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation
- 2025Why Compress What You Can Generate? When GPT-4o Generation Ushers in Image Compression Fields
- 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generation
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)
- 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Tasks
- 2024Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency