Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision
Not on the map. Why?
Abstract (arXiv)
Frontier general-purpose systems are rapidly expanding beyond visual understanding into capabilities traditionally handled by dedicated computer-vision models. As these capabilities expand, a central question for the computer-vision community is how far this reach extends, and what remains hard. We evaluate GPT-6 Astra alongside five frontier general-purpose AI systems across 34 capabilities and 55 benchmarks spanning nine areas of computer vision. We compare their performance with dedicated models and humans where suitable references are available. Astra demonstrates broad visual capability, with substantial gains over other frontier systems in visual and spatial reasoning and several forms of structured prediction. Across the state-of-the-art systems, a consistent pattern emerges. Capabilities involving semantic interpretation, reasoning, and object-centric prediction increasingly approach or reach available reference levels. In contrast, larger gaps remain when tasks require metric geometric accuracy, faithful reconstruction, temporally consistent dense prediction, or specialized fine-grained visual knowledge. Additional reasoning and specialist tools close selected gaps, but their benefits vary across capabilities. These results map a changing landscape of computer vision in which increasingly sophisticated visual tasks are accessible through a general-purpose interface, while precise and fidelity-sensitive perception remains an important frontier.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 68 of its 98 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
68 of 98 references.
References · 68
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
38 more
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,068
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2017Dense-Captioning Events in Videoscited by 793
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2017Benchmarking Single Image Dehazing and Beyondcited by 447
- 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 347
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 254
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 221
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 183
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 162
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 160
- 2024Vision language models are blind: Failing to translate detailed visual features into wordscited by 147
- 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 145
- 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 137
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 114
- 2018Pose2Seg: Detection Free Human Instance Segmentationcited by 107
- 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 89
- 2024Towards Open-ended Visual Quality Comparisoncited by 85
- 2025Detect Anything via Next Point Predictioncited by 73
- 2025Vision Language Models are Biasedcited by 66
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2022Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation
- 2025Reasoning in Computer Vision: Taxonomy, Models, Tasks, and Methodologies
- 2024UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling
- 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models
- 2024Mind the GAP: Glimpse-based Active Perception improves generalization and sample efficiency of visual reasoning
- 2026GST-Bench: Can VLMs Develop Global Spatial Awareness from Video?
- 2024VisionGPT: Vision-Language Understanding Agent Using Generalized Multimodal Framework
- 2025Beyond Recognition: Evaluating Visual Perspective Taking in Vision Language Models