mlsanityData to 14 Oct 2026

Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision

arXiv 2609.35718 ↗First posted 28 Sep 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Frontier general-purpose systems are rapidly expanding beyond visual understanding into capabilities traditionally handled by dedicated computer-vision models. As these capabilities expand, a central question for the computer-vision community is how far this reach extends, and what remains hard. We evaluate GPT-6 Astra alongside five frontier general-purpose AI systems across 34 capabilities and 55 benchmarks spanning nine areas of computer vision. We compare their performance with dedicated models and humans where suitable references are available. Astra demonstrates broad visual capability, with substantial gains over other frontier systems in visual and spatial reasoning and several forms of structured prediction. Across the state-of-the-art systems, a consistent pattern emerges. Capabilities involving semantic interpretation, reasoning, and object-centric prediction increasingly approach or reach available reference levels. In contrast, larger gaps remain when tasks require metric geometric accuracy, faithful reconstruction, temporally consistent dense prediction, or specialized fine-grained visual knowledge. Additional reasoning and specialist tools close selected gaps, but their benefits vary across capabilities. These results map a changing landscape of computer vision in which increasingly sophisticated visual tasks are accessible through a general-purpose interface, while precise and fidelity-sensitive perception remains an important frontier.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 68 of its 98 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

68 of 98 references.

References · 68

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  3. 2023Segment Anythingcited by 8,234
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  7. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  9. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  11. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  12. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
38 more
  1. 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,068
  2. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  3. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  4. 2025SAM 3: Segment Anything with Conceptscited by 906
  5. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  6. 2017Dense-Captioning Events in Videoscited by 793
  7. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  8. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
  9. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  10. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
  11. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  12. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  13. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  14. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  15. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
  16. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
  17. 2017Benchmarking Single Image Dehazing and Beyondcited by 447
  18. 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 347
  19. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
  20. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
  21. 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 254
  22. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
  23. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
  24. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  25. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 221
  26. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 183
  27. 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 162
  28. 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 160
  29. 2024Vision language models are blind: Failing to translate detailed visual features into wordscited by 147
  30. 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 145
  31. 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 137
  32. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
  33. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 114
  34. 2018Pose2Seg: Detection Free Human Instance Segmentationcited by 107
  35. 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 89
  36. 2024Towards Open-ended Visual Quality Comparisoncited by 85
  37. 2025Detect Anything via Next Point Predictioncited by 73
  38. 2025Vision Language Models are Biasedcited by 66

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2022Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation
  2. 2025Reasoning in Computer Vision: Taxonomy, Models, Tasks, and Methodologies
  3. 2024UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling
  4. 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models
  5. 2024Mind the GAP: Glimpse-based Active Perception improves generalization and sample efficiency of visual reasoning
  6. 2026GST-Bench: Can VLMs Develop Global Spatial Awareness from Video?
  7. 2024VisionGPT: Vision-Language Understanding Agent Using Generalized Multimodal Framework
  8. 2025Beyond Recognition: Evaluating Visual Perspective Taking in Vision Language Models