mlsanityData to 14 Oct 2026

A Unified Interactive Model Evaluation for Classification, Object Detection, and Instance Segmentation in Computer Vision

arXiv 2308.05168 ↗First posted 9 Aug 2023cs.CV cs.HCcited by 8

Not on the map. Why?

Abstract (arXiv)

Existing model evaluation tools mainly focus on evaluating classification models, leaving a gap in evaluating more complex models, such as object detection. In this paper, we develop an open-source visual analysis tool, Uni-Evaluator, to support a unified model evaluation for classification, object detection, and instance segmentation in computer vision. The key idea behind our method is to formulate both discrete and continuous predictions in different tasks as unified probability distributions. Based on these distributions, we develop 1) a matrix-based visualization to provide an overview of model performance; 2) a table visualization to identify the problematic data subsets where the model performs poorly; 3) a grid visualization to display the samples of interest. These visualizations work together to facilitate the model evaluation from a global overview to individual samples. Two case studies demonstrate the effectiveness of Uni-Evaluator in evaluating model performance and making informed improvements.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 40 of its 74 references that are in the map. First posted on arXiv 9 Aug 2023.

Builds on

40 of 74 references.

References · 40

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2022A ConvNet for the 2020scited by 3,579
  5. 2015Fast R-CNNcited by 2,933
  6. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  7. 2017A Survey on Multi-Task Learningcited by 840
  8. 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 691
  9. 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 672
  10. 2016TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systemscited by 664
  11. 2020Image Segmentation Using Deep Learning: A Surveycited by 660
  12. 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 596
28 more
  1. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
  2. 2018Deep Learning for Generic Object Detection: A Surveycited by 392
  3. 2019iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Imagescited by 197
  4. 2018Boundary loss for highly unbalanced segmentationcited by 190
  5. 2022Focal Modulation Networkscited by 186
  6. 2018Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontierscited by 117
  7. 2020TIDE: A General Toolbox for Identifying Object Detection Errorscited by 114
  8. 2017Do Convolutional Neural Networks Learn Class Hierarchy?cited by 61
  9. 2020A Survey of Visual Analytics Techniques for Machine Learningcited by 56
  10. 2016Towards Better Analysis of Deep Convolutional Neural Networkscited by 51
  11. 2020Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Modelscited by 49
  12. 2018Geometric Understanding of Deep Learningcited by 41
  13. 2020OoDAnalyzer: Interactive Analysis of Out-of-Distribution Samplescited by 33
  14. 2020Analyzing the Noise Robustness of Deep Neural Networkscited by 31
  15. 2020Boxer: Interactive Comparison of Classifier Resultscited by 28
  16. 2020VATLD: A Visual Analytics System to Assess, Understand and Improve Traffic Light Detectioncited by 28
  17. 2022A Unified Understanding of Deep NLP Models for Text Classificationcited by 18
  18. 2021Neo: Generalizing Confusion Matrix Visualization to Hierarchical and Multi-Output Labelscited by 17
  19. 2019ConfusionFlow: A model-agnostic visualization for temporal analysis of classifier confusioncited by 15
  20. 2020Diagnosing Concept Drift with Visual Analyticscited by 14
  21. 2020Interactive Steering of Hierarchical Clusteringcited by 14
  22. 2022Visual Comparison of Language Model Adaptationcited by 14
  23. 2022Diagnosing Ensemble Few-Shot Classifierscited by 13
  24. 2019Empirical Upper Bound in Object Detection and Morecited by 12
  25. 2021Learning to Aggregate Multi-Scale Context for Instance Segmentation in Remote Sensing Imagescited by 12
  26. 2022DendroMap: Visual Exploration of Large-Scale Image Datasets for Machine Learning with Treemapscited by 12
  27. 2022Calibrate: Interactive Analysis of Probabilistic Model Outputcited by 6
  28. 2022MosaicSets: Embedding Set Systems into Grid Graphscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 3; 2026: 1.

8 papers.

  1. 2023Foundation Models Meet Visualizations: Challenges and Opportunitiescited by 31
  2. 2024Human-Guided Image Generation for Expanding Small-Scale Training Image Datasetscited by 10
  3. 2024AttributionScanner: A Visual Analytics System for Model Validation with Metadata-Free Slice Findingcited by 6
  4. 2025VISLIX: An XAI Framework for Validating Vision Models with Slice Discovery and Analysiscited by 5
  5. 2025Unlearning Comparator: A Visual Analytics System for Comparative Evaluation of Machine Unlearning Methodscited by 4
  6. 2024RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifierscited by 1
  7. 2025VisMoDAl: Visual Analytics for Evaluating and Improving Corruption Robustness of Vision-Language Modelscited by 1
  8. 2026Survey on Remote Sensing Scene Classification: From Traditional Methods to Large Generative AI Modelscited by 1