mlsanityData to 7 Oct 2026

Recognize Anything: A Strong Image Tagging Model

arXiv 2306.03514 ↗First posted 6 Jun 2023cs.CVcited by 305

Not on the map. Why?

Cited by 68 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present the Recognize Anything Model (RAM): a strong foundation model for image tagging. RAM makes a substantial step for large models in computer vision, demonstrating the zero-shot ability to recognize any common category with high accuracy. RAM introduces a new paradigm for image tagging, leveraging large-scale image-text pairs for training instead of manual annotations. The development of RAM comprises four key steps. Firstly, annotation-free image tags are obtained at scale through automatic text semantic parsing. Subsequently, a preliminary model is trained for automatic annotation by unifying the caption and tagging tasks, supervised by the original texts and parsed tags, respectively. Thirdly, a data engine is employed to generate additional annotations and clean incorrect ones. Lastly, the model is retrained with the processed data and fine-tuned using a smaller but higher-quality dataset. We evaluate the tagging capabilities of RAM on numerous benchmarks and observe impressive zero-shot performance, significantly outperforming CLIP and BLIP. Remarkably, RAM even surpasses the fully supervised manners and exhibits competitive performance with the Google tagging API. We are releasing the RAM at urlhttps://recognize-anything.github.io/ to foster the advancements of large models in computer vision.

Key facts. Cited by 305 papers in the map (data through 7 Oct 2026). Builds on 23 of its 36 references that are in the map. First posted on arXiv 6 Jun 2023.

Builds on

23 of 36 references.

References · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2023Segment Anythingcited by 8,158
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  7. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  9. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  10. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  11. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
  12. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
11 more
  1. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
  2. 2020Asymmetric Loss For Multi-Label Classificationcited by 379
  3. 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
  4. 2022Open-Vocabulary DETR with Conditional Matchingcited by 220
  5. 2022Focal Modulation Networkscited by 186
  6. 2021Query2Label: A Simple Transformer Way to Multi-Label Classificationcited by 126
  7. 2023Tag2Text: Guiding Vision-Language Model via Image Taggingcited by 84
  8. 2021ML-Decoder: Scalable and Versatile Classification Headcited by 78
  9. 2022Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfercited by 33
  10. 2021Simple and Robust Loss Design for Multi-Label Learning with Missing Labelscited by 30
  11. 2022IDEA: Increasing Text Diversity via Online Multi-Label Recognition for Vision-Language Pre-trainingcited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 40; 2024: 110; 2025: 98; 2026: 57.

305 papers.

Sort:

By area:

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  3. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  4. 2025VACE: All-in-One Video Creation and Editingcited by 467
  5. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 447
  6. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  7. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
  8. 2024A Survey on Hallucination in Large Vision-Language Modelscited by 352
  9. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
  10. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 297
  11. 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
  12. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
38 more
  1. 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
  2. 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 188
  3. 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
  4. 2024An Introduction to Vision-Language Modelingcited by 175
  5. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 133
  6. 2024xGen-MM (BLIP-3): A Family of Open Large Multimodal Modelscited by 116
  7. 2023BuboGPT: Enabling Visual Grounding in Multi-Modal LLMscited by 114
  8. 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 109
  9. 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 108
  10. 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approachcited by 93
  11. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
  12. 2023LION : Empowering Multimodal Large Language Model with Dual-Level Visual Knowledgecited by 80
  13. 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
  14. 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 77
  15. 2024Open-Vocabulary SAM: Segment and Recognize Twenty-thousand Classes Interactivelycited by 74
  16. 2024VideoVista: A Versatile Benchmark for Video Understanding and Reasoningcited by 72
  17. 2024DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perceptioncited by 72
  18. 2023Open-Set Image Tagging with Multi-Grained Text Supervisioncited by 67
  19. 2024AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillationcited by 66
  20. 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Methodcited by 66
  21. 2024Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMscited by 60
  22. 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
  23. 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
  24. 2025Open-Vocabulary Functional 3D Scene Graphs for Real-World Indoor Spacescited by 53
  25. 2023PG-Video-LLaVA: Pixel Grounding Large Video-Language Modelscited by 50
  26. 2024AVHBench: A Cross-Modal Hallucination Benchmark for Audio-Visual Large Language Modelscited by 50
  27. 2025Seeing Far and Clearly: Mitigating Hallucinations in MLLMs with Attention Causal Decodingcited by 42
  28. 2024XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolutioncited by 41
  29. 2024NTIRE 2024 Challenge on Image Super-Resolution (x4): Methods and Resultscited by 40
  30. 2025Reinforced Visual Perception with Toolscited by 38
  31. 2024Segment Any Meshcited by 37
  32. 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Modelscited by 37
  33. 2025Visual Large Language Models for Generalized and Specialized Applicationscited by 35
  34. 2024OSDFace: One-Step Diffusion Model for Face Restorationcited by 33
  35. 2023HallE-Control: Controlling Object Hallucination in Large Multimodal Modelscited by 31
  36. 2024Getting it Right: Improving Spatial Consistency in Text-to-Image Modelscited by 30
  37. 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 30
  38. 2024Benchmarking Large Vision-Language Models via Directed Scene Graph for Comprehensive Image Captioningcited by 30

50 most cited of 305 All 305 (JSON)