mlsanityData to 14 Oct 2026

LMC: Large Model Collaboration with Cross-assessment for Training-Free Open-Set Object Recognition

arXiv 2309.12780 ↗First posted 22 Sep 2023cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Open-set object recognition aims to identify if an object is from a class that has been encountered during training or not. To perform open-set object recognition accurately, a key challenge is how to reduce the reliance on spurious-discriminative features. In this paper, motivated by that different large models pre-trained through different paradigms can possess very rich while distinct implicit knowledge, we propose a novel framework named Large Model Collaboration (LMC) to tackle the above challenge via collaborating different off-the-shelf large models in a training-free manner. Moreover, we also incorporate the proposed framework with several novel designs to effectively extract implicit knowledge from large models. Extensive experiments demonstrate the efficacy of our proposed framework. Code is available https://github.com/Harryqu123/LMC

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 58 of its 75 references that are in the map. First posted on arXiv 22 Sep 2023.

Builds on

58 of 75 references.

References · 58

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  7. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  8. 2016Concrete Problems in AI Safetycited by 1,642
  9. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
  10. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  11. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
  12. 2015Towards Open Set Deep Networkscited by 538
38 more
  1. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  2. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 488
  3. 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
  4. 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 353
  5. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 331
  6. 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
  7. 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 256
  8. 2018Reducing Network Agnostophobiacited by 165
  9. 2017Generative OpenMax for Multi-Class Open Set Classificationcited by 157
  10. 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
  11. 2021Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIPcited by 152
  12. 2023Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learnerscited by 152
  13. 2018Classification-Reconstruction Learning for Open-Set Recognitioncited by 146
  14. 2019C2AE: Class Conditioned Auto-Encoder for Open-set Recognitioncited by 142
  15. 2021OpenGAN: Open-Set Recognition via Open Data Generationcited by 135
  16. 2018Robust Classification with Convolutional Prototype Learningcited by 123
  17. 2021Learning Placeholders for Open-Set Recognitioncited by 121
  18. 2020Learning Open Set Network with Discriminative Reciprocal Pointscited by 115
  19. 2017DOC: Deep Open Classification of Text Documentscited by 109
  20. 2020Hybrid Models for Open Set Recognitioncited by 109
  21. 2018The Limits and Potentials of Deep Learning for Roboticscited by 104
  22. 2020Conditional Gaussian Distribution Learning for Open Set Recognitioncited by 104
  23. 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
  24. 2023ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding with GPT and Prototype Guidancecited by 70
  25. 2023C-SFDA: A Curriculum Learning Aided Self-Training Framework for Efficient Source Free Domain Adaptationcited by 50
  26. 2023CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Modelcited by 47
  27. 2021Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learningcited by 42
  28. 2018Learning a Neural-network-based Representation for Open Set Recognitioncited by 40
  29. 2019Deep Transfer Learning for Multiple Class Novelty Detectioncited by 33
  30. 2021How Transferable Are Self-supervised Features in Medical Image Classification Tasks?cited by 33
  31. 2022OpenAUC: Towards AUC-Oriented Open-Set Recognitioncited by 33
  32. 2019P-ODN: Prototype based Open Deep Network for Open Set Recognitioncited by 28
  33. 2022Class-Specific Semantic Reconstruction for Open Set Recognitioncited by 28
  34. 2022PMAL: Open Set Recognition via Robust Prototype Miningcited by 27
  35. 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
  36. 2022Difficulty-Aware Simulator for Open Set Recognitioncited by 24
  37. 2022Multimodal Open-Vocabulary Video Classification via Pre-Trained Vision and Language Modelscited by 22
  38. 2023AutoLabel: CLIP-based framework for Open-set Video Domain Adaptationcited by 18

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 5; 2025: 3; 2026: 1.

10 papers.