LMC: Large Model Collaboration with Cross-assessment for Training-Free Open-Set Object Recognition
Not on the map. Why?
Abstract (arXiv)
Open-set object recognition aims to identify if an object is from a class that has been encountered during training or not. To perform open-set object recognition accurately, a key challenge is how to reduce the reliance on spurious-discriminative features. In this paper, motivated by that different large models pre-trained through different paradigms can possess very rich while distinct implicit knowledge, we propose a novel framework named Large Model Collaboration (LMC) to tackle the above challenge via collaborating different off-the-shelf large models in a training-free manner. Moreover, we also incorporate the proposed framework with several novel designs to effectively extract implicit knowledge from large models. Extensive experiments demonstrate the efficacy of our proposed framework. Code is available https://github.com/Harryqu123/LMC
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 58 of its 75 references that are in the map. First posted on arXiv 22 Sep 2023.
Builds on
58 of 75 references.
References · 58
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2016Concrete Problems in AI Safetycited by 1,642
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2015Towards Open Set Deep Networkscited by 538
38 more
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 488
- 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
- 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 353
- 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 331
- 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
- 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 256
- 2018Reducing Network Agnostophobiacited by 165
- 2017Generative OpenMax for Multi-Class Open Set Classificationcited by 157
- 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
- 2021Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIPcited by 152
- 2023Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learnerscited by 152
- 2018Classification-Reconstruction Learning for Open-Set Recognitioncited by 146
- 2019C2AE: Class Conditioned Auto-Encoder for Open-set Recognitioncited by 142
- 2021OpenGAN: Open-Set Recognition via Open Data Generationcited by 135
- 2018Robust Classification with Convolutional Prototype Learningcited by 123
- 2021Learning Placeholders for Open-Set Recognitioncited by 121
- 2020Learning Open Set Network with Discriminative Reciprocal Pointscited by 115
- 2017DOC: Deep Open Classification of Text Documentscited by 109
- 2020Hybrid Models for Open Set Recognitioncited by 109
- 2018The Limits and Potentials of Deep Learning for Roboticscited by 104
- 2020Conditional Gaussian Distribution Learning for Open Set Recognitioncited by 104
- 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
- 2023ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding with GPT and Prototype Guidancecited by 70
- 2023C-SFDA: A Curriculum Learning Aided Self-Training Framework for Efficient Source Free Domain Adaptationcited by 50
- 2023CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Modelcited by 47
- 2021Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learningcited by 42
- 2018Learning a Neural-network-based Representation for Open Set Recognitioncited by 40
- 2019Deep Transfer Learning for Multiple Class Novelty Detectioncited by 33
- 2021How Transferable Are Self-supervised Features in Medical Image Classification Tasks?cited by 33
- 2022OpenAUC: Towards AUC-Oriented Open-Set Recognitioncited by 33
- 2019P-ODN: Prototype based Open Deep Network for Open Set Recognitioncited by 28
- 2022Class-Specific Semantic Reconstruction for Open Set Recognitioncited by 28
- 2022PMAL: Open Set Recognition via Robust Prototype Miningcited by 27
- 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
- 2022Difficulty-Aware Simulator for Open Set Recognitioncited by 24
- 2022Multimodal Open-Vocabulary Video Classification via Pre-Trained Vision and Language Modelscited by 22
- 2023AutoLabel: CLIP-based framework for Open-set Video Domain Adaptationcited by 18
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 3; 2026: 1.
10 papers.
- 2024LLMs are Good Action Recognizerscited by 37
- 2024LTGC: Long-tail Recognition via Leveraging LLMs-driven Generated Contentcited by 33
- 2023A Survey on Open-Set Image Recognitioncited by 7
- 2025Informative Sample Selection Model for Skeleton-based Action Recognition with Limited Training Samplescited by 4
- 2026DiffGraph: An Automated Agent-driven Model Merging Framework for In-the-Wild Text-to-Image Generationcited by 4
- 2024GPT-Connect: Interaction between Text-Driven Human Motion Generator and 3D Scenes in a Training-free Mannercited by 3
- 2024Off-the-shelf ChatGPT is a Good Few-shot Human Motion Predictorcited by 1
- 2024LMSeg: Unleashing the Power of Large-Scale Models for Open-Vocabulary Semantic Segmentationcited by 1
- 2025CodeMerge: Codebook-Guided Model Merging for Robust Test-Time Adaptation in Autonomous Drivingcited by 1
- 2025Training-Free Label Space Alignment for Universal Domain Adaptationcited by 1
- 2026DiffGraph: An Automated Agent-driven Model Merging Framework for In-the-Wild Text-to-Image Generation20 Mar 2026
- 2025Informative Sample Selection Model for Skeleton-based Action Recognition with Limited Training Samples29 Oct 2025
- 2025Training-Free Label Space Alignment for Universal Domain Adaptation22 Sep 2025
- 2025CodeMerge: Codebook-Guided Model Merging for Robust Test-Time Adaptation in Autonomous Driving22 May 2025
- 2024LMSeg: Unleashing the Power of Large-Scale Models for Open-Vocabulary Semantic Segmentation30 Nov 2024
- 2024Off-the-shelf ChatGPT is a Good Few-shot Human Motion Predictor24 May 2024
- 2024LLMs are Good Action Recognizers31 Mar 2024
- 2024GPT-Connect: Interaction between Text-Driven Human Motion Generator and 3D Scenes in a Training-free Manner22 Mar 2024
- 2024LTGC: Long-tail Recognition via Leveraging LLMs-driven Generated Content9 Mar 2024
- 2023A Survey on Open-Set Image Recognition25 Dec 2023