Few-Shot Object Detection with Fully Cross-Transformer
Not on the map. Why?
Abstract (arXiv)
Few-shot object detection (FSOD), with the aim to detect novel objects using very few training examples, has recently attracted great research interest in the community. Metric-learning based methods have been demonstrated to be effective for this task using a two-branch based siamese network, and calculate the similarity between image regions and few-shot examples for detection. However, in previous works, the interaction between the two branches is only restricted in the detection head, while leaving the remaining hundreds of layers for separate feature extraction. Inspired by the recent work on vision transformers and vision-language transformers, we propose a novel Fully Cross-Transformer based model (FCT) for FSOD by incorporating cross-transformer into both the feature backbone and detection head. The asymmetric-batched cross-attention is proposed to aggregate the key information from the two branches with different batch sizes. Our model can improve the few-shot similarity learning between the two branches by introducing the multi-level interactions. Comprehensive experiments on both PASCAL VOC and MSCOCO FSOD benchmarks demonstrate the effectiveness of our model.
Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 28 Mar 2022.
Builds on
43 of 53 references.
References · 43
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
31 more
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2015Fast R-CNNcited by 2,933
- 2017Non-local Neural Networkscited by 2,293
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
- 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 751
- 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
- 2018Dynamic Few-Shot Visual Learning without Forgettingcited by 385
- 2020Frustratingly Simple Few-Shot Object Detectioncited by 282
- 2018Few-shot Object Detection via Feature Reweightingcited by 265
- 2019Few-Shot Object Detection with Attention-RPN and Multi-Relation Detectorcited by 206
- 2019Meta R-CNN : Towards General Solver for Instance-level Few-shot Learningcited by 182
- 2020CrossTransformers: spatially-aware few-shot transfercited by 174
- 2021FSCE: Few-Shot Object Detection via Contrastive Proposal Encodingcited by 168
- 2020Few-Shot Object Detection and Viewpoint Estimation for Objects in the Wildcited by 142
- 2020Multi-Scale Positive Sample Refinement for Few-Shot Object Detectioncited by 116
- 2021DeFRCN: Decoupled Faster R-CNN for Few-Shot Object Detectioncited by 106
- 2021Semantic Relation Reasoning for Shot-Stable Few-Shot Object Detectioncited by 79
- 2019One-Shot Object Detection with Co-Attention and Co-Excitationcited by 67
- 2021Meta Faster R-CNN: Towards Accurate Few-Shot Object Detection with Attentive Feature Alignmentcited by 57
- 2021Query Adaptive Few-Shot Object Detection with Heterogeneous Graph Convolutional Networkscited by 55
- 2021Dense Relation Distillation with Context-aware Aggregation for Few-Shot Object Detectioncited by 53
- 2021Hallucination Improves Few-Shot Object Detectioncited by 50
- 2022The Met Dataset: Instance-level Recognition for Artworkscited by 40
- 2021Partner-Assisted Learning for Few-Shot Image Classificationcited by 36
- 2021Dual-Awareness Attention for Few-Shot Object Detectioncited by 29
Built on by
Citing papers per year: 2022: 11; 2023: 21; 2024: 14; 2025: 13; 2026: 5.
64 papers.
Sort:
By area:
- 2023Multi-modal Queried Object Detection in the Wildcited by 47
- 2024Cross-Domain Few-Shot Object Detection via Enhanced Open-Set Object Detectorcited by 43
- 2023Explore the Power of Synthetic Data on Few-shot Object Detectioncited by 38
- 2023Vision Transformer Off-the-Shelf: A Surprising Baseline for Few-Shot Class-Agnostic Countingcited by 25
- 2023Supervised Masked Knowledge Distillation for Few-Shot Transformerscited by 23
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2024MoDE: CLIP Data Experts via Clusteringcited by 22
- 2023DiGeo: Discriminative Geometry-Aware Learning for Generalized Few-Shot Object Detectioncited by 21
- 2023Generating Features with Increased Crop-related Diversity for Few-Shot Object Detectioncited by 21
- 2022FS-DETR: Few-Shot DEtection TRansformer with prompting and without re-trainingcited by 20
- 2022Few-Shot Learning Meets Transformer: Unified Query-Support Transformers for Few-Shot Classificationcited by 16
- 2023Detect Everything with Few Examplescited by 14
38 more
- 2022Disentangle and Remerge: Interventional Knowledge Distillation for Few-Shot Object Detection from A Conditional Causal Perspectivecited by 13
- 2022Breaking Immutable: Information-Coupled Prototype Elaboration for Few-Shot Object Detectioncited by 12
- 2023Reference Twice: A Simple and Unified Baseline for Few-Shot Instance Segmentationcited by 12
- 2022Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Promptingcited by 11
- 2024Fine-Grained Prototypes Distillation for Few-Shot Object Detectioncited by 10
- 2024AirShot: Efficient Few-Shot Detection for Autonomous Explorationcited by 10
- 2022Integrally Migrating Pre-trained Transformer Encoder-decoders for Visual Object Detectioncited by 9
- 2025No time to train! Training-Free Reference-Based Instance Segmentationcited by 9
- 2022Hierarchical Few-Shot Object Detection: Problem, Benchmark and Methodcited by 8
- 2023FER-former: Multi-modal Transformer for Facial Expression Recognitioncited by 8
- 2024SMILe: Leveraging Submodular Mutual Information For Robust Few-Shot Object Detectioncited by 8
- 2025Fine-Grained Zero-Shot Object Detectioncited by 8
- 2023Identification of Novel Classes for Improving Few-Shot Object Detectioncited by 7
- 2022Hierarchical Attention Network for Few-Shot Object Detection via Meta-Contrastive Learningcited by 6
- 2024Chameleon: A Data-Efficient Generalist for Dense Visual Prediction in the Wildcited by 6
- 2024Learning Unknowns from Unknowns: Diversified Negative Prototypes Generator for Few-Shot Open-Set Recognitioncited by 6
- 2025Multi-Perspective Data Augmentation for Few-shot Object Detectioncited by 6
- 2025Generalized Semantic Contrastive Learning via Embedding Side Information for Few-Shot Object Detectioncited by 6
- 2025Visual Textualization for Image Prompted Object Detectioncited by 6
- 2023The Art of Camouflage: Few-Shot Learning for Animal Detection and Segmentationcited by 5
- 2023Improved Region Proposal Network for Enhanced Few-Shot Object Detectioncited by 5
- 2024Cross-domain Multi-modal Few-shot Object Detection via Rich Textcited by 5
- 2024Search and Detect: Training-Free Long Tail Object Detection via Web-Image Retrievalcited by 5
- 2022Enhancing Few-shot Image Classification with Cosine Transformercited by 4
- 2023Meta-tuning Loss Functions and Data Augmentation for Few-shot Object Detectioncited by 4
- 2023ECEA: Extensible Co-Existing Attention for Few-Shot Object Detectioncited by 4
- 2025CDFormer: Cross-Domain Few-Shot Object Detection Transformer Against Feature Confusioncited by 4
- 2025Decoupling Template Bias in CLIP: Harnessing Empty Prompts for Enhanced Few-Shot Learningcited by 4
- 2023An Effective Crop-Paste Pipeline for Few-shot Object Detectioncited by 3
- 2023Few-Shot Object Detection via Synthetic Features with Optimal Transportcited by 3
- 2026Learning Multi-Modal Prototypes for Cross-Domain Few-Shot Object Detectioncited by 3
- 2022Proposal Distribution Calibration for Few-Shot Object Detectioncited by 2
- 2023TIDE: Test Time Few Shot Object Detectioncited by 2
- 2024UniFS: Universal Few-shot Instance Perception with Point Representationscited by 2
- 2025Few-Shot Learning in Video and 3D Object Detection: A Surveycited by 2
- 2026FSOD-VFM: Few-Shot Object Detection with Vision Foundation Models and Graph Diffusioncited by 2
- 2022A Comparative Attention Framework for Better Few-Shot Object Detection on Aerial Imagescited by 1
- 2023Decoupled DETR For Few-shot Object Detectioncited by 1
50 most cited of 64 All 64 (JSON)
- 2026Robust Prototypical Networks for Few-Shot Sensor Fault Diagnosis10 Sep 2026
- 2026Personalized Object Identification and Localization via In-Context Inference with Vision-Language Models1 Jul 2026
- 2026Rethinking Prototype-based Similarity Learning for Few-Shot Object Detection22 Jun 2026
- 2026Learning Multi-Modal Prototypes for Cross-Domain Few-Shot Object Detection21 Feb 2026
- 2026FSOD-VFM: Few-Shot Object Detection with Vision Foundation Models and Graph Diffusion3 Feb 2026
- 2025Decoupling Template Bias in CLIP: Harnessing Empty Prompts for Enhanced Few-Shot Learning9 Dec 2025
- 2025FSP-DETR: Few-Shot Prototypical Parasitic Ova Detection10 Oct 2025
- 2025Few-Shot Pattern Detection via Template Matching and Regression25 Aug 2025
- 2025Few-Shot Learning in Video and 3D Object Detection: A Survey22 Jul 2025
- 2025Few-Shot Object Detection via Spatial-Channel State Space Model21 Jul 2025
- 2025Fine-Grained Zero-Shot Object Detection14 Jul 2025
- 2025No time to train! Training-Free Reference-Based Instance Segmentation3 Jul 2025
38 more
- 2025Visual Textualization for Image Prompted Object Detection30 Jun 2025
- 2025Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentation20 May 2025
- 2025CDFormer: Cross-Domain Few-Shot Object Detection Transformer Against Feature Confusion2 May 2025
- 2025Generalized Semantic Contrastive Learning via Embedding Side Information for Few-Shot Object Detection9 Apr 2025
- 2025Multi-Perspective Data Augmentation for Few-shot Object Detection25 Feb 2025
- 2025Cross-domain Few-shot Object Detection with Multi-modal Textual Enrichment23 Feb 2025
- 2024Cascaded Multi-Scale Attention for Enhanced Multi-Scale Feature Extraction and Interaction with Low-Resolution Images3 Dec 2024
- 2024Search and Detect: Training-Free Long Tail Object Detection via Web-Image Retrieval26 Sep 2024
- 2024CP-VoteNet: Contrastive Prototypical VoteNet for Few-Shot Point Cloud Object Detection30 Aug 2024
- 2024More Pictures Say More: Visual Intersection Network for Open Set Object Detection26 Aug 2024
- 2024Learning Unknowns from Unknowns: Diversified Negative Prototypes Generator for Few-Shot Open-Set Recognition23 Aug 2024
- 2024SMILe: Leveraging Submodular Mutual Information For Robust Few-Shot Object Detection2 Jul 2024
- 2024WIDIn: Wording Image for Domain-Invariant Representation in Single-Source Domain Generalization28 May 2024
- 2024UniFS: Universal Few-shot Instance Perception with Point Representations30 Apr 2024
- 2024Chameleon: A Data-Efficient Generalist for Dense Visual Prediction in the Wild29 Apr 2024
- 2024MoDE: CLIP Data Experts via Clustering24 Apr 2024
- 2024AirShot: Efficient Few-Shot Detection for Autonomous Exploration7 Apr 2024
- 2024Cross-domain Multi-modal Few-shot Object Detection via Rich Text24 Mar 2024
- 2024Cross-Domain Few-Shot Object Detection via Enhanced Open-Set Object Detector5 Feb 2024
- 2024Fine-Grained Prototypes Distillation for Few-Shot Object Detection15 Jan 2024
- 2023TIDE: Test Time Few Shot Object Detection30 Nov 2023
- 2023Decoupled DETR For Few-shot Object Detection20 Nov 2023
- 2023SKU-Patch: Towards Efficient Instance Segmentation for Unseen Objects in Auto-Store8 Nov 2023
- 2023Re-Scoring Using Image-Language Similarity for Few-Shot Object Detection1 Nov 2023
- 2023Detect Everything with Few Examples22 Sep 2023
- 2023ECEA: Extensible Co-Existing Attention for Few-Shot Object Detection15 Sep 2023
- 2023Few-Shot Object Detection via Synthetic Features with Optimal Transport29 Aug 2023
- 2023Improved Region Proposal Network for Enhanced Few-Shot Object Detection15 Aug 2023
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directions12 Jul 2023
- 2023Multi-modal Queried Object Detection in the Wild30 May 2023
- 2023Vision Transformer Off-the-Shelf: A Surprising Baseline for Few-Shot Class-Agnostic Counting8 May 2023
- 2023Meta-tuning Loss Functions and Data Augmentation for Few-shot Object Detection24 Apr 2023
- 2023The Art of Camouflage: Few-Shot Learning for Animal Detection and Segmentation15 Apr 2023
- 2023Generating Features with Increased Crop-related Diversity for Few-Shot Object Detection11 Apr 2023
- 2023Supervised Masked Knowledge Distillation for Few-Shot Transformers25 Mar 2023
- 2023Explore the Power of Synthetic Data on Few-shot Object Detection23 Mar 2023
- 2023FER-former: Multi-modal Transformer for Facial Expression Recognition23 Mar 2023
- 2023Identification of Novel Classes for Improving Few-Shot Object Detection18 Mar 2023
50 newest of 64 All 64 (JSON)
- 2023Multi-modal Queried Object Detection in the Wildcited by 47
- 2024Cross-Domain Few-Shot Object Detection via Enhanced Open-Set Object Detectorcited by 43
- 2023Explore the Power of Synthetic Data on Few-shot Object Detectioncited by 38
- 2023Vision Transformer Off-the-Shelf: A Surprising Baseline for Few-Shot Class-Agnostic Countingcited by 25
- 2024MoDE: CLIP Data Experts via Clusteringcited by 22
- 2023DiGeo: Discriminative Geometry-Aware Learning for Generalized Few-Shot Object Detectioncited by 21
- 2023Generating Features with Increased Crop-related Diversity for Few-Shot Object Detectioncited by 21
- 2022FS-DETR: Few-Shot DEtection TRansformer with prompting and without re-trainingcited by 20
- 2022Few-Shot Learning Meets Transformer: Unified Query-Support Transformers for Few-Shot Classificationcited by 16
- 2023Detect Everything with Few Examplescited by 14
- 2022Breaking Immutable: Information-Coupled Prototype Elaboration for Few-Shot Object Detectioncited by 12
- 2023Reference Twice: A Simple and Unified Baseline for Few-Shot Instance Segmentationcited by 12
12 most cited of 57 All 57 (JSON)
- 2026Robust Prototypical Networks for Few-Shot Sensor Fault Diagnosis10 Sep 2026
- 2026Rethinking Prototype-based Similarity Learning for Few-Shot Object Detection22 Jun 2026
- 2026Learning Multi-Modal Prototypes for Cross-Domain Few-Shot Object Detection21 Feb 2026
- 2026FSOD-VFM: Few-Shot Object Detection with Vision Foundation Models and Graph Diffusion3 Feb 2026
- 2025Decoupling Template Bias in CLIP: Harnessing Empty Prompts for Enhanced Few-Shot Learning9 Dec 2025
- 2025FSP-DETR: Few-Shot Prototypical Parasitic Ova Detection10 Oct 2025
- 2025Few-Shot Pattern Detection via Template Matching and Regression25 Aug 2025
- 2025Few-Shot Learning in Video and 3D Object Detection: A Survey22 Jul 2025
- 2025Fine-Grained Zero-Shot Object Detection14 Jul 2025
- 2025No time to train! Training-Free Reference-Based Instance Segmentation3 Jul 2025
- 2025Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentation20 May 2025
- 2025CDFormer: Cross-Domain Few-Shot Object Detection Transformer Against Feature Confusion2 May 2025
12 newest of 57 All 57 (JSON)