Label Efficient Learning of Transferable Representations across Domains and Tasks
Not on the map. Why?
Abstract (arXiv)
We propose a framework that learns a representation transferable across different domains and tasks in a label efficient manner. Our approach battles domain shift with a domain adversarial loss, and generalizes the embedding to novel task using a metric learning-based approach. Our model is simultaneously optimized on labeled source data and unlabeled or sparsely labeled data in the target domain. Our method shows compelling results on novel classes within a new domain even when only a few labeled examples per class are available, outperforming the prevalent fine-tuning approach. In addition, we demonstrate the effectiveness of our framework on the transfer learning task from image object recognition to video action recognition.
Key facts. Cited by 49 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 14; 2023: 10; 2024: 1; 2025: 4; 2026: 2.
49 papers.
Sort:
- 2021Source-Free Adaptation to Measurement Shift via Bottom-Up Feature Restorationcited by 50
- 2023A Survey on Few-Shot Class-Incremental Learningcited by 48
- 2025Model Adaptation: Unsupervised Domain Adaptation without Source Datacited by 34
- 2021ECACL: A Holistic Framework for Semi-Supervised Domain Adaptationcited by 31
- 2021Iterative Feature Matching: Toward Provable Domain Generalization with Logarithmic Environmentscited by 30
- 2021Zero-Shot Dense Retrieval with Momentum Adversarial Domain Invariant Representationscited by 27
- 2021Self-Attentive Spatial Adaptive Normalization for Cross-Modality Domain Adaptationcited by 24
- 2022GATE: Graph CCA for Temporal SElf-supervised Learning for Label-efficient fMRI Analysiscited by 19
- 2022Unsupervised Structure-Texture Separation Network for Oracle Character Recognitioncited by 15
- 2021CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networkscited by 12
- 2021What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Datacited by 10
- 2021Transfer Learning for Pose Estimation of Illustrated Characterscited by 10
37 more
- 2022From Big to Small: Adaptive Learning to Partial-Set Domainscited by 9
- 2023Differentially Private Video Activity Recognitioncited by 9
- 2021Task Affinity with Maximum Bipartite Matching in Few-Shot Learningcited by 8
- 2022Learning Unbiased Transferability for Domain Adaptation by Uncertainty Modelingcited by 8
- 2021Fisher Task Distance and Its Application in Neural Architecture Searchcited by 7
- 2022Cluster-to-adapt: Few Shot Domain Adaptation for Semantic Segmentation across Disjoint Labelscited by 7
- 2023Taxonomy Adaptive Cross-Domain Adaptation in Medical Imaging via Optimization Trajectory Distillationcited by 7
- 2025Steady Progress Beats Stagnation: Mutual Aid of Foundation and Conventional Models in Mixed Domain Semi-Supervised Medical Image Segmentationcited by 7
- 2021MetaCloth: Learning Unseen Tasks of Dense Fashion Landmark Detection from a Few Samplescited by 6
- 2022How to Fine-tune Models with Few Samples: Update, Data Augmentation, and Test-time Augmentationcited by 6
- 2021Multi-task Learning by Leveraging the Semantic Informationcited by 5
- 2022When Facial Expression Recognition Meets Few-Shot Learning: A Joint and Alternate Learning Frameworkcited by 5
- 2022Unsupervised Domain Adaptation Using Feature Disentanglement And GCNs For Medical Image Classificationcited by 5
- 2023Oracle Character Recognition using Unsupervised Discriminative Consistency Networkcited by 5
- 2021Self-Taught Cross-Domain Few-Shot Learning with Weakly Supervised Object Localization and Task-Decompositioncited by 4
- 2022Gap Minimization for Knowledge Sharing and Transfercited by 4
- 2022Metric Based Few-Shot Graph Classificationcited by 4
- 2023Interpretations of Domain Adaptations via Layer Variational Analysiscited by 4
- 2025FocalLens: Instruction Tuning Enables Zero-Shot Conditional Image Representationscited by 4
- 2021Improved Automated Machine Learning from Transfer Learningcited by 3
- 2022Heterogeneous Domain Adaptation with Adversarial Neural Representation Learning: Experiments on E-Commerce and Cybersecuritycited by 3
- 2023Bayesian Transfer Learningcited by 3
- 2025Leveraging Transfer Learning and Mobile-enabled Convolutional Neural Networks for Improved Arabic Handwritten Character Recognitioncited by 3
- 2021Learning Purified Feature Representations from Task-irrelevant Labelscited by 2
- 2023Mode-Aware Continual Learning for Conditional Generative Adversarial Networkscited by 2
- 2021Learning Invariant Representations across Domains and Taskscited by 1
- 2021More Separable and Easier to Segment: A Cluster Alignment Method for Cross-Domain Semantic Segmentationcited by 1
- 2021Self-Adaptive Partial Domain Adaptationcited by 1
- 2022Cycle Label-Consistent Networks for Unsupervised Domain Adaptationcited by 1
- 2022Instance-level Heterogeneous Domain Adaptation for Limited-labeled Sketch-to-Photo Retrievalcited by 1
- 2023Efficient Large-Scale Visual Representation Learning And Evaluationcited by 1
- 2022A Survey on Computational Intelligence-based Transfer Learningcited by 0
- 2023Domain Adaptive Semantic Segmentation by Optimal Transportcited by 0
- 2023Incorporating Experts' Judgment into Machine Learning Modelscited by 0
- 2024Unsupervised Attention Regularization Based Domain Adaptation for Oracle Character Recognitioncited by 0
- 2026Generative Cross-Entropy: A Strictly Proper Loss for Data-Efficient Classificationcited by 0
- 2026A Transfer Learning Evaluation of Deep Neural Networks for Image Classificationcited by 0
- 2026A Transfer Learning Evaluation of Deep Neural Networks for Image Classification12 May 2026
- 2026Generative Cross-Entropy: A Strictly Proper Loss for Data-Efficient Classification8 Apr 2026
- 2025Leveraging Transfer Learning and Mobile-enabled Convolutional Neural Networks for Improved Arabic Handwritten Character Recognition5 Sep 2025
- 2025FocalLens: Instruction Tuning Enables Zero-Shot Conditional Image Representations11 Apr 2025
- 2025Steady Progress Beats Stagnation: Mutual Aid of Foundation and Conventional Models in Mixed Domain Semi-Supervised Medical Image Segmentation21 Mar 2025
- 2025Model Adaptation: Unsupervised Domain Adaptation without Source Data26 Feb 2025
- 2024Unsupervised Attention Regularization Based Domain Adaptation for Oracle Character Recognition24 Sep 2024
- 2023Bayesian Transfer Learning20 Dec 2023
- 2023Oracle Character Recognition using Unsupervised Discriminative Consistency Network11 Dec 2023
- 2023Taxonomy Adaptive Cross-Domain Adaptation in Medical Imaging via Optimization Trajectory Distillation27 Jul 2023
- 2023Differentially Private Video Activity Recognition27 Jun 2023
- 2023Efficient Large-Scale Visual Representation Learning And Evaluation22 May 2023
37 more
- 2023Mode-Aware Continual Learning for Conditional Generative Adversarial Networks19 May 2023
- 2023Incorporating Experts' Judgment into Machine Learning Models24 Apr 2023
- 2023A Survey on Few-Shot Class-Incremental Learning17 Apr 2023
- 2023Domain Adaptive Semantic Segmentation by Optimal Transport29 Mar 2023
- 2023Interpretations of Domain Adaptations via Layer Variational Analysis3 Feb 2023
- 2022Instance-level Heterogeneous Domain Adaptation for Limited-labeled Sketch-to-Photo Retrieval26 Nov 2022
- 2022Cluster-to-adapt: Few Shot Domain Adaptation for Semantic Segmentation across Disjoint Labels4 Aug 2022
- 2022Unsupervised Domain Adaptation Using Feature Disentanglement And GCNs For Medical Image Classification27 Jun 2022
- 2022A Survey on Computational Intelligence-based Transfer Learning17 Jun 2022
- 2022Metric Based Few-Shot Graph Classification8 Jun 2022
- 2022Learning Unbiased Transferability for Domain Adaptation by Uncertainty Modeling2 Jun 2022
- 2022Cycle Label-Consistent Networks for Unsupervised Domain Adaptation27 May 2022
- 2022How to Fine-tune Models with Few Samples: Update, Data Augmentation, and Test-time Augmentation13 May 2022
- 2022Unsupervised Structure-Texture Separation Network for Oracle Character Recognition13 May 2022
- 2022Heterogeneous Domain Adaptation with Adversarial Neural Representation Learning: Experiments on E-Commerce and Cybersecurity5 May 2022
- 2022GATE: Graph CCA for Temporal SElf-supervised Learning for Label-efficient fMRI Analysis17 Mar 2022
- 2022From Big to Small: Adaptive Learning to Partial-Set Domains14 Mar 2022
- 2022Gap Minimization for Knowledge Sharing and Transfer26 Jan 2022
- 2022When Facial Expression Recognition Meets Few-Shot Learning: A Joint and Alternate Learning Framework18 Jan 2022
- 2021MetaCloth: Learning Unseen Tasks of Dense Fashion Landmark Detection from a Few Samples6 Dec 2021
- 2021Zero-Shot Dense Retrieval with Momentum Adversarial Domain Invariant Representations14 Oct 2021
- 2021Task Affinity with Maximum Bipartite Matching in Few-Shot Learning5 Oct 2021
- 2021Self-Adaptive Partial Domain Adaptation18 Sep 2021
- 2021Self-Taught Cross-Domain Few-Shot Learning with Weakly Supervised Object Localization and Task-Decomposition3 Sep 2021
- 2021Transfer Learning for Pose Estimation of Illustrated Characters4 Aug 2021
- 2021Source-Free Adaptation to Measurement Shift via Bottom-Up Feature Restoration12 Jul 2021
- 2021Iterative Feature Matching: Toward Provable Domain Generalization with Logarithmic Environments18 Jun 2021
- 2021What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Data11 Jun 2021
- 2021More Separable and Easier to Segment: A Cluster Alignment Method for Cross-Domain Semantic Segmentation7 May 2021
- 2021ECACL: A Holistic Framework for Semi-Supervised Domain Adaptation19 Apr 2021
- 2021Fisher Task Distance and Its Application in Neural Architecture Search23 Mar 2021
- 2021CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks6 Mar 2021
- 2021Self-Attentive Spatial Adaptive Normalization for Cross-Modality Domain Adaptation5 Mar 2021
- 2021Learning Invariant Representations across Domains and Tasks3 Mar 2021
- 2021Multi-task Learning by Leveraging the Semantic Information3 Mar 2021
- 2021Improved Automated Machine Learning from Transfer Learning27 Feb 2021
- 2021Learning Purified Feature Representations from Task-irrelevant Labels22 Feb 2021
- 2021Source-Free Adaptation to Measurement Shift via Bottom-Up Feature Restorationcited by 50
- 2023A Survey on Few-Shot Class-Incremental Learningcited by 48
- 2025Model Adaptation: Unsupervised Domain Adaptation without Source Datacited by 34
- 2021ECACL: A Holistic Framework for Semi-Supervised Domain Adaptationcited by 31
- 2021Iterative Feature Matching: Toward Provable Domain Generalization with Logarithmic Environmentscited by 30
- 2021Zero-Shot Dense Retrieval with Momentum Adversarial Domain Invariant Representationscited by 27
- 2021Self-Attentive Spatial Adaptive Normalization for Cross-Modality Domain Adaptationcited by 24
- 2022GATE: Graph CCA for Temporal SElf-supervised Learning for Label-efficient fMRI Analysiscited by 19
- 2022Unsupervised Structure-Texture Separation Network for Oracle Character Recognitioncited by 15
- 2021CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networkscited by 12
- 2021What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Datacited by 10
- 2021Transfer Learning for Pose Estimation of Illustrated Characterscited by 10
12 most cited of 49 All 49 (JSON)
- 2026A Transfer Learning Evaluation of Deep Neural Networks for Image Classification12 May 2026
- 2026Generative Cross-Entropy: A Strictly Proper Loss for Data-Efficient Classification8 Apr 2026
- 2025Leveraging Transfer Learning and Mobile-enabled Convolutional Neural Networks for Improved Arabic Handwritten Character Recognition5 Sep 2025
- 2025FocalLens: Instruction Tuning Enables Zero-Shot Conditional Image Representations11 Apr 2025
- 2025Steady Progress Beats Stagnation: Mutual Aid of Foundation and Conventional Models in Mixed Domain Semi-Supervised Medical Image Segmentation21 Mar 2025
- 2025Model Adaptation: Unsupervised Domain Adaptation without Source Data26 Feb 2025
- 2024Unsupervised Attention Regularization Based Domain Adaptation for Oracle Character Recognition24 Sep 2024
- 2023Bayesian Transfer Learning20 Dec 2023
- 2023Oracle Character Recognition using Unsupervised Discriminative Consistency Network11 Dec 2023
- 2023Taxonomy Adaptive Cross-Domain Adaptation in Medical Imaging via Optimization Trajectory Distillation27 Jul 2023
- 2023Differentially Private Video Activity Recognition27 Jun 2023
- 2023Efficient Large-Scale Visual Representation Learning And Evaluation22 May 2023
12 newest of 49 All 49 (JSON)