mlsanityData to 14 Oct 2026

Meta Input: How to Leverage Off-the-Shelf Deep Neural Networks

arXiv 2210.13186 ↗First posted 21 Oct 2022cs.LG cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

These days, although deep neural networks (DNNs) have achieved a noticeable progress in a wide range of research area, it lacks the adaptability to be employed in the real-world applications because of the environment discrepancy problem. Such a problem originates from the difference between training and testing environments, and it is widely known that it causes serious performance degradation, when a pretrained DNN model is applied to a new testing environment. Therefore, in this paper, we introduce a novel approach that allows end-users to exploit pretrained DNN models in their own testing environment without modifying the models. To this end, we present a textitmeta input which is an additional input transforming the distribution of testing data to be aligned with that of training data. The proposed meta input can be optimized with a small number of testing data only by considering the relation between testing input data and its output prediction. Also, it does not require any knowledge of the network's internal architecture and modification of its weight parameters. Then, the obtained meta input is added to testing data in order to shift the distribution of testing data to that of originally used training data. As a result, end-users can exploit well-trained models in their own testing environment which can differ from the training environment. We validate the effectiveness and versatility of the proposed meta input by showing the robustness against the environment discrepancy through the comprehensive experiments with various tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 45 references that are in the map. First posted on arXiv 21 Oct 2022.

Builds on

29 of 45 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  5. 2015SSD: Single Shot MultiBox Detectorcited by 3,130
  6. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
  7. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,329
  8. 2017Adversarial Discriminative Domain Adaptationcited by 1,311
  9. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
  10. 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 683
  11. 2018Deep Visual Domain Adaptation: A Surveycited by 635
  12. 2016Deep Transfer Learning with Joint Adaptation Networkscited by 612
17 more
  1. 2015Deep Speech 2: End-to-End Speech Recognition in English and Mandarincited by 451
  2. 2019Contrastive Adaptation Network for Unsupervised Domain Adaptationcited by 407
  3. 2017Semantic Foggy Scene Understanding with Synthetic Datacited by 403
  4. 2016Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networkscited by 308
  5. 2018Cross-Domain Weakly-Supervised Object Detection through Progressive Domain Adaptationcited by 218
  6. 2019Fixing the train-test resolution discrepancycited by 209
  7. 2016Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptationcited by 163
  8. 2018Adversarial Reprogramming of Neural Networkscited by 116
  9. 2016LipNet: End-to-End Sentence-level Lipreadingcited by 80
  10. 2020On the Value of Out-of-Distribution Testing: An Example of Goodhart's Lawcited by 74
  11. 2021Dynamic Weighted Learning for Unsupervised Domain Adaptationcited by 53
  12. 2021Cross-modal Adversarial Reprogrammingcited by 34
  13. 2015Deep Transfer Network: Unsupervised Domain Adaptationcited by 20
  14. 2022Speaker-adaptive Lip Reading with User-dependent Paddingcited by 17
  15. 2021Why Adversarial Reprogramming Works, When It Fails, and How to Tell the Differencecited by 13
  16. 2019Speaker Adaptive Training using Model Agnostic Meta-Learningcited by 8
  17. 2022Improved Input Reprogramming for GAN Conditioningcited by 7

Built on by

Not cited yet.