What's in a Domain? Learning Domain-Robust Text Representations using Adversarial Training
Not on the map. Why?
Abstract (arXiv)
Most real world language problems require learning from heterogenous corpora, raising the problem of learning robust models which generalise well to both similar (in domain) and dissimilar (out of domain) instances to those seen in training. This requires learning an underlying task, while not learning irrelevant signals and biases specific to individual domains. We propose a novel method to optimise both in- and out-of-domain accuracy based on joint learning of a structured neural model with domain-specific and domain-general components, coupled with adversarial training for domain. Evaluating on multi-domain language identification and multi-domain sentiment analysis, we show substantial improvements over standard domain adaptation techniques, and domain-adversarial training.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 5; 2023: 1; 2024: 2; 2025: 2.
17 papers.
Sort:
By area:
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectivescited by 98
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 98
- 2021Diverse Adversaries for Mitigating Bias in Trainingcited by 48
- 2021Balancing out Bias: Achieving Fairness Through Balanced Trainingcited by 34
- 2021UDALM: Unsupervised Domain Adaptation through Language Modelingcited by 33
- 2021Cross-Domain Label-Adaptive Stance Detectioncited by 30
- 2021Uncertainty-Aware Balancing for Multilingual and Multi-Domain Neural Machine Translation Trainingcited by 19
- 2023Language Variety Identification with True Labelscited by 12
- 2022Towards Equal Opportunity Fairness through Adversarial Learningcited by 8
- 2022Explainable Misinformation Detection Across Multiple Social Media Platformscited by 5
- 2021Cross-Lingual Transfer Learning for Statistical Type Inferencecited by 2
- 2021ASAT: Adaptively Scaled Adversarial Training in Time Seriescited by 2
5 more
- 2024Auto-GDA: Automatic Domain Adaptation for Efficient Grounding Verification in Retrieval-Augmented Generationcited by 2
- 2025Multi-Domain Explainability of Preferencescited by 2
- 2025JurisCTC: Enhancing Legal Judgment Prediction via Cross-Domain Transfer and Contrastive Learningcited by 1
- 2022Utilizing Out-Domain Datasets to Enhance Multi-Task Citation Analysiscited by 0
- 2024Learning to Generalize Unseen Domains via Multi-Source Meta Learning for Text Classificationcited by 0
- 2025Multi-Domain Explainability of Preferences26 May 2025
- 2025JurisCTC: Enhancing Legal Judgment Prediction via Cross-Domain Transfer and Contrastive Learning24 Apr 2025
- 2024Auto-GDA: Automatic Domain Adaptation for Efficient Grounding Verification in Retrieval-Augmented Generation4 Oct 2024
- 2024Learning to Generalize Unseen Domains via Multi-Source Meta Learning for Text Classification20 Sep 2024
- 2023Language Variety Identification with True Labels2 Mar 2023
- 2022State-of-the-art generalisation research in NLP: A taxonomy and review6 Oct 2022
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives15 Aug 2022
- 2022Explainable Misinformation Detection Across Multiple Social Media Platforms20 Mar 2022
- 2022Towards Equal Opportunity Fairness through Adversarial Learning12 Mar 2022
- 2022Utilizing Out-Domain Datasets to Enhance Multi-Task Citation Analysis22 Feb 2022
- 2021Balancing out Bias: Achieving Fairness Through Balanced Training16 Sep 2021
- 2021Uncertainty-Aware Balancing for Multilingual and Multi-Domain Neural Machine Translation Training6 Sep 2021
5 more
- 2021ASAT: Adaptively Scaled Adversarial Training in Time Series20 Aug 2021
- 2021Cross-Lingual Transfer Learning for Statistical Type Inference1 Jul 2021
- 2021Cross-Domain Label-Adaptive Stance Detection15 Apr 2021
- 2021UDALM: Unsupervised Domain Adaptation through Language Modeling14 Apr 2021
- 2021Diverse Adversaries for Mitigating Bias in Training25 Jan 2021
- 2025Multi-Domain Explainability of Preferencescited by 2
- 2025Multi-Domain Explainability of Preferences26 May 2025
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectivescited by 98
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 98
- 2021Diverse Adversaries for Mitigating Bias in Trainingcited by 48
- 2021Balancing out Bias: Achieving Fairness Through Balanced Trainingcited by 34
- 2021UDALM: Unsupervised Domain Adaptation through Language Modelingcited by 33
- 2021Cross-Domain Label-Adaptive Stance Detectioncited by 30
- 2021Uncertainty-Aware Balancing for Multilingual and Multi-Domain Neural Machine Translation Trainingcited by 19
- 2023Language Variety Identification with True Labelscited by 12
- 2022Towards Equal Opportunity Fairness through Adversarial Learningcited by 8
- 2022Explainable Misinformation Detection Across Multiple Social Media Platformscited by 5
- 2021Cross-Lingual Transfer Learning for Statistical Type Inferencecited by 2
- 2021ASAT: Adaptively Scaled Adversarial Training in Time Seriescited by 2
12 most cited of 15 All 15 (JSON)
- 2025JurisCTC: Enhancing Legal Judgment Prediction via Cross-Domain Transfer and Contrastive Learning24 Apr 2025
- 2024Learning to Generalize Unseen Domains via Multi-Source Meta Learning for Text Classification20 Sep 2024
- 2023Language Variety Identification with True Labels2 Mar 2023
- 2022State-of-the-art generalisation research in NLP: A taxonomy and review6 Oct 2022
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives15 Aug 2022
- 2022Explainable Misinformation Detection Across Multiple Social Media Platforms20 Mar 2022
- 2022Towards Equal Opportunity Fairness through Adversarial Learning12 Mar 2022
- 2022Utilizing Out-Domain Datasets to Enhance Multi-Task Citation Analysis22 Feb 2022
- 2021Balancing out Bias: Achieving Fairness Through Balanced Training16 Sep 2021
- 2021Uncertainty-Aware Balancing for Multilingual and Multi-Domain Neural Machine Translation Training6 Sep 2021
- 2021ASAT: Adaptively Scaled Adversarial Training in Time Series20 Aug 2021
- 2021Cross-Lingual Transfer Learning for Statistical Type Inference1 Jul 2021
12 newest of 15 All 15 (JSON)