Counter-fitting Word Vectors to Linguistic Constraints
Not on the map. Why?
Abstract (arXiv)
In this work, we present a novel counter-fitting method which injects antonymy and synonymy constraints into vector space representations in order to improve the vectors' capability for judging semantic similarity. Applying this method to publicly available pre-trained word vectors leads to a new state of the art performance on the SimLex-999 dataset. We also show how the method can be used to tailor the word vector space for the downstream task of dialogue state tracking, resulting in robust improvements across different dialogue domains.
Key facts. Cited by 138 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2017: 1; 2018: 0; 2019: 0; 2020: 0; 2021: 33; 2022: 36; 2023: 35; 2024: 17; 2025: 3; 2026: 13.
138 papers.
Sort:
By area:
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 128
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
- 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
- 2021Towards Improving Adversarial Training of NLP Modelscited by 79
- 2021Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Modelscited by 76
- 2021Triggerless Backdoor Attack for NLP Tasks with Clean Labelscited by 61
- 2021Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitutioncited by 55
- 2025Harnessing the Universal Geometry of Embeddingscited by 54
- 2022A Customized Text Sanitization Mechanism with Differential Privacycited by 51
- 2022Deepfake Text Detection: Limitations and Opportunitiescited by 37
- 2022Detection of Word Adversarial Examples in Text Classification: Benchmark and Baseline via Robust Density Estimationcited by 32
38 more
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2021Defending Pre-trained Language Models from Adversarial Word Substitutions Without Performance Sacrificecited by 30
- 2021Perturbing Inputs for Fragile Interpretations in Deep Natural Language Processingcited by 30
- 2023Large Language Models for Healthcare Data Augmentation: An Example on Patient-Trial Matchingcited by 30
- 2023Black-box Adversarial Attacks against Dense Retrieval Models: A Multi-view Contrastive Learning Methodcited by 29
- 2021Grey-box Adversarial Attack And Defence For Sentiment Classificationcited by 28
- 2022Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbationcited by 28
- 2024Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attackcited by 27
- 2022Phrase-level Textual Adversarial Attack with Label Preservationcited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2022Query-Efficient and Scalable Black-Box Adversarial Attacks on Discrete Sequential Data via Bayesian Optimizationcited by 22
- 2021Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Trainingcited by 21
- 2021ReMeDi: Resources for Multi-domain, Multi-service, Medical Dialoguescited by 20
- 2022Textual Manifold-based Defense Against Natural Language Adversarial Examplescited by 19
- 2024Emergent Visual-Semantic Hierarchies in Image-Text Representationscited by 19
- 2021A Strong Baseline for Query Efficient Attacks in a Black Box Settingcited by 16
- 2021Text Counterfactuals via Latent Optimization and Shapley-Guided Searchcited by 16
- 2024HQA-Attack: Toward High Quality Black-Box Hard-Label Adversarial Attack on Textcited by 16
- 2022Text Adversarial Purification as Defense against Adversarial Attackscited by 15
- 2022TASA: Deceiving Question Answering Models by Twin Answer Sentences Attackcited by 15
- 2022Fooling Explanations in Text Classifierscited by 13
- 2021Adversarial Stylometry in the Wild: Transferable Lexical Substitution Attacks on Author Profilingcited by 12
- 2021Token-Modification Adversarial Attacks for Natural Language Processing: A Surveycited by 12
- 2022Robust Textual Embedding against Word-level Adversarial Attackscited by 12
- 2022Adversarial Training for Improving Model Robustness? Look at Both Prediction and Interpretationcited by 12
- 2022Discovering Differences in the Representation of People using Contextualized Semantic Axescited by 12
- 2024Defending Text-to-image Diffusion Models: Surprising Efficacy of Textual Perturbations Against Backdoor Attackscited by 12
- 2022Fact-Saboteurs: A Taxonomy of Evidence Manipulation Attacks against Fact-Verification Systemscited by 11
- 2023Randomized Smoothing with Masked Inference for Adversarially Robust Text Classificationscited by 11
- 2021'Just because you are right, doesn't mean I am wrong': Overcoming a Bottleneck in the Development and Evaluation of Open-Ended Visual Question Answering (VQA) Taskscited by 10
- 2022TextHacker: Learning based Hybrid Local Search Algorithm for Text Hard-label Adversarial Attackcited by 10
- 2022Beyond Distributional Hypothesis: Let Language Models Learn Meaning-Text Correspondencecited by 10
- 2023ProKnow: Process Knowledge for Safety Constrained and Explainable Question Generation for Mental Health Diagnostic Assistancecited by 10
- 2021Double Perturbation: On the Robustness of Robustness and Counterfactual Bias Evaluationcited by 9
- 2021BERT is Robust! A Case Against Synonym-Based Adversarial Examples in Text Classificationcited by 9
- 2022Impact of Adversarial Training on Robustness and Generalizability of Language Modelscited by 9
- 2023Less is More: Understanding Word-level Textual Adversarial Attack via n-gram Frequency Descendcited by 9
- 2023LimeAttack: Local Explainable Method for Textual Hard-Label Adversarial Attackcited by 9
50 most cited of 138 All 138 (JSON)
- 2026OASIS: Optimizing Attacker Sequences for Hard-Label Black-Box Text Attacks30 Aug 2026
- 2026A Comparative Study on Affective Cues in Text Embeddings Across Psychological Emotion Theories27 Jun 2026
- 2026An Empirical Analysis of Factual Errors in Human-Written Text and Its Application to Factual Error Detection26 Jun 2026
- 2026Vulnerability of Natural Language Classifiers to Evolutionary Generated Adversarial Text25 Jun 2026
- 2026MiqraBERT: Regression-Based Sentence-BERT Finetuning for Biblical Hebrew Parallel Detection17 Jun 2026
- 2026Adversarial Robustness of Activation Steering in Large Language Models5 Jun 2026
- 2026HQA-VLAttack: Towards High Quality Adversarial Attack on Vision-Language Pre-Trained Models14 Apr 2026
- 2026A visual observation on the geometry of UMAP projections of the difference vectors of antonym and synonym word pair embeddings25 Mar 2026
- 2026PivotAttack: Rethinking the Search Trajectory in Hard-Label Text Attacks via Pivot Words11 Mar 2026
- 2026One Word is Enough: Minimal Adversarial Perturbations for Neural Text Ranking28 Jan 2026
- 2026A Hybrid Protocol for Large-Scale Semantic Dataset Generation in Low-Resource Languages: The Turkish Semantic Relations Corpus19 Jan 2026
- 2026Beyond Cosine Similarity: Taming Semantic Drift and Antonym Intrusion in a 15-Million Node Turkish Synonym Graph19 Jan 2026
38 more
- 2026Embedding Retrofitting: Data Engineering for better RAG6 Jan 2026
- 2025Beyond Weaponization: NLP Security for Medium and Lower-Resourced Languages in Their Own Right4 Jul 2025
- 2025Harnessing the Universal Geometry of Embeddings18 May 2025
- 2025Confidence Elicitation: A New Attack Vector for Large Language Models7 Feb 2025
- 2024Automated Trustworthiness Oracle Generation for Machine Learning Text Classifiers30 Oct 2024
- 2024Unitary Multi-Margin BERT for Robust Natural Language Processing16 Oct 2024
- 2024OpenFact at CheckThat! 2024: Combining Multiple Attack Methods for Effective Adversarial Text Generation4 Sep 2024
- 2024Defending Text-to-image Diffusion Models: Surprising Efficacy of Textual Perturbations Against Backdoor Attacks28 Aug 2024
- 2024TF-Attack: Transferable and Fast Adversarial Attacks on Large Language Models26 Aug 2024
- 2024Emergent Visual-Semantic Hierarchies in Image-Text Representations11 Jul 2024
- 2024Explaining the role of Intrinsic Dimensionality in Adversarial Training27 May 2024
- 2024A Constraint-Enforcing Reward for Adversarial Attacks on Text Classifiers20 May 2024
- 2024Adversarial Attacks and Dimensionality in Text Classifiers3 Apr 2024
- 2024Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack2 Apr 2024
- 2024SemRoDe: Macro Adversarial Training to Learn Representations That are Robust to Word-Level Attacks27 Mar 2024
- 2024Reversible Jump Attack to Textual Classifiers with Modification Reduction21 Mar 2024
- 2024Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks16 Feb 2024
- 2024Generating Diverse Translation with Perturbed kNN-MT14 Feb 2024
- 2024HQA-Attack: Toward High Quality Black-Box Hard-Label Adversarial Attack on Text2 Feb 2024
- 2024A Survey on Data Augmentation in Large Model Era27 Jan 2024
- 2024ROIC-DM: Robust Text Inference and Classification via Diffusion Model7 Jan 2024
- 2023DA3: A Distribution-Aware Adversarial Attack against Language Models14 Nov 2023
- 2023Towards Effective Paraphrasing for Information Disguise8 Nov 2023
- 2023Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks1 Nov 2023
- 2023Robustifying Language Models with Test-Time Adaptation29 Oct 2023
- 2023BERT Lost Patience Won't Be Robust to Adversarial Slowdown29 Oct 2023
- 2023Retrofitting Light-weight Language Models for Emotions using Supervised Contrastive Learning29 Oct 2023
- 2023PerturbScore: Connecting Discrete and Continuous Perturbations in NLP13 Oct 2023
- 2023Defending Against Authorship Identification Attacks2 Oct 2023
- 2023Fooling the Textual Fooler via Randomizing Latent Representations2 Oct 2023
- 2023Word Embedding with Neural Probabilistic Prior21 Sep 2023
- 2023What Learned Representations and Influence Functions Can Tell Us About Adversarial Examples19 Sep 2023
- 2023Black-box Adversarial Attacks against Dense Retrieval Models: A Multi-view Contrastive Learning Method19 Aug 2023
- 2023Biomedical Knowledge Graph Embeddings with Negative Statements7 Aug 2023
- 2023LimeAttack: Local Explainable Method for Textual Hard-Label Adversarial Attack1 Aug 2023
- 2023Adversarially Robust Neural Legal Judgement Systems31 Jul 2023
- 2023Lost In Translation: Generating Adversarial Examples Robust to Round-Trip Translation24 Jul 2023
- 2023DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications5 Jul 2023
50 newest of 138 All 138 (JSON)
- 2021Triggerless Backdoor Attack for NLP Tasks with Clean Labelscited by 61
- 2021Triggerless Backdoor Attack for NLP Tasks with Clean Labels15 Nov 2021
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 128
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
- 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
- 2021Towards Improving Adversarial Training of NLP Modelscited by 79
- 2021Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Modelscited by 76
- 2021Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitutioncited by 55
- 2025Harnessing the Universal Geometry of Embeddingscited by 54
- 2022A Customized Text Sanitization Mechanism with Differential Privacycited by 51
- 2022Deepfake Text Detection: Limitations and Opportunitiescited by 37
- 2022Detection of Word Adversarial Examples in Text Classification: Benchmark and Baseline via Robust Density Estimationcited by 32
- 2021Defending Pre-trained Language Models from Adversarial Word Substitutions Without Performance Sacrificecited by 30
12 most cited of 132 All 132 (JSON)
- 2026OASIS: Optimizing Attacker Sequences for Hard-Label Black-Box Text Attacks30 Aug 2026
- 2026A Comparative Study on Affective Cues in Text Embeddings Across Psychological Emotion Theories27 Jun 2026
- 2026An Empirical Analysis of Factual Errors in Human-Written Text and Its Application to Factual Error Detection26 Jun 2026
- 2026Vulnerability of Natural Language Classifiers to Evolutionary Generated Adversarial Text25 Jun 2026
- 2026MiqraBERT: Regression-Based Sentence-BERT Finetuning for Biblical Hebrew Parallel Detection17 Jun 2026
- 2026Adversarial Robustness of Activation Steering in Large Language Models5 Jun 2026
- 2026A visual observation on the geometry of UMAP projections of the difference vectors of antonym and synonym word pair embeddings25 Mar 2026
- 2026PivotAttack: Rethinking the Search Trajectory in Hard-Label Text Attacks via Pivot Words11 Mar 2026
- 2026One Word is Enough: Minimal Adversarial Perturbations for Neural Text Ranking28 Jan 2026
- 2026A Hybrid Protocol for Large-Scale Semantic Dataset Generation in Low-Resource Languages: The Turkish Semantic Relations Corpus19 Jan 2026
- 2026Beyond Cosine Similarity: Taming Semantic Drift and Antonym Intrusion in a 15-Million Node Turkish Synonym Graph19 Jan 2026
- 2026Embedding Retrofitting: Data Engineering for better RAG6 Jan 2026
12 newest of 132 All 132 (JSON)