Breaking the Adversarial Robustness-Performance Trade-off in Text Classification via Manifold Purification
Not on the map. Why?
Abstract (arXiv)
A persistent challenge in text classification (TC) is that enhancing model robustness against adversarial attacks typically degrades performance on clean data. We argue that this challenge can be resolved by modeling the distribution of clean samples in the encoder embedding manifold. To this end, we propose the Manifold-Correcting Causal Flow (MC^2F), a two-module system that operates directly on sentence embeddings. A Stratified Riemannian Continuous Normalizing Flow (SR-CNF) learns the density of the clean data manifold. It identifies out-of-distribution embeddings, which are then corrected by a Geodesic Purification Solver. This solver projects adversarial points back onto the learned manifold via the shortest path, restoring a clean, semantically coherent representation. We conducted extensive evaluations on text classification (TC) across three datasets and multiple adversarial attacks. The results demonstrate that our method, MC^2F, not only establishes a new state-of-the-art in adversarial robustness but also fully preserves performance on clean data, even yielding modest gains in accuracy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 45 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
27 of 45 references.
References · 27
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 671
- 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 491
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2018Generating Natural Language Adversarial Examplescited by 424
- 2018TextBugger: Generating Adversarial Text Against Real-world Applicationscited by 381
- 2020BAE: BERT-based Adversarial Examples for Text Classificationcited by 316
- 2019FreeLB: Enhanced Adversarial Training for Natural Language Understandingcited by 264
15 more
- 2019Visualizing and Measuring the Geometry of BERTcited by 216
- 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
- 2016Yelp Dataset Challenge: Review Rating Predictioncited by 84
- 2022Fisher SAM: Information Geometry and Sharpness Aware Minimisationcited by 84
- 2020Emergence of Separable Manifolds in Deep Language Representationscited by 40
- 2018Understanding Convolutional Neural Networks for Text Classificationcited by 36
- 2022Textual Manifold-based Defense Against Natural Language Adversarial Examplescited by 19
- 2023Why do universal adversarial attacks work on large language models?: Geometry might be the answercited by 14
- 2025Unraveling the Localized Latents: Learning Stratified Manifold Structures in LLM Embedding Space with Sparse Mixture-of-Expertscited by 10
- 2024Adversarial Text Purification: A Large Language Model Approach for Defensecited by 8
- 2023DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimizationcited by 7
- 2024Feature Density Estimation for Out-of-Distribution Detection via Normalizing Flowscited by 4
- 2024Extreme Miscalibration and the Illusion of Adversarial Robustnesscited by 4
- 2024New Paradigm of Adversarial Training: Releasing Accuracy-Robustness Trade-Off via Dummy Classcited by 2
- 2024Subspace Defense: Discarding Adversarial Perturbations by Learning a Subspace for Clean Signalscited by 1
Built on by
Not cited yet.