mlsanityData to 7 Oct 2026

QLSC: A Query Latent Semantic Calibrator for Robust Extractive Question Answering

arXiv 2404.19316 ↗First posted 30 Apr 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Extractive Question Answering (EQA) in Machine Reading Comprehension (MRC) often faces the challenge of dealing with semantically identical but format-variant inputs. Our work introduces a novel approach, called the ``Query Latent Semantic Calibrator (QLSC)'', designed as an auxiliary module for existing MRC models. We propose a unique scaling strategy to capture latent semantic center features of queries. These features are then seamlessly integrated into traditional query and passage embeddings using an attention mechanism. By deepening the comprehension of the semantic queries-passage relationship, our approach diminishes sensitivity to variations in text format and boosts the model's capability in pinpointing accurate answers. Experimental results on robust Question-Answer datasets confirm that our approach effectively handles format-variant but semantically identical queries, highlighting the effectiveness and adaptability of our proposed method.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 30 Apr 2024.

Builds on

23 of 31 references.

References · 23

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  5. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  6. 2019Adversarial Training for Free!cited by 638
  7. 2018Generating Natural Language Adversarial Examplescited by 422
  8. 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
  9. 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
  10. 2019FreeLB: Enhanced Adversarial Training for Natural Language Understandingcited by 261
  11. 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 253
  12. 2018The Natural Language Decathlon: Multitask Learning as Question Answeringcited by 235
11 more
  1. 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
  2. 2019You Only Propagate Once: Accelerating Adversarial Training via Maximal Principlecited by 181
  3. 2021Improving Question Answering Model Robustness with Synthetic Adversarial Data Generationcited by 77
  4. 2022Adversarial Training for High-Stakes Reliabilitycited by 60
  5. 2020A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasetscited by 40
  6. 2021Improved Text Classification via Contrastive Adversarial Trainingcited by 38
  7. 2021ESTER: A Machine Reading Comprehension Dataset for Event Semantic Relation Reasoningcited by 30
  8. 2022PERT: Pre-training BERT with Permuted Language Modelcited by 23
  9. 2021Block-Skim: Efficient Question Answering for Transformercited by 16
  10. 2020DuReader_robust: A Chinese Dataset Towards Evaluating Robustness and Generalization of Machine Reading Comprehension in Real-World Applicationscited by 13
  11. 2019Improving Machine Reading Comprehension via Adversarial Trainingcited by 7

Built on by

Not cited yet.