Pre-trained Language Model Based Active Learning for Sentence Matching
Not on the map. Why?
Abstract (arXiv)
Active learning is able to significantly reduce the annotation cost for data-driven techniques. However, previous active learning approaches for natural language processing mainly depend on the entropy-based uncertainty criterion, and ignore the characteristics of natural language. In this paper, we propose a pre-trained language model based active learning approach for sentence matching. Differing from previous active learning, it can provide linguistic criteria to measure instances and help select more efficient instances for annotation. Experiments demonstrate our approach can achieve greater accuracy with fewer labeled training instances.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 4.
7 papers.
- 2022A Survey of Active Learning for Natural Language Processingcited by 40
- 2022Multi-task Active Learning for Pre-trained Transformer-based Modelscited by 16
- 2023D-CALM: A Dynamic Clustering-based Active Learning Approach for Mitigating Biascited by 12
- 2024Active Learning for Robust and Representative LLM Generation in Safety-Critical Scenarioscited by 10
- 2024Coherence-Driven Multimodal Safety Dialogue with Active Learning for Embodied Agentscited by 7
- 2024Inconsistency-Based Data-Centric Active Open-Set Annotationcited by 5
- 2024Active Learning with Task Adaptation Pre-training for Speech Emotion Recognitioncited by 0
- 2024Coherence-Driven Multimodal Safety Dialogue with Active Learning for Embodied Agents18 Oct 2024
- 2024Active Learning for Robust and Representative LLM Generation in Safety-Critical Scenarios14 Oct 2024
- 2024Active Learning with Task Adaptation Pre-training for Speech Emotion Recognition1 May 2024
- 2024Inconsistency-Based Data-Centric Active Open-Set Annotation10 Jan 2024
- 2023D-CALM: A Dynamic Clustering-based Active Learning Approach for Mitigating Bias26 May 2023
- 2022A Survey of Active Learning for Natural Language Processing18 Oct 2022
- 2022Multi-task Active Learning for Pre-trained Transformer-based Models10 Aug 2022