mlsanityData to 14 Oct 2026

Discourse-Based Objectives for Fast Unsupervised Sentence Representation Learning

arXiv 1705.00557 ↗First posted 23 Apr 2017cs.CL cs.LG cs.NEcited by 18

Not on the map. Why?

Abstract (arXiv)

This work presents a novel objective function for the unsupervised training of neural network sentence encoders. It exploits signals from paragraph-level discourse coherence to train these models to understand text. Our objective is purely discriminative, allowing us to train models many times faster than was possible under prior methods, and it yields models which perform well in extrinsic evaluations.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Apr 2017.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 3; 2022: 9; 2023: 3; 2024: 2; 2025: 1.

18 papers.

Sort:

  1. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  2. 2022RankGen: Improving Text Generation with Large Ranking Modelscited by 72
  3. 2022Improving In-Context Few-Shot Learning via Self-Supervised Trainingcited by 57
  4. 2022SciNLI: A Corpus for Natural Language Inference on Scientific Textcited by 27
  5. 2025When AI Co-Scientists Fail: SPOT-a Benchmark for Automated Verification of Scientific Researchcited by 26
  6. 2021Discourse Relation Embeddings: Representing the Relations between Discourse Segments in Social Mediacited by 8
  7. 2022Randomized Quantization: A Generic Augmentation for Data Agnostic Self-supervised Learningcited by 6
  8. 2021PAUSE: Positive and Annealed Unlabeled Sentence Embeddingcited by 5
  9. 2022Fortunately, Discourse Markers Can Enhance Language Models for Sentiment Analysiscited by 5
  10. 2022Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representationcited by 5
  11. 2022AF Adapter: Continual Pretraining for Building Chinese Biomedical Language Modelcited by 3
  12. 2023Distributed Marker Representation for Ambiguous Discourse Markers and Entangled Relationscited by 3
6 more
  1. 2022Leveraging Natural Supervision for Language Representation Learning and Generationcited by 2
  2. 2023Enhancing Pre-Trained Language Models with Sentence Position Embeddings for Rhetorical Roles Recognition in Legal Opinionscited by 2
  3. 2022elBERto: Self-supervised Commonsense Learning for Question Answeringcited by 0
  4. 2023When Do Discourse Markers Affect Computational Sentence Understanding?cited by 0
  5. 2024DEPTH: Discourse Education through Pre-Training Hierarchicallycited by 0
  6. 2024The Large Language Model GreekLegalRoBERTacited by 0