# Finding Pragmatic Differences Between Disciplines

arXiv: https://arxiv.org/abs/2310.00204 · HTML: https://mlsanity.com/paper/2310.00204/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 5 of its 17 references that are in the map.
- First posted on arXiv 30 Sep 2023.

## Builds on (most cited first, 5 of 5)

- [SciBERT: A Pretrained Language Model for Scientific Text](https://mlsanity.com/paper/1903.10676/) (2019)
- [SECTOR: A Neural Model for Coherent Topic Segmentation and Classification](https://mlsanity.com/paper/1902.04793/) (2019)
- [Meta Fine-Tuning Neural Language Models for Multi-Domain Text Mining](https://mlsanity.com/paper/2003.13003/) (2020)
- [OCR++: A Robust Framework For Information Extraction from Scholarly Articles](https://mlsanity.com/paper/1609.06423/) (2016)
- [Structure-Tags Improve Text Classification for Scholarly Document Quality Prediction](https://mlsanity.com/paper/2005.00129/) (2020)

## Abstract (arXiv)

Scholarly documents have a great degree of variation, both in terms of content (semantics) and structure (pragmatics). Prior work in scholarly document understanding emphasizes semantics through document summarization and corpus topic modeling but tends to omit pragmatics such as document organization and flow. Using a corpus of scholarly documents across 19 disciplines and state-of-the-art language modeling techniques, we learn a fixed set of domain-agnostic descriptors for document sections and "retrofit" the corpus to these descriptors (also referred to as "normalization"). Then, we analyze the position and ordering of these descriptors across documents to understand the relationship between discipline and structure. We report within-discipline structural archetypes, variability, and between-discipline comparisons, supporting the hypothesis that scholarly communities, despite their size, diversity, and breadth, share similar avenues for expressing their work. Our findings lay the foundation for future work in assessing research quality, domain style transfer, and further pragmatic analysis.