Slogans or Stance? A Label-Light Diagnostic for Entrepreneurial-Discourse Measurement on Chinese SOE Speeches
Not on the map. Why?
Abstract (arXiv)
Dictionary methods, topic models, and embedding-similarity scorers are widely used in CSS and management research to measure constructs such as "entrepreneurial spirit" in corporate speeches. We contribute a label-light measurement diagnostic for such instruments rather than a new extraction model. On a corpus of 80 speeches by leaders of centrally administered Chinese state-owned enterprises, we exploit a natural experiment of 24 same-company different-speaker pairs and 5 same-company same-speaker pairs to test whether a method's per-document indices vary with leader identity holding firm constant. LDA fails (Cohen d=0.20, 95% CI [-0.72, 1.20]); a dictionary scorer reaches d=0.81 and a Chinese sentence encoder d=0.65 on doc-vector distances of order 10^-3. A zero-shot 9B open-weight LLM (Qwen3.5:9b) raises paired-contrast d to 1.09 (exact permutation p1=0.034). We downgrade three claims accordingly: gold F1 measures consistency with the LLM's own prompt rule rather than external construct recovery; doc-level style residualisation cuts the LLM's d to 0.43 (p1=0.22), so roughly half of the effect is consistent with leader idiolect; and a confidence-weighted calibration trades Delta for variance with an auto-mined slogan lexicon near-inert in ablation. We release the 2,190-segment scored corpus, the 170-paragraph pilot, the slogan lexicon, two-family LLM scores, and the evaluation harness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 57 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
13 of 57 references.
References · 13
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
- 2019Measurement and Fairnesscited by 308
- 2020Top2Vec: Distributed Representations of Topicscited by 126
- 2020Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representationscited by 98
- 2018Framing and Agenda-setting in Russian News: a Computational Analysis of Intricate Political Strategiescited by 47
- 2020An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot Labelscited by 44
- 2025FinMTEB: Finance Massive Text Embedding Benchmarkcited by 18
- 2020Weakly- and Semi-supervised Evidence Extractioncited by 16
- 2021CoPHE: A Count-Preserving Hierarchical Evaluation Metric in Large-Scale Multi-Label Text Classificationcited by 9
Built on by
Not cited yet.