LLM-enhanced Self-training for Cross-domain Constituency Parsing
On the map: Synthetic data and self-improvement for LLMs → Self-rewarding alignment and self-training
Abstract (arXiv)
Self-training has proven to be an effective approach for cross-domain tasks, and in this study, we explore its application to cross-domain constituency parsing. Traditional self-training methods rely on limited and potentially low-quality raw corpora. To overcome this limitation, we propose enhancing self-training with the large language model (LLM) to generate domain-specific raw corpora iteratively. For the constituency parsing, we introduce grammar rules that guide the LLM in generating raw corpora and establish criteria for selecting pseudo instances. Our experimental results demonstrate that self-training for constituency parsing, equipped with an LLM, outperforms traditional methods regardless of the LLM's performance. Moreover, the combination of grammar rules and confidence criteria for pseudo-data selection yields the highest performance in the cross-domain constituency parsing.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Self-rewarding alignment and self-training, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 20 of its 47 references that are in the map. First posted on arXiv 5 Nov 2023.
Builds on
20 of 47 references.
References · 20
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 488
- 2018Constituency Parsing with a Self-Attentive Encodercited by 199
- 2019Revisiting Self-Training for Neural Sequence Generationcited by 155
- 2020Neural Unsupervised Domain Adaptation in NLP---A Surveycited by 144
- 2018Multilingual Constituency Parsing with Self-Attention and Pre-Trainingcited by 117
- 2016Recurrent Neural Network Grammarscited by 109
- 2023Automated Annotation with Generative AI Requires Validationcited by 76
- 2017A Minimal Span-Based Neural Constituency Parsercited by 59
8 more
- 2023Large Language Model Augmented Narrative Driven Recommendationscited by 31
- 2019Deep Contextualized Self-training for Low Resource Dependency Parsingcited by 24
- 2017In-Order Transition-based Constituent Parsingcited by 23
- 2018What's Going On in Neural Constituency Parsers? An Analysiscited by 22
- 2020Adaptive Self-training for Few-shot Neural Sequence Labelingcited by 18
- 2019Cross-Domain Generalization of Neural Constituency Parserscited by 17
- 2023Targeted Data Generation: Finding and Fixing Model Weaknessescited by 15
- 2020Feature Adaptation of Pre-Trained Language Models across Languages and Domains with Robust Self-Trainingcited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2025Contrastive Learning on LLM Back Generation Treebank for Cross-domain Constituency Parsing27 May 2025
- 2025Self-Correction Makes LLMs Better Parsers19 Apr 2025
- 2025Better Benchmarking LLMs for Zero-Shot Dependency Parsing28 Feb 2025
- 2024Cross-domain Chinese Sentence Pattern Parsing26 Feb 2024
Similar, not cited
Close in wording, no citation either way
- 2025Step-by-step Instructions and a Simple Tabular Output Format Improve the Dependency Parsing Accuracy of LLMs
- 2025SR-LLM: Rethinking the Structured Representation in Large Language Model
- 2024Log Parsing using LLMs with Self-Generated In-Context Learning and Self-Correction
- 2024BLADE: Enhancing Black-box Large Language Models with Small Domain-Specific Models
- 2023Ensemble Distillation for Unsupervised Constituency Parsing
- 2025Evaluation of Finetuned LLMs in AMR Parsing
- 2025Semantic Voting: A Self-Evaluation-Free Approach for Efficient LLM Self-Improvement on Unverifiable Open-ended Tasks
- 2024Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages