The Galactic Dependencies Treebanks: Getting More Data by Synthesizing New Languages
Not on the map. Why?
Abstract (arXiv)
We release Galactic Dependencies 1.0---a large set of synthetic languages not found on Earth, but annotated in Universal Dependencies format. This new resource aims to provide training and development data for NLP methods that aim to adapt to unfamiliar languages. Each synthetic treebank is produced from a real treebank by stochastically permuting the dependents of nouns and/or verbs to match the word order of other real languages. We discuss the usefulness, realism, parsability, perplexity, and diversity of the synthetic languages. As a simple demonstration of the use of Galactic Dependencies, we consider single-source transfer, which attempts to parse a real target language using a parser trained on a "nearby" source language. We find that including synthetic source languages somewhat increases the diversity of the source pool, which significantly improves results for most target languages.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 4; 2024: 3; 2025: 1; 2026: 2.
19 papers.
Sort:
- 2021When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfercited by 42
- 2023Modeling rapid language learning by distilling Bayesian priors into artificial neural networkscited by 42
- 2021Examining the Inductive Bias of Neural Language Models with Artificial Languagescited by 40
- 2025Can Language Models Learn Typologically Implausible Languages?cited by 23
- 2024Emergent Word Order Universals from Cognitively-Motivated Language Modelscited by 11
- 2023Transparency at the Source: Evaluating and Interpreting Language Models With Access to the True Distributioncited by 10
- 2022Oolong: Investigating What Makes Transfer Learning Hard with Controlled Studiescited by 9
- 2021On the Difficulty of Translating Free-Order Case-Marking Languagescited by 8
- 2024NeLLCom-X: A Comprehensive Neural-Agent Framework to Simulate Language Learning and Group Communicationcited by 8
- 2021How Suitable Are Subword Segmentation Strategies for Translating Non-Concatenative Morphology?cited by 7
- 2022ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-trainingcited by 6
- 2021The Impact of Positional Encodings on Multilingual Compressioncited by 5
7 more
- 2023Multilingual Nonce Dependency Treebanks: Understanding how Language Models represent and process syntactic structurecited by 5
- 2022Word Order Matters when you Increase Maskingcited by 4
- 2023Improving Cross-Lingual Transfer through Subtree-Aware Word Reorderingcited by 4
- 2024Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varietiescited by 4
- 2026Retrievit: In-context Retrieval Capabilities of Transformers, State Space Models, and Hybrid Architecturescited by 1
- 2022Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models?cited by 0
- 2026Typological Alignment of Stack-Based Language Models on Mildly Context-Sensitive Artificial Languagescited by 0
- 2026Typological Alignment of Stack-Based Language Models on Mildly Context-Sensitive Artificial Languages1 Oct 2026
- 2026Retrievit: In-context Retrieval Capabilities of Transformers, State Space Models, and Hybrid Architectures3 Mar 2026
- 2025Can Language Models Learn Typologically Implausible Languages?17 Feb 2025
- 2024NeLLCom-X: A Comprehensive Neural-Agent Framework to Simulate Language Learning and Group Communication19 Jul 2024
- 2024Emergent Word Order Universals from Cognitively-Motivated Language Models19 Feb 2024
- 2024Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varieties3 Feb 2024
- 2023Multilingual Nonce Dependency Treebanks: Understanding how Language Models represent and process syntactic structure13 Nov 2023
- 2023Transparency at the Source: Evaluating and Interpreting Language Models With Access to the True Distribution23 Oct 2023
- 2023Improving Cross-Lingual Transfer through Subtree-Aware Word Reordering20 Oct 2023
- 2023Modeling rapid language learning by distilling Bayesian priors into artificial neural networks24 May 2023
- 2022ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-training15 Nov 2022
- 2022Word Order Matters when you Increase Masking8 Nov 2022
7 more
- 2022Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models?12 May 2022
- 2022Oolong: Investigating What Makes Transfer Learning Hard with Controlled Studies24 Feb 2022
- 2021When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer27 Oct 2021
- 2021The Impact of Positional Encodings on Multilingual Compression11 Sep 2021
- 2021How Suitable Are Subword Segmentation Strategies for Translating Non-Concatenative Morphology?2 Sep 2021
- 2021On the Difficulty of Translating Free-Order Case-Marking Languages13 Jul 2021
- 2021Examining the Inductive Bias of Neural Language Models with Artificial Languages2 Jun 2021
- 2021When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfercited by 42
- 2023Modeling rapid language learning by distilling Bayesian priors into artificial neural networkscited by 42
- 2021Examining the Inductive Bias of Neural Language Models with Artificial Languagescited by 40
- 2025Can Language Models Learn Typologically Implausible Languages?cited by 23
- 2024Emergent Word Order Universals from Cognitively-Motivated Language Modelscited by 11
- 2023Transparency at the Source: Evaluating and Interpreting Language Models With Access to the True Distributioncited by 10
- 2022Oolong: Investigating What Makes Transfer Learning Hard with Controlled Studiescited by 9
- 2021On the Difficulty of Translating Free-Order Case-Marking Languagescited by 8
- 2024NeLLCom-X: A Comprehensive Neural-Agent Framework to Simulate Language Learning and Group Communicationcited by 8
- 2021How Suitable Are Subword Segmentation Strategies for Translating Non-Concatenative Morphology?cited by 7
- 2022ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-trainingcited by 6
- 2021The Impact of Positional Encodings on Multilingual Compressioncited by 5
12 most cited of 19 All 19 (JSON)
- 2026Typological Alignment of Stack-Based Language Models on Mildly Context-Sensitive Artificial Languages1 Oct 2026
- 2026Retrievit: In-context Retrieval Capabilities of Transformers, State Space Models, and Hybrid Architectures3 Mar 2026
- 2025Can Language Models Learn Typologically Implausible Languages?17 Feb 2025
- 2024NeLLCom-X: A Comprehensive Neural-Agent Framework to Simulate Language Learning and Group Communication19 Jul 2024
- 2024Emergent Word Order Universals from Cognitively-Motivated Language Models19 Feb 2024
- 2024Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varieties3 Feb 2024
- 2023Multilingual Nonce Dependency Treebanks: Understanding how Language Models represent and process syntactic structure13 Nov 2023
- 2023Transparency at the Source: Evaluating and Interpreting Language Models With Access to the True Distribution23 Oct 2023
- 2023Improving Cross-Lingual Transfer through Subtree-Aware Word Reordering20 Oct 2023
- 2023Modeling rapid language learning by distilling Bayesian priors into artificial neural networks24 May 2023
- 2022ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-training15 Nov 2022
- 2022Word Order Matters when you Increase Masking8 Nov 2022
12 newest of 19 All 19 (JSON)