Dango: A Strictly L1-Only Large Language Model for Studying Second Language Acquisition
Not on the map. Why?
Abstract (arXiv)
We introduce Dango, a 1.8B-parameter large language model designed for controlled studies of L1-to-L2 (Japanese-to-English) transfer in second language acquisition (SLA). While previous studies have explored SLA in language models, they have predominantly relied on smaller or non-decoder models, limiting their ability to generate open-ended text and reducing their suitability as practical L2 simulators. We identify a key challenge when scaling models to this size: L2 contamination within the "monolingual" pretraining corpus used for L1 acquisition. To address this, we propose a filtering method to reduce premature exposure to English while preserving realistic, minimal exposure. We then fine-tune the model on LLM-generated L2-learning lessons to simulate the L2 acquisition process. Our evaluations confirm that Dango develops human-like L2 production patterns, outperforming both unfiltered and standard multilingual baselines. We release the model, data, and code to facilitate reproducible computational SLA research and learner-facing applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 30 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
11 of 30 references.
References · 11
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 564
- 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 548
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 206
- 2022Language Contamination Helps Explain the Cross-lingual Capabilities of English Pretrained Modelscited by 92
- 2020Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpuscited by 77
- 2025MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairscited by 71
- 2023SLABERT Talk Pretty One Day: Modeling Second Language Acquisition with BERTcited by 15
- 2023Second Language Acquisition of Neural Language Modelscited by 8
- 2025Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent Biasescited by 1
Built on by
Not cited yet.