{"total":20,"rows":[{"id":"2103.06678","title":"The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models","created":"2021-03-11","cited_by_count":119,"area":null},{"id":"2204.13509","title":"On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language Model","created":"2022-04-28","cited_by_count":81,"area":null},{"id":"2303.09859","title":"Trained on 100 million words and still in shape: BERT meets British National Corpus","created":"2023-03-17","cited_by_count":39,"area":null},{"id":"2203.10753","title":"Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferability","created":"2022-03-21","cited_by_count":26,"area":null},{"id":"2109.03537","title":"On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets","created":"2021-09-08","cited_by_count":25,"area":null},{"id":"2109.03160","title":"How much pretraining data do language models need to learn syntax?","created":"2021-09-07","cited_by_count":21,"area":null},{"id":"2212.12510","title":"MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning","created":"2022-12-23","cited_by_count":12,"area":null},{"id":"2110.13658","title":"Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios?","created":"2021-10-26","cited_by_count":11,"area":null},{"id":"2212.05421","title":"Feature-Level Debiased Natural Language Understanding","created":"2022-12-11","cited_by_count":10,"area":null},{"id":"2306.01497","title":"Data-Efficient French Language Modeling with CamemBERTa","created":"2023-06-02","cited_by_count":8,"area":null},{"id":"2109.13209","title":"FQuAD2.0: French Question Answering and knowing that you know nothing","created":"2021-09-27","cited_by_count":7,"area":null},{"id":"2109.06862","title":"Legal Transformer Models May Not Always Help","created":"2021-09-14","cited_by_count":6,"area":null},{"id":"2207.09152","title":"Benchmarking Transformers-based models on French Spoken Language Understanding tasks","created":"2022-07-19","cited_by_count":3,"area":null},{"id":"2601.05911","title":"Pantagruel: Unified Self-Supervised Encoders for French Text and Speech","created":"2026-01-09","cited_by_count":2,"area":null},{"id":"2401.07525","title":"TAROT: A Hierarchical Framework with Multitask Co-Pretraining on Semi-Structured Data towards Effective Person-Job Fit","created":"2024-01-15","cited_by_count":1,"area":null},{"id":"2510.04945","title":"A First Context-Free Grammar Applied to Nawatl Corpora Augmentation","created":"2025-10-06","cited_by_count":1,"area":null},{"id":"2512.14239","title":"Two CFG Nahuatl for automatic corpora expansion","created":"2025-12-16","cited_by_count":1,"area":null},{"id":"2311.00268","title":"Syntactic Inductive Bias in Transformer Language Models: Especially Helpful for Low-Resource Languages?","created":"2023-11-01","cited_by_count":0,"area":null},{"id":"2505.16277","title":"Spontaneous Speech Variables for Evaluating LLMs Cognitive Plausibility","created":"2025-05-22","cited_by_count":0,"area":null},{"id":"2604.07015","title":"Corpora deduplication or duplication in Natural Language Processing of few resourced languages ? A case of study: The Mexico's Nahuatl","created":"2026-04-08","cited_by_count":0,"area":null}],"next_cursor":null}