Translational NLP: A New Paradigm and General Principles for Natural Language Processing Research
Not on the map. Why?
Abstract (arXiv)
Natural language processing (NLP) research combines the study of universal principles, through basic science, with applied science targeting specific use cases and settings. However, the process of exchange between basic NLP and applications is often assumed to emerge naturally, resulting in many innovations going unapplied and many important questions left unstudied. We describe a new paradigm of Translational NLP, which aims to structure and facilitate the processes by which basic and applied NLP research inform one another. Translational NLP thus presents a third research paradigm, focused on understanding the challenges posed by application needs and how these challenges can drive innovation in basic science and technology design. We show that many significant advances in NLP research have emerged from the intersection of basic principles with application needs, and present a conceptual framework outlining the stakeholders and key questions in translational research. Our framework provides a roadmap for developing Translational NLP as a dedicated research area, and identifies general translational principles to facilitate exchange between basic and applied research.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 23 of its 94 references that are in the map. First posted on arXiv 16 Apr 2021.
Builds on
23 of 94 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2018Deep contextualized word representationscited by 2,285
- 2019Attention is not not Explanationcited by 629
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
- 2018Analysis Methods in Neural Language Processing: A Surveycited by 276
11 more
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2019InterpretML: A Unified Framework for Machine Learning Interpretabilitycited by 243
- 2016Demographic Dialectal Variation in Social Media: A Case Study of African-American Englishcited by 194
- 2020HAT: Hardware-Aware Transformers for Efficient Natural Language Processingcited by 136
- 2020Investigating African-American Vernacular English in Transformer-Based Text Generationcited by 52
- 2018Jointly Embedding Entities and Text with Distant Supervisioncited by 7
- 2018Embedding Transfer for Low-Resource Medical Named Entity Recognition: A Case Study on Patient Mobilitycited by 5
- 2020Lightweight Convolutional Representations for On-Device Natural Language Processingcited by 4
- 2020Costs to Consider in Adopting NLP for Your Businesscited by 3
- 2019HARE: a Flexible Highlighting Annotator for Ranking and Explorationcited by 2
- 2020Automated Coding of Under-Studied Medical Concept Domains: Linking Physical Activity Reports to the International Classification of Functioning, Disability, and Healthcited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 2; 2025: 1; 2026: 1.
7 papers.
- 2022Yes-Yes-Yes: Proactive Data Collection for ACL Rolling Review and Beyondcited by 12
- 2024Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challengescited by 5
- 2021Adapting to the Long Tail: A Meta-Analysis of Transfer Learning Research for Language Understanding Taskscited by 4
- 2024AI Thinking: A framework for rethinking artificial intelligence in practicecited by 2
- 2026Benchmarking Machine Translation on Chinese Social Media Textscited by 2
- 2025Beyond Text: Characterizing Domain Expert Needs in Document Researchcited by 1
- 2023Transformer-based Named Entity Recognition in Construction Supply Chain Risk Management in Australiacited by 0
- 2026Benchmarking Machine Translation on Chinese Social Media Texts30 Jan 2026
- 2025Beyond Text: Characterizing Domain Expert Needs in Document Research16 Apr 2025
- 2024AI Thinking: A framework for rethinking artificial intelligence in practice26 Aug 2024
- 2024Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challenges17 May 2024
- 2023Transformer-based Named Entity Recognition in Construction Supply Chain Risk Management in Australia23 Nov 2023
- 2022Yes-Yes-Yes: Proactive Data Collection for ACL Rolling Review and Beyond27 Jan 2022
- 2021Adapting to the Long Tail: A Meta-Analysis of Transfer Learning Research for Language Understanding Tasks2 Nov 2021