Natural Language Processing: A Comprehensive Practical Guide from Tokenisation to RLHF
On the map: Retrieval-augmented generation → Generation and context integration
Abstract (arXiv)
This preprint presents a systematic, research-oriented practicum that guides the reader through the entire modern NLP pipeline --- from tokenisation and vectorisation to fine tuning of large language models, retrieval augmented generation, reinforcement learning from human feedback, prompt engineering, model compression, and multimodal systems. Seventeen hands-on sessions combine concise theory with detailed implementation plans, formalised evaluation metrics, and transparent assessment criteria. The work is not a conventional textbook: it is designed as a reproducible research artefact where every session requires publishing code, models, and reports in public repositories. All experiments are conducted on a single evolving corpus, and the work advocates open weight models over commercial APIs, with special attention to the Hugging Face ecosystem. The material is enriched by original research on low resource languages, incorporating linguistic resources for Tajik and Tatar --- subword tokenisers, embeddings, lexical databases, and transliteration benchmarks --- demonstrating how modern NLP can be adapted to data scarce environments. The practicum also covers advanced topics including AI agents, multi-agent systems, LLMOps, and efficient inference, preparing students for both research and industrial deployment. Designed for senior undergraduates, graduate students, and practising developers seeking to implement, compare, and deploy methods from classical ML to state of the art multimodal and agent-based systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 43 of its 83 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
43 of 83 references.
Closest ancestors · 3
Same direction, newest first
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Models5 Aug
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks22 May
- 2020REALM: Retrieval-Augmented Language Model Pre-Training10 Feb
Other references · 40
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Visual Instruction Tuningcited by 7,792
28 more
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2020Learning to summarize from human feedbackcited by 2,562
- 2023A Survey of Large Language Modelscited by 2,537
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2020AutoGluon-Tabular: Robust and Accurate AutoML for Structured Datacited by 368
- 2020Low-resource Languages: A Review of Past Work and Future Challengescited by 90
- 2022Privacy-Preserved Neural Graph Similarity Learningcited by 2
- 2023Exploring the Consistency, Quality and Challenges in Manual and Automated Coding of Free-text Diagnoses from Hospital Outpatient Letterscited by 2
- 2019BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task Learningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Optimising Language Models for Downstream Tasks: A Post-Training Perspective
- 2024A critical review of methods and challenges in large language models
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications
- 2024RAG and RAU: A Survey on Retrieval-Augmented Language Model in Natural Language Processing
- 2026Transformer-Based Language Models Across Domain Verticals: Architectures, Applications and Critical Assessment
- 2024Efficient Prompting Methods for Large Language Models: A Survey
- 2023Aligning Large Language Models with Human: A Survey
- 2023Large Language Model Alignment: A Survey