mlsanityData to 7 Oct 2026

Exploring Advanced Large Language Models with LLMsuite

arXiv 2407.12036 ↗First posted 1 Jul 2024cs.CL cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

This tutorial explores the advancements and challenges in the development of Large Language Models (LLMs) such as ChatGPT and Gemini. It addresses inherent limitations like temporal knowledge cutoffs, mathematical inaccuracies, and the generation of incorrect information, proposing solutions like Retrieval Augmented Generation (RAG), Program-Aided Language Models (PAL), and frameworks such as ReAct and LangChain. The integration of these techniques enhances LLM performance and reliability, especially in multi-step reasoning and complex task execution. The paper also covers fine-tuning strategies, including instruction fine-tuning, parameter-efficient methods like LoRA, and Reinforcement Learning from Human Feedback (RLHF) as well as Reinforced Self-Training (ReST). Additionally, it provides a comprehensive survey of transformer architectures and training techniques for LLMs. The source code can be accessed by contacting the author via email for a request.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 1 Jul 2024.

Builds on

36 of 49 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2017Proximal Policy Optimization Algorithmscited by 14,441
  7. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  8. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  9. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  10. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  11. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  12. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
24 more
  1. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  3. 2017Deep reinforcement learning from human preferencescited by 3,846
  4. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  6. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  7. 2020Learning to summarize from human feedbackcited by 2,562
  8. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  9. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  10. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  11. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  12. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  13. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
  14. 2018Neural Network Acceptability Judgmentscited by 952
  15. 2023BloombergGPT: A Large Language Model for Financecited by 923
  16. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
  17. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
  18. 2022PAL: Program-aided Language Modelscited by 635
  19. 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
  20. 2023Reinforced Self-Training (ReST) for Language Modelingcited by 486
  21. 2024The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bitscited by 289
  22. 2024Capabilities of Gemini Models in Medicinecited by 231
  23. 2023Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuningcited by 171
  24. 2023Automating Customer Service using LangChain: Building custom open-source GPT Chatbot for organizationscited by 59

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

  1. 2025The Origin of Self-Attention: Pairwise Affinity Matrices in Feature Selection and the Emergence of Self-Attentioncited by 1
  2. 2025Large Language Models for Explainable Threat Intelligencecited by 0
  3. 2026Self-Attention And Beyond the Infinite: Towards Linear Transformers with Infinite Self-Attentioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024A critical review of methods and challenges in large language models
  2. 2023A Comprehensive Overview of Large Language Models
  3. 2024MM-LLMs: Recent Advances in MultiModal Large Language Models
  4. 2024A Survey of Large Language Models for European Languages
  5. 2024ChatGPT Alternative Solutions: Large Language Models Survey
  6. 2024Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges
  7. 2024LLMs Beyond English: Scaling the Multilingual Capability of LLMs with Cross-Lingual Feedback
  8. 2025Slimming Down LLMs Without Losing Their Minds