Multilevel Large Language Models for Everyone
Not on the map. Why?
Abstract (arXiv)
Large language models have made significant progress in the past few years. However, they are either generic it or field specific, splitting the community into different groups. In this paper, we unify these large language models into a larger map, where the generic it and specific models are linked together and can improve each other, based on the user personal input and information from the internet. The idea of linking several large language models together is inspired by the functionality of human brain. The specific regions on the brain cortex are specific for certain low level functionality. And these regions can jointly work together to achieve more complex high level functionality. Such behavior on human brain cortex sheds the light to design the multilevel large language models that contain global level, field level and user level models. The user level models run on local machines to achieve efficient response and protect the user's privacy. Such multilevel models reduce some redundancy and perform better than the single level models. The proposed multilevel idea can be applied in various applications, such as natural language processing, computer vision tasks, professional assistant, business and healthcare.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 14 of its 45 references that are in the map. First posted on arXiv 25 Jul 2023.
Builds on
14 of 45 references.
References · 14
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2023A Survey of Large Language Modelscited by 2,537
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2023Training Language Models with Language Feedback at Scalecited by 125
- 2019Side Window Filteringcited by 27
- 2021What do Large Language Models Learn about Scripts?cited by 19
- 2019Weighted Mean Curvaturecited by 15
- 2021Fast and High-Quality Blind Multi-Spectral Image Pansharpeningcited by 13
2 more
Built on by
Citing papers per year: 2023: 4; 2024: 1.
5 papers.
- 2023AE-GPT: Using Large Language Models to Extract Adverse Events from Surveillance Reports-A Use Case with Influenza Vaccine Adverse Eventscited by 8
- 2023Gradient Domain Diffusion Models for Image Synthesiscited by 4
- 2024Achieving Peak Performance for Large Language Models: A Systematic Reviewcited by 4
- 2023TSSR: A Truncated and Signed Square Root Activation Function for Neural Networkscited by 1
- 2023STL: A Signed and Truncated Logarithm Activation Function for Neural Networkscited by 0
- 2024Achieving Peak Performance for Large Language Models: A Systematic Review7 Sep 2024
- 2023AE-GPT: Using Large Language Models to Extract Adverse Events from Surveillance Reports-A Use Case with Influenza Vaccine Adverse Events28 Sep 2023
- 2023Gradient Domain Diffusion Models for Image Synthesis5 Sep 2023
- 2023TSSR: A Truncated and Signed Square Root Activation Function for Neural Networks9 Aug 2023
- 2023STL: A Signed and Truncated Logarithm Activation Function for Neural Networks31 Jul 2023