mlsanityData to 7 Oct 2026

ArcGPT: A Large Language Model Tailored for Real-world Archival Applications

arXiv 2307.14852 ↗First posted 27 Jul 2023cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Archives play a crucial role in preserving information and knowledge, and the exponential growth of such data necessitates efficient and automated tools for managing and utilizing archive information resources. Archival applications involve managing massive data that are challenging to process and analyze. Although LLMs have made remarkable progress in diverse domains, there are no publicly available archives tailored LLM. Addressing this gap, we introduce ArcGPT, to our knowledge, the first general-purpose LLM tailored to the archival field. To enhance model performance on real-world archival tasks, ArcGPT has been pre-trained on massive and extensive archival domain data. Alongside ArcGPT, we release AMBLE, a benchmark comprising four real-world archival tasks. Evaluation on AMBLE shows that ArcGPT outperforms existing state-of-the-art models, marking a substantial step forward in effective archival data management. Ultimately, ArcGPT aims to better serve the archival community, aiding archivists in their crucial role of preserving and harnessing our collective information and knowledge.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 40 of its 63 references that are in the map. First posted on arXiv 27 Jul 2023.

Builds on

40 of 63 references.

References · 40

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  9. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  10. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  11. 2021Program Synthesis with Large Language Modelscited by 3,509
  12. 2023A Survey of Large Language Modelscited by 2,537
28 more
  1. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  2. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  3. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  4. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  5. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  6. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  7. 2023BloombergGPT: A Large Language Model for Financecited by 923
  8. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  9. 2022Galactica: A Large Language Model for Sciencecited by 736
  10. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  11. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
  12. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 302
  13. 2018SentEval: An Evaluation Toolkit for Universal Sentence Representationscited by 294
  14. 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
  15. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 221
  16. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 217
  17. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
  18. 2022Talking About Large Language Modelscited by 174
  19. 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 130
  20. 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
  21. 2021CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generationcited by 81
  22. 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
  23. 2023ARB: Advanced Reasoning Benchmark for Large Language Modelscited by 60
  24. 2023A Bibliometric Review of Large Language Models Research from 2017 to 2023cited by 56
  25. 2021Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinesecited by 45
  26. 2023BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained Transformercited by 23
  27. 2023Several categories of Large Language Models (LLMs): A Short Surveycited by 6
  28. 2018History Playground: A Tool for Discovering Temporal Trends in Massive Textual Corporacited by 1

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 2.

3 papers.