mlsanityData to 7 Oct 2026

SikuGPT: A Generative Pre-trained Model for Intelligent Information Processing of Ancient Texts from the Perspective of Digital Humanities

arXiv 2304.07778 ↗First posted 16 Apr 2023cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

The rapid advance in artificial intelligence technology has facilitated the prosperity of digital humanities research. Against such backdrop, research methods need to be transformed in the intelligent processing of ancient texts, which is a crucial component of digital humanities research, so as to adapt to new development trends in the wave of AIGC. In this study, we propose a GPT model called SikuGPT based on the corpus of Siku Quanshu. The model's performance in tasks such as intralingual translation and text classification exceeds that of other GPT-type models aimed at processing ancient texts. SikuGPT's ability to process traditional Chinese ancient texts can help promote the organization of ancient information and knowledge services, as well as the international dissemination of Chinese ancient culture.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 16 Apr 2023.

Builds on

23 of 40 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  8. 2022Emergent Abilities of Large Language Modelscited by 2,483
  9. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  10. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  11. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  12. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
11 more
  1. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  2. 2019MASS: Masked Sequence to Sequence Pre-training for Language Generationcited by 345
  3. 2019UER: An Open-Source Toolkit for Pre-training Modelscited by 61
  4. 2021GPT-3 Models are Poor Few-Shot Learners in the Biomedical Domaincited by 36
  5. 2020AnchiBERT: A Pre-Trained Model for Ancient ChineseLanguage Understanding and Generationcited by 15
  6. 2019GPT-based Generation for Classical Chinese Poetrycited by 12
  7. 2020Generating Major Types of Chinese Classical Poetry in a Uniformed Frameworkcited by 12
  8. 2020Restoration of Fragmentary Babylonian Texts Using Recurrent Neural Networkscited by 11
  9. 2021Time-Aware Ancient Chinese Text Translation and Inferencecited by 10
  10. 2021Summarising Historical Text in Modern Languagescited by 6
  11. 2021SP-GPT2: Semantics Improvement in Vietnamese Poetry Generationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 3; 2026: 1.

9 papers.

  1. 2023GujiBERT and GujiGPT: Construction of Intelligent Information Processing Foundation Language Models for Ancient Textscited by 9
  2. 2025WenyanGPT: A Large Language Model for Classical Chinese Taskscited by 4
  3. 2024TongGu: Mastering Classical Chinese Understanding with Knowledge-Grounded Large Language Modelscited by 3
  4. 2024C3Bench: A Comprehensive Classical Chinese Understanding Benchmark for Large Language Modelscited by 2
  5. 2024Shared Heritage, Distinct Writing: Rethinking Resource Selection for East Asian Historical Documentscited by 1
  6. 2025RiverEcho: Real-Time Interactive Digital System for Ancient Yellow River Culturecited by 1
  7. 2025InteChar: A Unified Oracle Bone Character List for Ancient Chinese Language Modelingcited by 1
  8. 2023Exploring the Capabilities of ChatGPT in Ancient Chinese Translation and Person Name Recognitioncited by 0
  9. 2026When the Knowledge Base Becomes the Gold Standard: Measuring Resource-Shared Evaluation Loops in Entity-Level Machine Translationcited by 0