mlsanityData to 14 Oct 2026

AutoTail-BSFGM: Class-Balance-Aware Fine-Tuning for Chinese Scholarly Text Classification

arXiv 2606.03576 ↗First posted 2 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Scholarly text classification supports literature organization, subject indexing, and research intelligence, but Chinese scholarly corpora often contain imbalanced and semantically adjacent disciplinary labels. We propose AutoTail-BSFGM, a class-balance-aware fine-tuning method that combines an automatically gated tail-prior adjustment, a weak Balanced Softmax auxiliary loss, and Fast Gradient Method adversarial regularization. The method changes only the training objective and procedure; inference uses the same single base-size encoder and linear classifier as the corresponding label-smoothed baseline. We evaluate the method on two CSL-based tasks: an abstract-to-discipline task with 67 labels and a title-to-category task with 13 categories. On the primary abstract task, AutoTail-BSFGM improves validation and lockbox accuracy under both Chinese RoBERTa-WWM and MacBERT-base. With MacBERT-base, validation accuracy increases by 0.83 percentage points and lockbox accuracy by 0.49 points, with a pooled paired McNemar signal on validation (p = 0.023). On the title task, the method improves validation accuracy by 0.70 points and validation balanced accuracy by 2.64 points; lockbox accuracy is approximately neutral while lockbox balanced accuracy improves by 1.22 points. The results support a bounded contribution: AutoTail-BSFGM improves class-balance-sensitive behavior and yields consistent gains for abstract-based scholarly classification, without uniformly improving every metric on every split.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 42 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

27 of 42 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  4. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  5. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
  6. 2020Long-tail learning via logit adjustmentcited by 618
  7. 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 513
  8. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 478
  9. 2020Balanced Meta-Softmax for Long-Tailed Visual Recognitioncited by 400
  10. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 322
  11. 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
  12. 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 266
15 more
  1. 2019FreeLB: Enhanced Adversarial Training for Natural Language Understandingcited by 264
  2. 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 254
  3. 2021R-Drop: Regularized Dropout for Neural Networkscited by 202
  4. 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 129
  5. 2018Construction of the Literature Graph in Semantic Scholarcited by 118
  6. 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
  7. 2014Growth rates of modern science: A bibliometric analysis based on the number of publications and cited referencescited by 64
  8. 2022CSL: A Large-scale Chinese Scientific Literature Datasetcited by 45
  9. 2024Language Models for Text Classification: Is In-Context Learning Enough?cited by 40
  10. 2022A Survey of Methods for Addressing Class Imbalance in Deep-Learning Based Natural Language Processingcited by 21
  11. 2022PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learnerscited by 7
  12. 2023PESCO: Prompt-enhanced Self Contrastive Learning for Zero-shot Text Classificationcited by 4
  13. 2024SciPrompt: Knowledge-augmented Prompting for Fine-grained Categorization of Scientific Topicscited by 4
  14. 2024Efficient Few-shot Learning for Multi-label Classification of Scientific Documents with Many Classescited by 3
  15. 2024Artificial Intuition: Efficient Classification of Scientific Abstractscited by 2

Built on by

Not cited yet.