mlsanityData to 14 Oct 2026

Enhancing Burmese News Classification with Kolmogorov-Arnold Network Head Fine-tuning

arXiv 2511.21081 ↗First posted 26 Nov 2025cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In low-resource languages like Burmese, classification tasks often fine-tune only the final classification layer, keeping pre-trained encoder weights frozen. While Multi-Layer Perceptrons (MLPs) are commonly used, their fixed non-linearity can limit expressiveness and increase computational cost. This work explores Kolmogorov-Arnold Networks (KANs) as alternative classification heads, evaluating Fourier-based FourierKAN, Spline-based EfficientKAN, and Grid-based FasterKAN-across diverse embeddings including TF-IDF, fastText, and multilingual transformers (mBERT, Distil-mBERT). Experimental results show that KAN-based heads are competitive with or superior to MLPs. EfficientKAN with fastText achieved the highest F1-score (0.928), while FasterKAN offered the best trade-off between speed and accuracy. On transformer embeddings, EfficientKAN matched or slightly outperformed MLPs with mBERT (0.917 F1). These findings highlight KANs as expressive, efficient alternatives to MLPs for low-resource language classification.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 23 references that are in the map. First posted on arXiv 26 Nov 2025.

Builds on

10 of 23 references.

References · 10

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  4. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  5. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
  6. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
  7. 2024KAN: Kolmogorov-Arnold Networkscited by 649
  8. 2020The Kolmogorov-Arnold representation theorem revisitedcited by 89
  9. 2023Tuning Pre-trained Model via Moment Probingcited by 9
  10. 2024FourierKAN outperforms MLP on Text Classification Head Fine-tuningcited by 5

Built on by

Not cited yet.