mlsanityData to 7 Oct 2026

Small Language Models for Application Interactions: A Case Study

arXiv 2405.20347 ↗First posted 23 May 2024cs.CL cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

We study the efficacy of Small Language Models (SLMs) in facilitating application usage through natural language interactions. Our focus here is on a particular internal application used in Microsoft for cloud supply chain fulfilment. Our experiments show that small models can outperform much larger ones in terms of both accuracy and running time, even when fine-tuned on small datasets. Alongside these results, we also highlight SLM-based system design considerations.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 17 of its 24 references that are in the map. First posted on arXiv 23 May 2024.

Builds on

17 of 24 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2020Scaling Laws for Neural Language Modelscited by 6,411
  6. 2023Mistral 7Bcited by 3,065
  7. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  8. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  9. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  10. 2017Deep Learning Scaling is Predictable, Empiricallycited by 556
  11. 2023Scaling Data-Constrained Language Modelscited by 391
  12. 2023A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicitycited by 180
5 more
  1. 2024RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculturecited by 80
  2. 2023TinyGSM: achieving >80% on GSM8k with small language modelscited by 68
  3. 2023Large Language Models for Supply Chain Optimizationcited by 61
  4. 2024LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Reportcited by 47
  5. 2023Selective Pre-training for Private Fine-tuningcited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 1.

5 papers.

  1. 2024Small Language Models: Survey, Measurements, and Insightscited by 109
  2. 2025Learnware of Language Models: Specialized Small Language Models Can Do Bigcited by 3
  3. 2024Structured List-Grounded Question Answeringcited by 0
  4. 2025ixi-GEN: Efficient Industrial sLLMs through Domain Adaptive Continual Pretrainingcited by 0
  5. 2026Can Hallucinations Be Useful? Solving Multi-Hop Questions With SLMs By Chaining System-I/II Reasoningcited by 0