mlsanityData to 14 Oct 2026

Camoscio: an Italian Instruction-tuned LLaMA

arXiv 2307.16456 ↗First posted 31 Jul 2023cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

In recent years Large Language Models (LLMs) have increased the state of the art on several natural language processing tasks. However, their accessibility is often limited to paid API services, posing challenges for researchers in conducting extensive investigations. On the other hand, while some open-source models have been proposed by the community, they are typically English-centric or multilingual without a specific adaptation for the Italian language. In an effort to democratize the available and open resources for the Italian language, in this paper we introduce Camoscio: a language model specifically tuned to follow users' prompts in Italian. Specifically, we finetuned the smallest variant of LLaMA (7b) with LoRA on a corpus of instruction prompts translated to Italian via ChatGPT. Results indicate that the model's zero-shot performance on various downstream tasks in Italian competes favorably with existing models specifically finetuned for those tasks. All the artifacts (code, dataset, model) are released to the community at the following url: https://github.com/teelinsan/camoscio

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 32 of its 95 references that are in the map. First posted on arXiv 31 Jul 2023.

Builds on

32 of 95 references.

References · 32

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  8. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  9. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  10. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  11. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  12. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
20 more
  1. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  2. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  3. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  5. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  6. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  7. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  8. 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 906
  9. 2023Instruction Tuning with GPT-4cited by 686
  10. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
  11. 2021Datasets: A Community Library for Natural Language Processingcited by 530
  12. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
  13. 2023Accelerating Transformer Inference for Translation via Parallel Decodingcited by 124
  14. 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 52
  15. 2020Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answeringcited by 41
  16. 2022IT5: Text-to-text Pretraining for Italian Language Understanding and Generationcited by 20
  17. 2020GePpeTto Carves Italian into a Language Modelcited by 16
  18. 2023Fauno: The Italian Large Language Model that will leave you senza parole!cited by 13
  19. 2023Latent Autoregressive Source Separationcited by 12
  20. 2023Multimodal Neural Databasescited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 8; 2025: 2; 2026: 1.

13 papers.

Sort:

By area:

  1. 2023Empowering Cross-lingual Abilities of Instruction-tuned Large Language Models by Translation-following demonstrationscited by 35
  2. 2024Query Performance Prediction using Relevance Judgments Generated by Large Language Modelscited by 18
  3. 2024A Survey of Large Language Models for European Languagescited by 6
  4. 2024Disce aut Deficere: Evaluating LLMs Proficiency on the INVALSI Italian Benchmarkcited by 5
  5. 2024The Invalsi Benchmarks: measuring Linguistic and Mathematical understanding of Large Language Models in Italiancited by 4
  6. 2024Leveraging Large Language Models to Geolocate Linguistic Variations in Social Media Postscited by 2
  7. 2024A gentle push funziona benissimo: making instructed models in Italian via contrastive activation steeringcited by 1
  8. 2025CC-Tuning: A Cross-Lingual Connection Mechanism for Improving Joint Multilingual Supervised Fine-Tuningcited by 1
  9. 2023Experimenting AI Technologies for Disinformation Combat: the IDMO Projectcited by 0
  10. 2024Unipa-GPT: Large Language Models for university-oriented QA in Italiancited by 0
  11. 2024SLIMER-IT: Zero-Shot NER on Italian Languagecited by 0
  12. 2025Fluent Alignment with Disfluent Judges: Post-training for Lower-resource Languagescited by 0
1 more
  1. 2026Language, Language Models, and What We're Talking Aboutcited by 0