mlsanityData to 14 Oct 2026

Fauno: The Italian Large Language Model that will leave you senza parole!

arXiv 2306.14457 ↗First posted 26 Jun 2023cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

This paper presents Fauno, the first and largest open-source Italian conversational Large Language Model (LLM). Our goal with Fauno is to democratize the study of LLMs in Italian, demonstrating that obtaining a fine-tuned conversational bot with a single GPU is possible. In addition, we release a collection of datasets for conversational AI in Italian. The datasets on which we fine-tuned Fauno include various topics such as general question answering, computer science, and medical questions. We release our code and datasets on urlhttps://github.com/RSTLess-research/Fauno-Italian-LLM

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 31 of its 43 references that are in the map. First posted on arXiv 26 Jun 2023.

Builds on

31 of 43 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  9. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  10. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  11. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  12. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
19 more
  1. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  2. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  3. 2020Point Transformercited by 1,470
  4. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
  5. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  6. 2018Self-Attentive Sequential Recommendationcited by 1,184
  7. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  8. 2020Jukebox: A Generative Model for Musiccited by 542
  9. 2020Towards a Human-like Open-Domain Chatbotcited by 470
  10. 2023MusicLM: Generating Music From Textcited by 448
  11. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 176
  12. 2019A Question-Entailment Approach to Question Answeringcited by 134
  13. 2021Shape registration in the time of transformerscited by 51
  14. 2023A Survey on Efficient Training of Transformerscited by 39
  15. 2022IT5: Text-to-text Pretraining for Italian Language Understanding and Generationcited by 20
  16. 2020GePpeTto Carves Italian into a Language Modelcited by 16
  17. 2023Multimodal Neural Databasescited by 7
  18. 2021CycleDRUMS: Automatic Drum Arrangement For Bass Lines Using CycleGANcited by 4
  19. 2023Integrating Item Relevance in Training Loss for Sequential Recommender Systemscited by 4

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 10.

13 papers.

Sort:

By area:

  1. 2024Large Concept Models: Language Modeling in a Sentence Representation Spacecited by 89
  2. 2024Advanced Natural-based interaction for the ITAlian language: LLaMAntino-3-ANITAcited by 17
  3. 2023Camoscio: an Italian Instruction-tuned LLaMAcited by 13
  4. 2024BgGPT 1.0: Extending English-centric LLMs to other languagescited by 8
  5. 2023RRAML: Reinforced Retrieval Augmented Machine Learningcited by 6
  6. 2024A Survey of Large Language Models for European Languagescited by 6
  7. 2024Disce aut Deficere: Evaluating LLMs Proficiency on the INVALSI Italian Benchmarkcited by 5
  8. 2024The Invalsi Benchmarks: measuring Linguistic and Mathematical understanding of Large Language Models in Italiancited by 4
  9. 2023Cerbero-7B: A Leap Forward in Language-Specific LLMs Through Enhanced Chat Corpus Generation and Evaluationcited by 3
  10. 2024Fine-tuning with HED-IT: The impact of human post-editing for dialogical language modelscited by 3
  11. 2024"Vorbecsti Romanecste?" A Recipe to Train Powerful Romanian LLMs with English Instructionscited by 3
  12. 2024Open Llama2 Model for the Lithuanian Languagecited by 2
1 more
  1. 2024Unipa-GPT: Large Language Models for university-oriented QA in Italiancited by 0