mlsanityData to 14 Oct 2026

Grandes modelos de lenguaje: de la predicci'on de palabras a la comprensi'on?

arXiv 2502.18205 ↗First posted 25 Feb 2025cs.CL cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models, such as the well-known ChatGPT, have brought about an unexpected revolution in the field of artificial intelligence. On the one hand, they have numerous practical applications and enormous potential still to be explored. On the other hand, they are also the subject of debate from scientific, philosophical, and social perspectives: there are doubts about the exact mechanisms of their functioning and their actual capacity for language comprehension, and their applications raise ethical dilemmas. In this chapter, we describe how this technology has been developed and the fundamentals of its operation, allowing us to better understand its capabilities and limitations and to introduce some of the main debates surrounding its development and use. -- Los grandes modelos de lenguaje, como el conocido ChatGPT, han supuesto una inesperada revoluci'on en el 'ambito de la inteligencia artificial. Por un lado, cuentan con multitud de aplicaciones pr'acticas y un enorme potencial todav'ia por explorar. Por otro lado, son tambi'en objeto de debate, tanto desde el punto de vista cient'ifico y filos'ofico como social: hay dudas sobre los mecanismos exactos de su funcionamiento y su capacidad real de comprensi'on del lenguaje, y sus aplicaciones plantean dilemas 'eticos. En este cap'itulo describimos c'omo se ha llegado a esta tecnolog'ia y los fundamentos de su funcionamiento, permiti'endonos as'i comprender mejor sus capacidades y limitaciones e introducir algunos de los principales debates que rodean su desarrollo y uso.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 57 references that are in the map. First posted on arXiv 25 Feb 2025.

Builds on

32 of 57 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2024The Llama 3 Herd of Modelscited by 14,715
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  7. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  8. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  9. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  10. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  11. 2022Emergent Abilities of Large Language Modelscited by 2,512
  12. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
20 more
  1. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  2. 2022Towards Reasoning in Large Language Models: A Surveycited by 596
  3. 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 523
  4. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
  5. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
  6. 2021Implicit Representations of Meaning in Neural Language Modelscited by 180
  7. 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
  8. 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
  9. 2023A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writingcited by 99
  10. 2023Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluationcited by 97
  11. 2024Understanding Emergent Abilities of Language Models from the Loss Perspectivecited by 94
  12. 2024Is Temperature the Creativity Parameter of Large Language Models?cited by 93
  13. 2024LLMs Will Always Hallucinate, and We Need to Live With Thiscited by 78
  14. 2023Could a Large Language Model be Conscious?cited by 73
  15. 2024Datasets for Large Language Models: A Comprehensive Surveycited by 71
  16. 2023Summarization is (Almost) Deadcited by 44
  17. 2024Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing?cited by 27
  18. 2024Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Taskscited by 24
  19. 2023Meaning and understanding in large language modelscited by 5
  20. 2024The Unlikely Duel: Evaluating Creative Writing in LLMs through a Unique Scenariocited by 2

Built on by

Not cited yet.