mlsanityData to 7 Oct 2026

TaxoLLaMA: WordNet-based Model for Solving Multiple Lexical Semantic Tasks

arXiv 2403.09207 ↗First posted 14 Mar 2024cs.CLcited by 14

Not on the map. Why?

Abstract (arXiv)

In this paper, we explore the capabilities of LLMs in capturing lexical-semantic knowledge from WordNet on the example of the LLaMA-2-7b model and test it on multiple lexical semantic tasks. As the outcome of our experiments, we present TaxoLLaMA, the everything-in-one model, lightweight due to 4-bit quantization and LoRA. It achieves 11 SotA results, 4 top-2 results out of 16 tasks for the Taxonomy Enrichment, Hypernym Discovery, Taxonomy Construction, and Lexical Entailment tasks. Moreover, it demonstrates very strong zero-shot performance on Lexical Entailment and Taxonomy Construction with no fine-tuning. We also explore its hidden multilingual and domain adaptation capabilities with a little tuning or few-shot learning. All datasets, code, and model are available online at https://github.com/VityaVitalich/TaxoLLaMA

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 24 of its 47 references that are in the map. First posted on arXiv 14 Mar 2024.

Builds on

24 of 47 references.

References · 24

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  6. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  7. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
  8. 2022A Survey on In-context Learningcited by 717
  9. 2024Extreme Compression of Large Language Models via Additive Quantizationcited by 223
  10. 2023Unlearn What You Want to Forget: Efficient Unlearning for LLMscited by 211
  11. 2019Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networkscited by 103
  12. 2022Event knowledge in large language models: the gap between the impossible and the unlikelycited by 44
12 more
  1. 2016HyperLex: A Large-Scale Evaluation of Graded Lexical Entailmentcited by 25
  2. 2019Every child should have parents: a taxonomy refinement algorithm based on hyperbolic term embeddingscited by 23
  3. 2021Taxonomy Completion via Triplet Matching Networkcited by 21
  4. 2022TaxoEnrich: Self-Supervised Taxonomy Completion via Structure-Semantic Representationscited by 20
  5. 2021Enhancing Taxonomy Completion with Concept Generation via Fusing Relational Representationscited by 19
  6. 2017Specialising Word Vectors for Lexical Entailmentcited by 18
  7. 2019Probabilistic Models of Relational Implicationcited by 17
  8. 2018pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inferencecited by 10
  9. 2023What Do Llamas Really Think? Revealing Preference Biases in Language Model Representationscited by 10
  10. 2022Distilling Hypernymy Relations from Language Models: On the Effectiveness of Zero-Shot Taxonomy Inductioncited by 8
  11. 2022Smoothing Entailment Graphs with Language Modelscited by 8
  12. 2018SeVeN: Augmenting Word Embeddings with Unsupervised Relation Vectorscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 8; 2026: 1.

14 papers.

Sort:

By area:

  1. 2024Do LLMs Really Adapt to Domains? An Ontology Learning Perspectivecited by 10
  2. 2024CodeTaxo: Enhancing Taxonomy Expansion with Limited Examples via Code Language Promptscited by 10
  3. 2025The LLM Bottleneck: Why Open-Source Vision LLMs Struggle with Hierarchical Visual Recognitioncited by 7
  4. 2025Vision-and-Language Training Helps Deploy Taxonomic Knowledge but Does Not Fundamentally Alter Itcited by 6
  5. 2024Frame Representation Hypothesis: Multi-Token LLM Interpretability and Concept-Guided Text Generationcited by 5
  6. 2024Talking the Talk Does Not Entail Walking the Walk: On the Limits of Large Language Models in Lexical Entailment Recognitioncited by 1
  7. 2025Meaning Beyond Truth Conditions: Evaluating Discourse Level Understanding via Anaphora Accessibilitycited by 1
  8. 2025KnowCoder-V2: Deep Knowledge Analysiscited by 1
  9. 2024GEAR: A Simple GENERATE, EMBED, AVERAGE AND RANK Approach for Unsupervised Reverse Dictionarycited by 0
  10. 2025Do I look like a `cat.n.01` to you? A Taxonomy Image Generation Benchmarkcited by 0
  11. 2025CEFR-Annotated WordNet: LLM-Based Proficiency-Guided Semantic Database for Language Learningcited by 0
  12. 2025Evontree: Ontology Rule-Guided Self-Evolution of Large Language Modelscited by 0
2 more
  1. 2025OpenGloss: A Synthetic Encyclopedic Dictionary and Semantic Knowledge Graphcited by 0
  2. 2026BEATS: Bootstrapping E-commerce Attribute Taxonomies for Search through Iterative Human-AI Collaborationcited by 0