mlsanityData to 14 Oct 2026

Towards Universal Semantics With Large Language Models

arXiv 2505.11764 ↗First posted 17 May 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The Natural Semantic Metalanguage (NSM) is a linguistic theory based on a universal set of semantic primes: simple, primitive word-meanings that have been shown to exist in most, if not all, languages of the world. According to this framework, any word, regardless of complexity, can be paraphrased using these primes, revealing a clear and universally translatable meaning. These paraphrases, known as explications, can offer valuable applications for many natural language processing (NLP) tasks, but producing them has traditionally been a slow, manual process. In this work, we present the first study of using large language models (LLMs) to generate NSM explications. We introduce automatic evaluation methods, a tailored dataset for training and evaluation, and fine-tuned models for this task. Our 1B and 8B models outperform GPT-4o in producing accurate, cross-translatable explications, marking a significant step toward universal semantic representation with LLMs and opening up new possibilities for applications in semantic analysis, translation, and beyond. Our code is available at https://github.com/OSU-STARLAB/DeepNSM.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 45 references that are in the map. First posted on arXiv 17 May 2025.

Builds on

11 of 45 references.

References · 11

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  5. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  6. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  7. 2024MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notescited by 80
  8. 2023A Survey on Contextualised Semantic Shift Detectioncited by 22
  9. 2024Low-Resource Machine Translation through Retrieval-Augmented LLM Prompting: A Study on the Mambai Languagecited by 12
  10. 2025Is Small Language Model the Silver Bullet to Low-Resource Languages Machine Translation?cited by 5
  11. 2025LUSIFER: Language Universal Space Integration for Enhanced Multilingual Embeddings with Large Language Modelscited by 1

Built on by

Not cited yet.