Semantic Mastery: Enhancing LLMs with Advanced Natural Language Understanding
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have greatly improved their capability in performing NLP tasks. However, deeper semantic understanding, contextual coherence, and more subtle reasoning are still difficult to obtain. The paper discusses state-of-the-art methodologies that advance LLMs with more advanced NLU techniques, such as semantic parsing, knowledge integration, and contextual reinforcement learning. We analyze the use of structured knowledge graphs, retrieval-augmented generation (RAG), and fine-tuning strategies that match models with human-level understanding. Furthermore, we address the incorporation of transformer-based architectures, contrastive learning, and hybrid symbolic-neural methods that address problems like hallucinations, ambiguity, and inconsistency in the factual perspectives involved in performing complex NLP tasks, such as question-answering text summarization and dialogue generation. Our findings show the importance of semantic precision for enhancing AI-driven language systems and suggest future research directions to bridge the gap between statistical language models and true natural language understanding.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 19 of its 50 references that are in the map. First posted on arXiv 1 Apr 2025.
Builds on
19 of 50 references.
References · 19
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
- 2023Enabling Large Language Models to Generate Text with Citationscited by 595
- 2022DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scalecited by 407
- 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 221
- 2023Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasonerscited by 63
- 2023Effective Large Language Model Adaptation for Improved Grounding and Citation Generationcited by 45
- 2024Citation-Enhanced Generation for LLM-based Chatbotscited by 25
- 2018Semantically Enhanced Software Traceability Using Deep Learning Techniquescited by 22
- 2023Language Models As Semantic Indexerscited by 20
7 more
- 2023CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Taskscited by 18
- 2024Evaluating the Ability of LLMs to Solve Semantics-Aware Process Mining Taskscited by 14
- 2025Enhancing Semantic Consistency of Large Language Models through Model Editing: An Interpretability-Oriented Approachcited by 14
- 2024Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRLcited by 10
- 2022Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question Answeringcited by 6
- 2024LLMs' Understanding of Natural Language Revealedcited by 6
- 2024Enhancing Text Generation in Joint NLG/NLU Learning Through Curriculum Learning, Semi-Supervised Training, and Advanced Optimization Techniquescited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2025Video-STR: Reinforcing MLLMs in Video Spatio-Temporal Reasoning with Relation Graphcited by 6
- 2025Agentic RAG for Software Testing with Hybrid Vector-Graph and Multi-Agent Orchestrationcited by 2
- 2026Comparing Developer and LLM Biases in Code Evaluationcited by 1
- 2026Comparing Developer and LLM Biases in Code Evaluation25 Mar 2026
- 2025Video-STR: Reinforcing MLLMs in Video Spatio-Temporal Reasoning with Relation Graph13 Oct 2025
- 2025Agentic RAG for Software Testing with Hybrid Vector-Graph and Multi-Agent Orchestration12 Oct 2025
- 2025A Survey of Context Engineering for Large Language Models17 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning Beyond Limits: Advances and Open Problems for LLMs
- 2025Advancing Reasoning in Large Language Models: Promising Methods and Approaches
- 2025Improving Natural Language Understanding for LLMs via Large-Scale Instruction Synthesis
- 2023Large Language Models Are Not Strong Abstract Reasoners
- 2025A Survey on Large Language Models with some Insights on their Capabilities and Limitations
- 2025LLM Inference Enhanced by External Knowledge: A Survey
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Models
- 2026Semantic Abstraction for Natural Language Inference: a Methodological Framework for Discovering and Compensating Semantic Knowledge and Reasoning Gaps in Large Language Models