mlsanityData to 14 Oct 2026

A Survey on Semantic Processing Techniques

arXiv 2310.18345 ↗First posted 22 Oct 2023cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Semantic processing is a fundamental research domain in computational linguistics. In the era of powerful pre-trained language models and large language models, the advancement of research in this domain appears to be decelerating. However, the study of semantics is multi-dimensional in linguistics. The research depth and breadth of computational semantic processing can be largely improved with new technologies. In this survey, we analyzed five semantic processing tasks, e.g., word sense disambiguation, anaphora resolution, named entity recognition, concept extraction, and subjectivity detection. We study relevant theoretical research in these fields, advanced methods, and downstream applications. We connect the surveyed tasks with downstream applications because this may inspire future scholars to fuse these low-level semantic processing tasks with high-level natural language processing tasks. The review of theoretical research may also inspire new tasks and technologies in the semantic processing domain. Finally, we compare the different semantic processing techniques and summarize their technical trends, application trends, and future directions.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 74 of its 449 references that are in the map. First posted on arXiv 22 Oct 2023.

Builds on

74 of 449 references.

References · 74

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  6. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
  7. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  8. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  9. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
  10. 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
  11. 2016Language Modeling with Gated Convolutional Networkscited by 702
  12. 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 669
38 more
  1. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 659
  2. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
  3. 2018Hypergraph Neural Networkscited by 488
  4. 2019How to Fine-Tune BERT for Text Classification?cited by 411
  5. 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 299
  6. 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
  7. 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 231
  8. 2019WinoGrande: An Adversarial Winograd Schema Challenge at Scalecited by 204
  9. 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
  10. 2020TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialoguecited by 185
  11. 2021Template-Based Named Entity Recognition Using BARTcited by 153
  12. 2021A Unified Generative Framework for Various NER Subtaskscited by 141
  13. 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
  14. 2020Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusioncited by 122
  15. 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
  16. 2016Modeling Coverage for Neural Machine Translationcited by 110
  17. 2019Automatically Neutralizing Subjective Bias in Textcited by 105
  18. 2017Deep Keyphrase Generationcited by 102
  19. 2017Joint Extraction of Entities and Relations Based on a Novel Tagging Schemecited by 102
  20. 2019Coreference Resolution as Query-based Span Predictioncited by 91
  21. 2020Coreferential Reasoning Learning for Language Representationcited by 80
  22. 2020GRADE: Automatic Graph-Enhanced Coherence Metric for Evaluating Open-Domain Dialogue Systemscited by 76
  23. 2021Template-free Prompt Tuning for Few-shot NERcited by 73
  24. 2018Few-shot classification in Named Entity Recognition Taskcited by 64
  25. 2020Moving Down the Long Tail of Word Sense Disambiguation with Gloss-Informed Biencoderscited by 61
  26. 2018Joint entity recognition and relation extraction as a multi-head selection problemcited by 59
  27. 2018Keyphrase Generation with Correlation Constraintscited by 45
  28. 2021Coreference Resolution without Span Representationscited by 45
  29. 2021A Partition Filter Network for Joint Entity and Relation Extractioncited by 42
  30. 2019Joint Extraction of Entities and Relations Based on a Novel Decomposition Strategycited by 41
  31. 2018Semi-Supervised Learning for Neural Keyphrase Generationcited by 36
  32. 2018Title-Guided Encoding for Keyphrase Generationcited by 36
  33. 2019Nested Named Entity Recognition via Second-best Sequence Learning and Decodingcited by 34
  34. 2018Neural Segmental Hypergraphs for Overlapping Mention Recognitioncited by 32
  35. 2018Anaphora and Coreference Resolution: A Reviewcited by 31
  36. 2019Label-Agnostic Sequence Labeling by Copying Nearest Neighborscited by 27
  37. 2021Bottom-Up Constituency Parsing and Nested Named Entity Recognition with Pointer Networkscited by 21
  38. 2016Learning Global Features for Coreference Resolutioncited by 20

50 most cited of 74 All 74 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 1; 2026: 1.

4 papers.

  1. 2024AI Hallucinations: A Misnomer Worth Clarifyingcited by 34
  2. 2024Explainable Natural Language Processing for Corporate Sustainability Analysiscited by 9
  3. 2025Bridging Minds and Machines: Toward an Integration of AI and Cognitive Sciencecited by 2
  4. 2026How Much Do LLMs Know About Chinese Zero Pronouns?cited by 0