mlsanityData to 7 Oct 2026

VTCC-NLP at NL4Opt competition subtask 1: An Ensemble Pre-trained language models for Named Entity Recognition

arXiv 2212.07219 ↗First posted 14 Dec 2022cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

We propose a combined three pre-trained language models (XLM-R, BART, and DeBERTa-V3) as an empower of contextualized embedding for named entity recognition. Our model achieves a 92.9% F1 score on the test set and ranks 5th on the leaderboard at NL4Opt competition subtask 1.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 13 of its 16 references that are in the map. First posted on arXiv 14 Dec 2022.

Builds on

13 of 16 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2018Deep contextualized word representationscited by 2,285
  6. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  7. 2016Neural Architectures for Named Entity Recognitioncited by 548
  8. 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
  9. 2022Augmenting Operations Research with Auto-Formulation of Optimization Models from Problem Descriptionscited by 54
  10. 2018NCRF++: An Open-source Neural Sequence Labeling Toolkitcited by 29
  11. 2019Dependency-Guided LSTM-CRF for Named Entity Recognitioncited by 28
  12. 2021mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Modelscited by 19
1 more
  1. 2022DAMO-NLP at SemEval-2022 Task 11: A Knowledge-based System for Multilingual Named Entity Recognitioncited by 17

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 2; 2025: 1.

5 papers.

  1. 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
  2. 2025A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solvingcited by 9
  3. 2024Generalists vs. Specialists: Evaluating LLMs on Highly-Constrained Biophysical Sequence Optimization Taskscited by 8
  4. 2024Ax-to-Grind Urdu: Benchmark Dataset for Urdu Fake News Detectioncited by 2
  5. 2023Transformer-based Named Entity Recognition in Construction Supply Chain Risk Management in Australiacited by 0