mlsanityData to 7 Oct 2026

NUBIA: NeUral Based Interchangeability Assessor for Text Generation

arXiv 2004.14667 ↗First posted 30 Apr 2020cs.CL cs.LGcited by 34

Not on the map. Why?

Abstract (arXiv)

We present NUBIA, a methodology to build automatic evaluation metrics for text generation using only machine learning models as core components. A typical NUBIA model is composed of three modules: a neural feature extractor, an aggregator and a calibrator. We demonstrate an implementation of NUBIA which outperforms metrics currently used to evaluate machine translation, summaries and slightly exceeds/matches state of the art metrics on correlation with human judgement on the WMT segment-level Direct Assessment task, sentence-level ranking and image captioning evaluation. The model implemented is modular, explainable and set to continuously improve over time.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 5; 2022: 7; 2023: 9; 2024: 11; 2025: 2.

34 papers.

Sort:

By area:

  1. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  2. 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
  3. 2023Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization)cited by 72
  4. 2023RCAgent: Cloud Root Cause Analysis by Autonomous Agents with Tool-Augmented Large Language Modelscited by 62
  5. 2023CLAIR: Evaluating Image Captions with Large Language Modelscited by 43
  6. 2023See, Say, and Segment: Teaching LMMs to Overcome False Premisescited by 40
  7. 2023Recommending Root-Cause and Mitigation Steps for Cloud Incidents using Large Language Modelscited by 38
  8. 2022Mutual Information Divergence: A Unified Metric for Multimodal Generative Modelscited by 35
  9. 2024AutoAD III: The Prequel -- Back to the Pixelscited by 35
  10. 2024Automated Root Causing of Cloud Incidents using In-Context Learning with GPT-4cited by 28
  11. 2022RuCoLA: Russian Corpus of Linguistic Acceptabilitycited by 26
  12. 2022Chain of Explanation: New Prompting Method to Generate Higher Quality Natural Language Explanation for Implicit Hate Speechcited by 25
22 more
  1. 2024A Survey on Large Language Models for Communication, Network, and Service Management: Application Insights, Challenges, and Future Directionscited by 25
  2. 2024Neptune: The Long Orbit to Benchmarking Long Video Understandingcited by 24
  3. 2021FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metricsfor Automatic Text Generationcited by 19
  4. 2024X-lifecycle Learning for Cloud Incident Management using LLMscited by 19
  5. 2024Automatic Metrics in Natural Language Generation: A Survey of Current Evaluation Practicescited by 19
  6. 2021SMURF: SeMantic and linguistic UndeRstanding Fusion for Caption Evaluation via Typicality Analysiscited by 18
  7. 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
  8. 2023Test-Time Distribution Normalization for Contrastively Learned Vision-language Modelscited by 14
  9. 2024Image2Text2Image: A Novel Framework for Label-Free Evaluation of Image-to-Text Generation with Text-to-Image Diffusion Modelscited by 10
  10. 2022Better Quality Estimation for Low Resource Corpus Miningcited by 8
  11. 2021BEAMetrics: A Benchmark for Language Generation Evaluation Evaluationcited by 6
  12. 2022Mind the Labels: Describing Relations in Knowledge Graphs With Pretrained Modelscited by 6
  13. 2023Tackling Hallucinations in Neural Chart Summarizationcited by 6
  14. 2024Evaluation of Large Language Models for Summarization Tasks in the Medical Domain: A Narrative Reviewcited by 3
  15. 2022Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Codecited by 2
  16. 2023Towards Explainable and Safe Conversational Agents for Mental Health: A Surveycited by 2
  17. 2023ASPIRO: Any-shot Structured Parsing-error-Induced ReprOmpting for Consistent Data-to-Text Generationcited by 2
  18. 2025LLMPi: Optimizing LLMs for High-Throughput on Raspberry Picited by 2
  19. 2025From Guessing to Asking: An Approach to Resolving the Persona Knowledge Gap in LLMs during Multi-Turn Conversationscited by 1
  20. 2021Semantic-Based Self-Critical Training For Question Generationcited by 0
  21. 2024Cross-lingual paraphrase identificationcited by 0
  22. 2024Surveying the Landscape of Image Captioning Evaluation: A Comprehensive Taxonomy, Trends and Metrics Analysiscited by 0