mlsanityData to 14 Oct 2026

DEEPAG'E: Answering Questions in Portuguese about the Brazilian Environment

arXiv 2110.10015 ↗First posted 19 Oct 2021cs.CL cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

The challenge of climate change and biome conservation is one of the most pressing issues of our time - particularly in Brazil, where key environmental reserves are located. Given the availability of large textual databases on ecological themes, it is natural to resort to question answering (QA) systems to increase social awareness and understanding about these topics. In this work, we introduce multiple QA systems that combine in novel ways the BM25 algorithm, a sparse retrieval technique, with PTT5, a pre-trained state-of-the-art language model. Our QA systems focus on the Portuguese language, thus offering resources not found elsewhere in the literature. As training data, we collected questions from open-domain datasets, as well as content from the Portuguese Wikipedia and news from the press. We thus contribute with innovative architectures and novel applications, attaining an F1-score of 36.2 with our best model.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 19 Oct 2021.

Builds on

12 of 22 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  5. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  6. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
  7. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
  8. 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 196
  9. 2018Neural Approaches to Conversational AIcited by 165
  10. 2020PTT5: Pretraining and validating the T5 model on Brazilian Portuguese datacited by 35
  11. 2020ClimaText: A Dataset for Climate Change Topic Detectioncited by 22
  12. 2020Analyzing Sustainability Reports Using Natural Language Processingcited by 18

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 1; 2024: 1.

5 papers.