DEEPAG'E: Answering Questions in Portuguese about the Brazilian Environment
Not on the map. Why?
Abstract (arXiv)
The challenge of climate change and biome conservation is one of the most pressing issues of our time - particularly in Brazil, where key environmental reserves are located. Given the availability of large textual databases on ecological themes, it is natural to resort to question answering (QA) systems to increase social awareness and understanding about these topics. In this work, we introduce multiple QA systems that combine in novel ways the BM25 algorithm, a sparse retrieval technique, with PTT5, a pre-trained state-of-the-art language model. Our QA systems focus on the Portuguese language, thus offering resources not found elsewhere in the literature. As training data, we collected questions from open-domain datasets, as well as content from the Portuguese Wikipedia and news from the press. We thus contribute with innovative architectures and novel applications, attaining an F1-score of 36.2 with our best model.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 19 Oct 2021.
Builds on
12 of 22 references.
References · 12
- 2017Attention Is All You Needcited by 60,361
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
- 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 196
- 2018Neural Approaches to Conversational AIcited by 165
- 2020PTT5: Pretraining and validating the T5 model on Brazilian Portuguese datacited by 35
- 2020ClimaText: A Dataset for Climate Change Topic Detectioncited by 22
- 2020Analyzing Sustainability Reports Using Natural Language Processingcited by 18
Built on by
Citing papers per year: 2022: 3; 2023: 1; 2024: 1.
5 papers.
- 2022Integrating question answering and text-to-SQL in Portuguesecited by 2
- 2023Benchmarks for Pir'a 2.0, a Reading Comprehension Dataset about the Ocean, the Brazilian Coast, and Climate Changecited by 1
- 2022Tracking environmental policy changes in the Brazilian Federal Official Gazettecited by 0
- 2022The BLue Amazon Brain (BLAB): A Modular Architecture of Services about the Brazilian Maritime Territorycited by 0
- 2024Question Answering with Texts and Tables through Deep Reinforcement Learningcited by 0
- 2024Question Answering with Texts and Tables through Deep Reinforcement Learning5 Jul 2024
- 2023Benchmarks for Pir'a 2.0, a Reading Comprehension Dataset about the Ocean, the Brazilian Coast, and Climate Change19 Sep 2023
- 2022The BLue Amazon Brain (BLAB): A Modular Architecture of Services about the Brazilian Maritime Territory6 Sep 2022
- 2022Tracking environmental policy changes in the Brazilian Federal Official Gazette11 Feb 2022
- 2022Integrating question answering and text-to-SQL in Portuguese8 Feb 2022