NumNet: Machine Reading Comprehension with Numerical Reasoning
Not on the map. Why?
Abstract (arXiv)
Numerical reasoning, such as addition, subtraction, sorting and counting is a critical skill in human's reading comprehension, which has not been well considered in existing machine reading comprehension (MRC) systems. To address this issue, we propose a numerical MRC model named as NumNet, which utilizes a numerically-aware graph neural network to consider the comparing information and performs numerical reasoning over numbers in the question and passage. Our system achieves an EM-score of 64.56% on the DROP dataset, outperforming all existing machine reading comprehension models by considering the numerical relations among numbers.
Key facts. Cited by 59 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 24; 2023: 6; 2024: 5; 2025: 2; 2026: 3.
59 papers.
Sort:
By area:
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 205
- 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 140
- 2021Investigating the Limitations of Transformers with Simple Arithmetic Taskscited by 139
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
- 2022NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Taskscited by 112
- 2021Representing Numbers in NLP: a Survey and a Visioncited by 83
- 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
- 2022Don't Blame the Annotator: Bias Already Starts in the Annotation Instructionscited by 47
- 2022Reasoning Like Program Executorscited by 45
38 more
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financecited by 45
- 2021Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skillscited by 39
- 2021DAGN: Discourse-Aware Graph Network for Logical Reasoningcited by 28
- 2024TAT-LLM: A Specialized Language Model for Discrete Reasoning over Tabular and Textual Datacited by 19
- 2021Rethinking Search: Making Domain Experts out of Dilettantescited by 18
- 2023Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning modelscited by 18
- 2024Path-Consistency with Prefix Enhancement for Efficient Inference in LLMscited by 17
- 2021Teaching Autoregressive Language Models Complex Tasks By Demonstrationcited by 15
- 2021NOAHQA: Numerical Reasoning with Interpretable Graph Question Answering Datasetcited by 14
- 2022ELASTIC: Numerical Reasoning with Adaptive Symbolic Compilercited by 14
- 2022UniRPG: Unified Discrete Reasoning over Table and Text as Program Generationcited by 13
- 2021Towards Tractable Mathematical Reasoning: Challenges, Strategies, and Opportunities for Solving Math Word Problemscited by 12
- 2021NT5?! Training T5 to Perform Numerical Reasoningcited by 11
- 2021Weakly Supervised Neuro-Symbolic Module Networks for Numerical Reasoningcited by 10
- 2021Mitigating False-Negative Contexts in Multi-document Question Answering with Retrieval Marginalizationcited by 10
- 2021Numerical reasoning in machine reading comprehension tasks: are we there yet?cited by 9
- 2022A Neural-Symbolic Approach to Natural Language Understandingcited by 8
- 2022APOLLO: An Optimized Training Approach for Long-form Numerical Reasoningcited by 8
- 2022OPERA:Operation-Pivoted Discrete Reasoning over Textcited by 7
- 2022Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systemscited by 7
- 2022Complex Reading Comprehension Through Question Decompositioncited by 7
- 2022Generalizing Math Word Problem Solvers via Solution Diversificationcited by 7
- 2021REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-trainingcited by 6
- 2022Towards Robust Numerical Question Answering: Diagnosing Numerical Capabilities of NLP Systemscited by 6
- 2021Masked Measurement Prediction: Learning to Jointly Predict Quantities and Units from Textual Contextcited by 5
- 2023Doc2SoarGraph: Discrete Reasoning over Visually-Rich Table-Text Documents via Semantic-Oriented Hierarchical Graphscited by 5
- 2024How to Leverage Digit Embeddings to Represent Numbers?cited by 5
- 2022NAPG: Non-Autoregressive Program Generation for Hybrid Tabular-Textual Question Answeringcited by 4
- 2024XRAG: eXamining the Core -- Benchmarking Foundational Components in Advanced Retrieval-Augmented Generationcited by 3
- 2026Inclusion-of-Thoughts: Mitigating Preference Instability via Purifying the Decision Spacecited by 3
- 2021EviDR: Evidence-Emphasized Discrete Reasoning for Reasoning Machine Reading Comprehensioncited by 2
- 2021Improving Numerical Reasoning Skills in the Modular Approach for Complex Question Answering on Textcited by 2
- 2022Unsupervised Numerical Reasoning to Extract Phenotypes from Clinical Text by Leveraging External Knowledgecited by 2
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoningcited by 2
- 2021Discrete Reasoning Templates for Natural Language Understandingcited by 1
- 2022Towards Differential Relational Privacy and its use in Question Answeringcited by 1
- 2022Teaching Neural Module Networks to Do Arithmeticcited by 1
- 2022How Well Do Multi-hop Reading Comprehension Models Understand Date Information?cited by 1
50 most cited of 59 All 59 (JSON)
- 2026Generalizing Numerical Reasoning in Table Data through Operation Sketches and Self-Supervised Learning23 Apr 2026
- 2026Inclusion-of-Thoughts: Mitigating Preference Instability via Purifying the Decision Space15 Mar 2026
- 2026CONE: Embeddings for Complex Numerical Data Preserving Unit and Variable Semantics5 Mar 2026
- 2025PanelTR: Zero-Shot Table Reasoning Framework Through Multi-Agent Scientific Discussion8 Aug 2025
- 2025Chaining Event Spans for Temporal Relation Grounding17 Jun 2025
- 2024XRAG: eXamining the Core -- Benchmarking Foundational Components in Advanced Retrieval-Augmented Generation20 Dec 2024
- 2024Path-Consistency with Prefix Enhancement for Efficient Inference in LLMs25 Aug 2024
- 2024Numbers Matter! Bringing Quantity-awareness to Retrieval Systems14 Jul 2024
- 2024How to Leverage Digit Embeddings to Represent Numbers?1 Jul 2024
- 2024TAT-LLM: A Specialized Language Model for Discrete Reasoning over Tabular and Textual Data24 Jan 2024
- 2023Around the GLOBE: Numerical Aggregation Question-Answering on Heterogeneous Genealogical Knowledge Graphs with Deep Neural Networks30 Jul 2023
- 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory6 Jun 2023
38 more
- 2023Comprehensive Solution Program Centric Pretraining for Table-and-Text Hybrid Numerical Reasoning12 May 2023
- 2023Doc2SoarGraph: Discrete Reasoning over Visually-Rich Table-Text Documents via Semantic-Oriented Hierarchical Graphs3 May 2023
- 2023REFINER: Reasoning Feedback on Intermediate Representations4 Apr 2023
- 2023Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning models14 Mar 2023
- 2022APOLLO: An Optimized Training Approach for Long-form Numerical Reasoning14 Dec 2022
- 2022Generalizing Math Word Problem Solvers via Solution Diversification1 Dec 2022
- 2022Towards Robust Numerical Question Answering: Diagnosing Numerical Capabilities of NLP Systems14 Nov 2022
- 2022NAPG: Non-Autoregressive Program Generation for Hybrid Tabular-Textual Question Answering7 Nov 2022
- 2022Complex Reading Comprehension Through Question Decomposition7 Nov 2022
- 2022ELASTIC: Numerical Reasoning with Adaptive Symbolic Compiler18 Oct 2022
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Finance17 Oct 2022
- 2022UniRPG: Unified Discrete Reasoning over Table and Text as Program Generation15 Oct 2022
- 2022How Well Do Multi-hop Reading Comprehension Models Understand Date Information?11 Oct 2022
- 2022Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems11 Oct 2022
- 2022Teaching Neural Module Networks to Do Arithmetic6 Oct 2022
- 2022Towards Complex Document Understanding By Discrete Reasoning25 Jul 2022
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoning4 Jul 2022
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Data3 Jun 2022
- 2022MMTM: Multi-Tasking Multi-Decoder Transformer for Math Word Problems2 Jun 2022
- 2022Don't Blame the Annotator: Bias Already Starts in the Annotation Instructions1 May 2022
- 2022OPERA:Operation-Pivoted Discrete Reasoning over Text29 Apr 2022
- 2022Unsupervised Numerical Reasoning to Extract Phenotypes from Clinical Text by Leveraging External Knowledge19 Apr 2022
- 2022NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks12 Apr 2022
- 2022Towards Differential Relational Privacy and its use in Question Answering30 Mar 2022
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar 2022
- 2022A Neural-Symbolic Approach to Natural Language Understanding20 Mar 2022
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan 2022
- 2022Reasoning Like Program Executors27 Jan 2022
- 2021Masked Measurement Prediction: Learning to Jointly Predict Quantities and Units from Textual Context16 Dec 2021
- 2021Towards Tractable Mathematical Reasoning: Challenges, Strategies, and Opportunities for Solving Math Word Problems29 Oct 2021
- 2021Tracing Origins: Coreference-aware Machine Reading Comprehension15 Oct 2021
- 2021NOAHQA: Numerical Reasoning with Interpretable Graph Question Answering Dataset22 Sep 2021
- 2021Numerical reasoning in machine reading comprehension tasks: are we there yet?16 Sep 2021
- 2021Improving Numerical Reasoning Skills in the Modular Approach for Complex Question Answering on Text6 Sep 2021
- 2021Teaching Autoregressive Language Models Complex Tasks By Demonstration5 Sep 2021
- 2021EviDR: Evidence-Emphasized Discrete Reasoning for Reasoning Machine Reading Comprehension18 Aug 2021
- 2021Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills15 Jul 2021
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Finance17 May 2021
50 newest of 59 All 59 (JSON)
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 205
- 2022NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Taskscited by 112
- 2022Reasoning Like Program Executorscited by 45
- 2024TAT-LLM: A Specialized Language Model for Discrete Reasoning over Tabular and Textual Datacited by 19
- 2023Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning modelscited by 18
- 2024Path-Consistency with Prefix Enhancement for Efficient Inference in LLMscited by 17
- 2022ELASTIC: Numerical Reasoning with Adaptive Symbolic Compilercited by 14
- 2022A Neural-Symbolic Approach to Natural Language Understandingcited by 8
- 2022Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systemscited by 7
- 2026Inclusion-of-Thoughts: Mitigating Preference Instability via Purifying the Decision Spacecited by 3
12 most cited of 16 All 16 (JSON)
- 2026Inclusion-of-Thoughts: Mitigating Preference Instability via Purifying the Decision Space15 Mar 2026
- 2025PanelTR: Zero-Shot Table Reasoning Framework Through Multi-Agent Scientific Discussion8 Aug 2025
- 2024Path-Consistency with Prefix Enhancement for Efficient Inference in LLMs25 Aug 2024
- 2024TAT-LLM: A Specialized Language Model for Discrete Reasoning over Tabular and Textual Data24 Jan 2024
- 2023REFINER: Reasoning Feedback on Intermediate Representations4 Apr 2023
- 2023Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning models14 Mar 2023
- 2022ELASTIC: Numerical Reasoning with Adaptive Symbolic Compiler18 Oct 2022
- 2022How Well Do Multi-hop Reading Comprehension Models Understand Date Information?11 Oct 2022
- 2022Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems11 Oct 2022
- 2022Teaching Neural Module Networks to Do Arithmetic6 Oct 2022
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoning4 Jul 2022
- 2022NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks12 Apr 2022
12 newest of 16 All 16 (JSON)
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 140
- 2021Investigating the Limitations of Transformers with Simple Arithmetic Taskscited by 139
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
- 2021Representing Numbers in NLP: a Survey and a Visioncited by 83
- 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
- 2022Don't Blame the Annotator: Bias Already Starts in the Annotation Instructionscited by 47
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financecited by 45
- 2021Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skillscited by 39
- 2021DAGN: Discourse-Aware Graph Network for Logical Reasoningcited by 28
- 2021Rethinking Search: Making Domain Experts out of Dilettantescited by 18
- 2021Teaching Autoregressive Language Models Complex Tasks By Demonstrationcited by 15
12 most cited of 42 All 42 (JSON)
- 2026Generalizing Numerical Reasoning in Table Data through Operation Sketches and Self-Supervised Learning23 Apr 2026
- 2026CONE: Embeddings for Complex Numerical Data Preserving Unit and Variable Semantics5 Mar 2026
- 2025Chaining Event Spans for Temporal Relation Grounding17 Jun 2025
- 2024Numbers Matter! Bringing Quantity-awareness to Retrieval Systems14 Jul 2024
- 2024How to Leverage Digit Embeddings to Represent Numbers?1 Jul 2024
- 2023Around the GLOBE: Numerical Aggregation Question-Answering on Heterogeneous Genealogical Knowledge Graphs with Deep Neural Networks30 Jul 2023
- 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory6 Jun 2023
- 2023Comprehensive Solution Program Centric Pretraining for Table-and-Text Hybrid Numerical Reasoning12 May 2023
- 2023Doc2SoarGraph: Discrete Reasoning over Visually-Rich Table-Text Documents via Semantic-Oriented Hierarchical Graphs3 May 2023
- 2022APOLLO: An Optimized Training Approach for Long-form Numerical Reasoning14 Dec 2022
- 2022Generalizing Math Word Problem Solvers via Solution Diversification1 Dec 2022
- 2022Towards Robust Numerical Question Answering: Diagnosing Numerical Capabilities of NLP Systems14 Nov 2022
12 newest of 42 All 42 (JSON)