mlsanityData to 7 Oct 2026

Enhancing Complex Formula Recognition with Hierarchical Detail-Focused Network

arXiv 2409.11677 ↗First posted 18 Sep 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Hierarchical and complex Mathematical Expression Recognition (MER) is challenging due to multiple possible interpretations of a formula, complicating both parsing and evaluation. In this paper, we introduce the Hierarchical Detail-Focused Recognition dataset (HDR), the first dataset specifically designed to address these issues. It consists of a large-scale training set, HDR-100M, offering an unprecedented scale and diversity with one hundred million training instances. And the test set, HDR-Test, includes multiple interpretations of complex hierarchical formulas for comprehensive model performance evaluation. Additionally, the parsing of complex formulas often suffers from errors in fine-grained details. To address this, we propose the Hierarchical Detail-Focused Recognition Network (HDNet), an innovative framework that incorporates a hierarchical sub-formula module, focusing on the precise handling of formula details, thereby significantly enhancing MER performance. Experimental results demonstrate that HDNet outperforms existing MER models across various datasets.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 18 Sep 2024.

Builds on

10 of 21 references.

References · 10

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
  4. 2023Vary: Scaling up the Vision Vocabulary for Large Vision-Language Modelscited by 84
  5. 2016Image-to-Markup Generation with Coarse-to-Fine Attentioncited by 79
  6. 2024UniMERNet: A Universal Network for Real-World Mathematical Expression Recognitioncited by 41
  7. 2022When Counting Meets HMER: Counting-Aware Network for Handwritten Mathematical Expression Recognitioncited by 35
  8. 2020Improving Attention-Based Handwritten Mathematical Expression Recognition with Scale Augmentation and Drop Attentioncited by 22
  9. 2021Handwritten Mathematical Expression Recognition via Attention Aggregation based Bi-directional Mutual Learningcited by 20
  10. 2019Pattern Generation Strategies for Improving Recognition of Handwritten Mathematical Expressionscited by 13

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.