Geo-Encoder: A Chunk-Argument Bi-Encoder Framework for Chinese Geographic Re-Ranking
Not on the map. Why?
Abstract (arXiv)
Chinese geographic re-ranking task aims to find the most relevant addresses among retrieved candidates, which is crucial for location-related services such as navigation maps. Unlike the general sentences, geographic contexts are closely intertwined with geographical concepts, from general spans (e.g., province) to specific spans (e.g., road). Given this feature, we propose an innovative framework, namely Geo-Encoder, to more effectively integrate Chinese geographical semantics into re-ranking pipelines. Our methodology begins by employing off-the-shelf tools to associate text with geographical spans, treating them as chunking units. Then, we present a multi-task learning module to simultaneously acquire an effective attention matrix that determines chunk contributions to extra semantic representations. Furthermore, we put forth an asynchronous update mechanism for the proposed addition task, aiming to guide the model capable of effectively focusing on specific chunks. Experiments on two distinct Chinese geographic re-ranking datasets, show that the Geo-Encoder achieves significant improvements when compared to state-of-the-art baselines. Notably, it leads to a substantial improvement in the Hit@1 score of MGEO-BERT, increasing it by 6.22% from 62.76 to 68.98 on the GeoTES dataset.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 55 references that are in the map. First posted on arXiv 4 Sep 2023.
Builds on
21 of 55 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 445
- 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 413
- 2020Pretrained Transformers for Text Ranking: BERT and Beyondcited by 267
- 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 260
- 2016Enhanced LSTM for Natural Language Inferencecited by 200
- 2018Constituency Parsing with a Self-Attentive Encodercited by 199
- 2019Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoringcited by 165
9 more
- 2016Fully-adaptive Feature Sharing in Multi-Task Networks with Applications in Person Attribute Classificationcited by 93
- 2016A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Taskscited by 62
- 2017A Minimal Span-Based Neural Constituency Parsercited by 59
- 2020Efficient Document Re-Ranking for Transformers by Precomputing Term Representationscited by 44
- 2022ERNIE-GeoL: A Geography-and-Language Pre-trained Model and its Applications in Baidu Mapscited by 25
- 2021Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Taskscited by 22
- 2020DC-BERT: Decoupling Question and Document for Efficient Contextual Encodingcited by 20
- 2022Geographic Adaptation of Pretrained Language Modelscited by 14
- 2022Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learningcited by 5
Built on by
Citing papers per year: 2024: 1.
1 paper.