DMRetriever: A Family of Models for Improved Text Retrieval in Disaster Management
Not on the map. Why?
Abstract (arXiv)
Effective and efficient access to relevant information is essential for disaster management. However, no retrieval model is specialized for disaster management, and existing general-domain models fail to handle the varied search intents inherent to disaster management scenarios, resulting in inconsistent and unreliable performance. To this end, we introduce DMRetriever, the first series of dense retrieval models (33M to 7.6B) tailored for this domain. It is trained through a novel three-stage framework of bidirectional attention adaptation, unsupervised contrastive pre-training, and difficulty-aware progressive instruction fine-tuning, using high-quality data generated through an advanced data refinement pipeline. Comprehensive experiments demonstrate that DMRetriever achieves state-of-the-art (SOTA) performance across all six search intents at every model scale. Moreover, DMRetriever is highly parameter-efficient, with 596M model outperforming baselines over 13.3 X larger and 33M model exceeding baselines with only 7.6% of their parameters. All codes, data, and checkpoints are available at https://github.com/KaiYin97/DMRETRIEVER
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 52 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
29 of 52 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2016Pointer Sentinel Mixture Modelscited by 2,992
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
17 more
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 556
- 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 466
- 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 396
- 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 339
- 2019Synthetic QA Corpora Generation with Roundtrip Consistencycited by 143
- 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 92
- 2024NV-Retriever: Improving text embedding models with effective hard-negative miningcited by 83
- 2024Arctic-Embed: Scalable, Efficient, and Accurate Text Embedding Modelscited by 60
- 2014Processing Social Media Messages in Mass Emergency: A Surveycited by 50
- 2024BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrieverscited by 38
- 2024CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informaticscited by 25
- 2025Granite Embedding Modelscited by 7
- 2025DisastIR: A Comprehensive Information Retrieval Benchmark for Disaster Managementcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.