EviMap: Evidence-Grounded Hierarchical Topic Maps for Exploring Unlabeled Corpora
Not on the map. Why?
Abstract (arXiv)
Research teams and organizations often explore unfamiliar free-text collections, from survey comments and reviews to reports and domain documents, before labels, queries or coding schemes exist. At this stage, the first thematic map shapes what users notice, prioritize and carry into downstream analysis, so it should be trusted only insofar as it can be verified. Existing options force a trade-off between scale and verifiability. Qualitative coding preserves evidence but is slow. Search presupposes a query. Clustering and topic models scale but produce labels users must interpret. One-shot large language model (LLM) summaries are fluent yet difficult to reproduce or audit. We present EviMap, an interactive system providing researchers and practitioners with an auditable thematic overview of such corpora. Guided by model-generated context describing the corpus and hypothesized stakeholder concerns, EviMap extracts within-document evidence phrases and organizes them, rather than whole documents, into a three-level map of aspects, groups and fine-grained topics. Embedding-based clustering narrows the search space for finer semantic judgments by the LLM. Each node traces back to supporting phrase spans, so documents link to topics through evidence they contain and users can audit labels against the original text. Users can start from a top-level corpus map, drill into topics, inspect highlighted evidence in original documents, and combine two topics to find documents discussing both. We demonstrate this workflow across six heterogeneous corpora spanning 2,108 to 101,699 documents, with a comparison against flat and hierarchical LLM baselines. By grounding every label in verbatim source spans, EviMap makes a topic map not just readable, but verifiable. Code, demo video, and interactive dashboard are available at https://github.com/zhiyintan/EviMap.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 40 references that are in the map. First posted on arXiv 6 Sep 2026.
Builds on
15 of 40 references.
References · 15
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
- 2023Enabling Large Language Models to Generate Text with Citationscited by 595
- 2021Measuring Attribution in Natural Language Generation Modelscited by 256
- 2019Topic Modeling in Embedding Spacescited by 224
- 2023Supporting Qualitative Analysis with Large Language Models: Combining Codebook with GPT-3 for Deductive Codingcited by 82
- 2024Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooMcited by 78
- 2021Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherencecited by 74
- 2023LLM-in-the-loop: Leveraging Large Language Model for Thematic Analysiscited by 70
- 2023Goal-Driven Explainable Clustering via Language Descriptionscited by 58
- 2024Attribute First, then Generate: Locally-attributable Grounded Text Generationcited by 54
3 more
- 2024Chain-of-Layer: Iteratively Prompting Large Language Models for Taxonomy Induction from Limited Examplescited by 24
- 2024Llama meets EU: Investigating the European Political Spectrum through the Lens of LLMscited by 14
- 2025Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluationcited by 4
Built on by
Not cited yet.