Dripper: Token-Efficient Main HTML Extraction with a Lightweight LM
Not on the map. Why?
Abstract (arXiv)
High-quality main content extraction from web pages is a critical prerequisite for constructing large-scale training corpora. While traditional heuristic extractors are efficient, they lack the semantic reasoning required to handle the structural heterogeneity of the modern web. Conversely, well-pretrained generative Large Language Models (LLMs) offer superior document comprehension but are prohibited by excessive computational costs, limited context windows, and hallucination risks when applied at web scale. We present Dripper, a lightweight framework that resolves these bottlenecks through four contributions: (1) We reformulate extraction as a constrained sequence labeling task using SLMs (Small Language Models). This paradigm eliminates generative hallucinations and achieves exceptional efficiency, reaching a throughput of 3.08 pages per second on a single A100 GPU. (2) We construct WebMainBench, a rigorous benchmark of 7,809 human-annotated pages covering 5,434 unique domains and multiple languages. Evaluations show our Dripper-0.6B model outperforms heuristics like Trafilatura and rivals massive models like DeepSeek-V3.2(685B), GPT-5 and Gemini-2.5-Pro, offering an optimal efficiency-accuracy trade-off. (3) We demonstrate infrastructural value by pre-training a 1B model on a Dripper-curated corpus (63B tokens). This model significantly outperforms baselines in downstream tasks, proving the critical role of extraction quality and the effectiveness of our framework. (4) We open-source the Dripper-0.6B weights and codebase to facilitate the construction of high-quality datasets.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 21 of its 48 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
21 of 48 references.
References · 21
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
- 2016The LAMBADA dataset: Word prediction requiring a broad discourse contextcited by 992
9 more
- 2017Crowdsourcing Multiple Choice Science Questionscited by 765
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
- 2018CoQA: A Conversational Question Answering Challengecited by 683
- 2025Organize the Web: Constructing Domains Enhances Pre-Training Data Curationcited by 76
- 2022WebFormer: The Web-page Transformer for Structure Information Extractioncited by 34
- 2021Simplified DOM Trees for Transferable Attribute Extraction from the Webcited by 16
- 2025ReaderLM-v2: Small Language Model for HTML to Markdown and JSONcited by 15
- 2020Boilerplate Removal using a Neural Sequence Labeling Modelcited by 11
- 2018Web2Text: Deep Structured Boilerplate Removalcited by 10
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Data Science and Technology Towards AGI Part I: Tiered Data Managementcited by 4
- 2026Region4Web: Rethinking Observation Space Granularity for Web Agentscited by 2
- 2026PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generationcited by 2
- 2026AXE: Low-Cost Cross-Domain Web Structured Information Extractioncited by 1
- 2026WCXB: A Multi-Type Web Content Extraction Benchmarkcited by 1
- 2026The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corporacited by 1
- 2026ScrapeGraphAI-100k: Dataset for Schema-Constrained LLM Generationcited by 0
- 2026ReScraper: Unified Scraping and Cleaning of Web Data for Effective LLM Pretrainingcited by 0
- 2026ReScraper: Unified Scraping and Cleaning of Web Data for Effective LLM Pretraining28 Sep 2026
- 2026The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora10 Aug 2026
- 2026PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation1 Jun 2026
- 2026WCXB: A Multi-Type Web Content Extraction Benchmark20 May 2026
- 2026Region4Web: Rethinking Observation Space Granularity for Web Agents8 May 2026
- 2026ScrapeGraphAI-100k: Dataset for Schema-Constrained LLM Generation16 Feb 2026
- 2026Data Science and Technology Towards AGI Part I: Tiered Data Management9 Feb 2026
- 2026AXE: Low-Cost Cross-Domain Web Structured Information Extraction2 Feb 2026