mlsanityData to 14 Oct 2026

Dripper: Token-Efficient Main HTML Extraction with a Lightweight LM

arXiv 2511.23119 ↗First posted 28 Nov 2025cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

High-quality main content extraction from web pages is a critical prerequisite for constructing large-scale training corpora. While traditional heuristic extractors are efficient, they lack the semantic reasoning required to handle the structural heterogeneity of the modern web. Conversely, well-pretrained generative Large Language Models (LLMs) offer superior document comprehension but are prohibited by excessive computational costs, limited context windows, and hallucination risks when applied at web scale. We present Dripper, a lightweight framework that resolves these bottlenecks through four contributions: (1) We reformulate extraction as a constrained sequence labeling task using SLMs (Small Language Models). This paradigm eliminates generative hallucinations and achieves exceptional efficiency, reaching a throughput of 3.08 pages per second on a single A100 GPU. (2) We construct WebMainBench, a rigorous benchmark of 7,809 human-annotated pages covering 5,434 unique domains and multiple languages. Evaluations show our Dripper-0.6B model outperforms heuristics like Trafilatura and rivals massive models like DeepSeek-V3.2(685B), GPT-5 and Gemini-2.5-Pro, offering an optimal efficiency-accuracy trade-off. (3) We demonstrate infrastructural value by pre-training a 1B model on a Dripper-curated corpus (63B tokens). This model significantly outperforms baselines in downstream tasks, proving the critical role of extraction quality and the effectiveness of our framework. (4) We open-source the Dripper-0.6B weights and codebase to facilitate the construction of high-quality datasets.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 21 of its 48 references that are in the map. First posted on arXiv 28 Nov 2025.

Builds on

21 of 48 references.

References · 21

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  4. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  5. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  6. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
  7. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
  8. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  9. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  10. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  11. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
  12. 2016The LAMBADA dataset: Word prediction requiring a broad discourse contextcited by 992
9 more
  1. 2017Crowdsourcing Multiple Choice Science Questionscited by 765
  2. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
  3. 2018CoQA: A Conversational Question Answering Challengecited by 683
  4. 2025Organize the Web: Constructing Domains Enhances Pre-Training Data Curationcited by 76
  5. 2022WebFormer: The Web-page Transformer for Structure Information Extractioncited by 34
  6. 2021Simplified DOM Trees for Transferable Attribute Extraction from the Webcited by 16
  7. 2025ReaderLM-v2: Small Language Model for HTML to Markdown and JSONcited by 15
  8. 2020Boilerplate Removal using a Neural Sequence Labeling Modelcited by 11
  9. 2018Web2Text: Deep Structured Boilerplate Removalcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.