mlsanityData to 14 Oct 2026

More Reader Data or a Better Teacher? Updating a Model of Crowd Highlights in Late 2026

arXiv 2610.17768 ↗First posted 13 Oct 2026cs.IR cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

A model trained on readers' highlights can show a newcomer where earlier readers converged on a page, even on pages with few readers. A year of stronger language models suggests two upgrades: use them directly, or use them as teachers. We compare both with a third, more reader data, on one social highlighting platform, with the comparisons, the selection rules and a sealed set of fresh pages fixed in advance. On 215 development pages, seven language models released by October 2026 rank sentences zero-shot at an average precision of at most 0.3744 against the sentences half the readers marked most, and 0.3931 when fused with reading position, while a 3-billion-parameter model trained on reader highlights alone reaches 0.4346. Used as the teacher that breaks ties among readers' counts, the stronger fusion changes a trained model by +0.0013 [-0.0012, +0.0040], whereas going from half to all of its training pages adds +0.0242 [+0.0179, +0.0301]. A 27-billion-parameter backbone on the reader-only recipe adds +0.0225 on the development pages; on 131 fresh pages, read once and too few for a confirmatory comparison, its difference from the 3-billion model is unresolved, both score above the fusion, and in an exploratory split their lead over the previous model sits on pages from domains that their fresh training pages also cover. In this recipe, more reader data improves a trained model where a stronger tie-breaking teacher yields no material gain, and frontier models used as rankers still trail a small model trained on readers.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 12 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

8 of 12 references.

References · 8

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  3. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
  4. 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 360
  5. 2026The Long Tail, Not the Front Page: Cold-Start Prediction of Crowd Highlight Saliencecited by 3
  6. 2026Measuring Alignment With Reader Highlights Net of Position and Lengthcited by 2
  7. 2026Language Models Agree With Each Other, Not With Readerscited by 2
  8. 2026Floor, Ceiling, and the Fusion Gap: How Much of Crowd Reading Attention Can Machines Predict?cited by 1

Built on by

Not cited yet.