Selection, Not Salience: The Shape and Limits of Personalization in Social Highlighting
Not on the map. Why?
Abstract (arXiv)
Does personalizing what a reader sees pay off, and where does it stop? Using a social web highlighter and a co-readership identity control (the same document highlighted by many users, which holds document and topic fixed and asks whether a person's own history predicts their marks better than another reader's does), we map the shape and limits of personalization across reading altitudes. At the document altitude we give the clean, leakage-free, identity-controlled measurement that prior next-document evaluations could only upper-bound: a person's history identifies which documents in a co-reading neighborhood are theirs, with an own-versus-other gap of +0.169 against community negatives and +0.119 against topic-matched hard negatives (both highly significant); a content-based arm suggests the signal is not purely title-driven but is largely thematic. This is comparable to the span-level selection signal (+0.14) from our prior work: the selection signal is of comparable magnitude across altitudes (+0.12 to +0.17), most of it stable topic preference. At the sentence altitude, a two-stage personalized auto-highlight (an impersonal model proposes candidates, a personal model re-ranks them) does not improve on its impersonal baseline: two off-the-shelf zero-shot LLMs, including a frontier model, predict highlight locations worse than a lead baseline, and personal re-ranking is beaten by the salience order even on the highest-recall candidate pool, so the null is not merely a Stage-1 ceiling artifact. Measurable personalization appears primarily at the selection layer: modest (~+0.13), topic-dominated, with no reliable gain at the salience layer. We also surface a control-in-negatives bias that inflated our document gap to a spurious +0.227 until audited. Going beyond the shared salience layer may be better approached by aggregating individuals than by personalizing them harder.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 7 of its 12 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
7 of 12 references.
References · 7
- 2023LaMP: When Large Language Models Meet Personalizationcited by 437
- 2024Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracycited by 67
- 2018PHD-GIFs: Personalized Highlight Detection for Automatic GIF Creationcited by 19
- 2020A Re-visit of the Popularity Baseline in Recommender Systemscited by 18
- 2025Behavioral Analysis of Information Salience in Large Language Modelscited by 12
- 2026Personal Salience: Highlighting Is Social, but Individuality Lives in Selectioncited by 5
- 2024PerSEval: Assessing Personalization in Text Summarizerscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026The Long Tail, Not the Front Page: Cold-Start Prediction of Crowd Highlight Saliencecited by 3
- 2026Measuring Alignment With Reader Highlights Net of Position and Lengthcited by 2
- 2026Factions Within, Uncertain Across: Within-Document Reader Sub-Groups in Social Highlightingcited by 1
- 2026Trait, Not State: The Durability of Reading Identity in Social Highlightingcited by 0
- 2026Measuring Alignment With Reader Highlights Net of Position and Length30 Jul 2026
- 2026Trait, Not State: The Durability of Reading Identity in Social Highlighting11 Jun 2026
- 2026The Long Tail, Not the Front Page: Cold-Start Prediction of Crowd Highlight Salience10 Jun 2026
- 2026Factions Within, Uncertain Across: Within-Document Reader Sub-Groups in Social Highlighting10 Jun 2026