mlsanityData to 14 Oct 2026

Perceive, Refine, Reason: A Calibrated Pipeline for Measuring Indicators in Strategic Visual Communication on Social Media

arXiv 2609.14699 ↗First posted 13 Sep 2026cs.CV cs.CYcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Visual content shapes audience perception and opinion on social media, and computational social science increasingly relies on automated tools to analyze images at scale. Yet a measurement gap persists: existing tools rely on predefined categories or produce only coarse image-level labels, while measuring which specific objects appear in an image, how prominently, and where in the frame remains difficult at scale. We introduce Perceive, Refine, Reason (PRR), a calibrated pipeline that turns flexible vision-language detectors into auditable measurement instruments for social-scientific research. PRR combines natural-language category prompts with pixel-level spatial refinement via the Segment Anything Model (SAM) and a multimodal LLM arbitration layer whose reasoning chains externalize domain knowledge and lower the expertise threshold for human-in-the-loop validation. A complementary three-tier auditability framework applies quantification learning to profile per-category reliability, support task-aligned configuration, and statistically correct prevalence estimates. Across four vision-language detectors and nine sociological categories, the pipeline yields substantial precision gains over zero-shot baselines, including a 43.3-point improvement for the strongest backbone. Applying PRR to 103,920 Facebook images from U.S. legislators during the 2024 election cycle and linking detections to DW-NOMINATE ideology scores, we find that more conservative legislators display U.S. flags as larger visual elements, with a weaker tendency toward peripheral placement, a spatial pattern invisible to binary detection. PRR provides computational social scientists with a model-agnostic toolkit for accessible, spatially-grounded, and correctable visual measurement.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 2 of its 36 references that are in the map. First posted on arXiv 13 Sep 2026.

Builds on

2 of 36 references.

References · 2

  1. 2023GPT-4V(ision) as A Social Media Analysis Enginecited by 6
  2. 2026Reasoning-Guided Grounding: Elevating Video Anomaly Detection through Multimodal Large Language Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Bias in the Picture: Benchmarking VLMs with Social-Cue News Images and LLM-as-Judge Assessment
  2. 2026Edu-MMBias: A Three-Tier Multimodal Benchmark for Auditing Social Bias in Vision-Language Models under Educational Contexts
  3. 2025Large Language Model-Informed Feature Discovery Improves Prediction and Interpretation of Credibility Perceptions of Visual Content
  4. 2026GLEaN: A Text-to-image Bias Detection Approach for Public Comprehension
  5. 2026Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos
  6. 2025Seeing is Not Understanding: A Benchmark on Perception-Cognition Disparities in Large Language Models
  7. 2024Social Perception of Faces in a Vision-Language Model
  8. 2026Can MLLMs Reason About Visual Persuasion? Evaluating the Efficacy and Faithfulness of Reasoning