mlsanityData to 14 Oct 2026

Perceptual Reality Transformer: What Must an Illustration Preserve?

arXiv 2508.09852 ↗First posted 13 Aug 2025q-bio.NC cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

How can models help people communicate unusual perceptual experiences without changing what they mean? A recognizable image is only part of the answer: accounts also express vividness, duration, uncertainty, and emotion. We introduce Perceptual Reality Transformer (PRT), an evidence-linked workflow and descriptive atlas that retain the source account alongside representations and generated illustrations. Three studies examine successive parts of this transformation. In 3,145 public Ganzflicker records, frozen neural representations predict complex content well (AUROC 0.887--0.894), but vividness, persistence, and unpleasantness are less recoverable; separate imagery/context responses improve vividness prediction relative to narrative embeddings alone. In 672 synthetic contrasts, similarity judgments depend strongly on wording, while exploratory probes recover some distinctions that cosine handles poorly. Finally, 72 matched illustrations from 24 reports compare direct prompting, evidence in prose, and structured PRT. The automated coverage metric does not demonstrate a structured-format advantage; near-ceiling scores, an apparent judge error, and an analogy-to-object scoring ambiguity limit its interpretation. Together, the studies motivate separating missing information, inaccessible meaning, and an inadequate evaluation criterion. The resulting atlas makes these choices inspectable, without treating generated images as measurements of private perception.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 15 references that are in the map. First posted on arXiv 13 Aug 2025.

Builds on

9 of 15 references.

References · 9

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  4. 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 610
  5. 2023SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionalitycited by 243
  6. 2025CLIP Behaves like a Bag-of-Words Model Cross-modally but not Uni-modallycited by 31
  7. 2024How and where does CLIP process negation?cited by 16
  8. 2025Mapping of Subjective Accounts into Interpreted Clusters (MOSAIC): Topic Modelling and LLM applied to Stroboscopic Phenomenologycited by 2
  9. 2025From dots to faces: Individual differences in visual imagery capacity predict the content of Ganzflicker-induced hallucinationscited by 1

Built on by

Not cited yet.