mlsanityData to 14 Oct 2026

An Exploratory Framework for Future SETI Applications: Detecting Generative Reactivity via Language Models

arXiv 2506.02730 ↗First posted 3 Jun 2025astro-ph.IM cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We present an exploratory framework to test whether noise-like input can induce structured responses in language models. Instead of assuming that extraterrestrial signals must be decoded, we evaluate whether inputs can trigger linguistic behavior in generative systems. This shifts the focus from decoding to viewing structured output as a sign of underlying regularity in the input. We tested GPT-2 small, a 117M-parameter model trained on English text, using four types of acoustic input: human speech, humpback whale vocalizations, Phylloscopus trochilus birdsong, and algorithmically generated white noise. All inputs were treated as noise-like, without any assumed symbolic encoding. To assess reactivity, we defined a composite score called Semantic Induction Potential (SIP), combining entropy, syntax coherence, compression gain, and repetition penalty. Results showed that whale and bird vocalizations had higher SIP scores than white noise, while human speech triggered only moderate responses. This suggests that language models may detect latent structure even in data without conventional semantics. We propose that this approach could complement traditional SETI methods, especially in cases where communicative intent is unknown. Generative reactivity may offer a different way to identify data worth closer attention.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 51 references that are in the map. First posted on arXiv 3 Jun 2025.

Builds on

18 of 51 references.

References · 18

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  5. 2022Emergent Abilities of Large Language Modelscited by 2,512
  6. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  7. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  8. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  9. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  10. 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 359
  11. 2023Language Modeling Is Compressioncited by 225
  12. 2023How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language modelcited by 202
6 more
  1. 2024Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Modelscited by 152
  2. 2023Towards Interpretable Sequence Continuation: Analyzing Shared Circuits in Large Language Modelscited by 15
  3. 2023A deep-learning search for technosignatures of 820 nearby starscited by 4
  4. 2018Classification of simulated radio signals using Wide Residual Networks for use in the search for extra-terrestrial intelligencecited by 3
  5. 2019Model selection for deep audio source separation via clustering analysiscited by 1
  6. 2022Edge Detection and Deep Learning Based SETI Signal Classification Methodcited by 1

Built on by

Not cited yet.