ALIGNS: Unlocking nomological networks in psychological measurement through a large language model
Not on the map. Why?
Abstract (arXiv)
Psychological measurement is critical to many disciplines. Despite advances in measurement, building nomological networks, theoretical maps of how concepts and measures relate to establish validity, remains a challenge 70 years after Cronbach and Meehl proposed them as fundamental to validation. This limitation has practical consequences: clinical trials may fail to detect treatment effects, and public policy may target the wrong outcomes. We introduce Analysis of Latent Indicators to Generate Nomological Structures (ALIGNS), a large language model-based system trained with validated questionnaire measures. ALIGNS provides three comprehensive nomological networks containing over 550,000 indicators across psychology, medicine, social policy, and other fields. This represents the first application of large language models to solve a foundational problem in measurement validation. We report classification accuracy tests used to develop the model, as well as three evaluations. In the first evaluation, the widely used NIH PROMIS anxiety and depression instruments are shown to converge into a single dimension of emotional distress. The second evaluation examines child temperament measures and identifies four potential dimensions not captured by current frameworks, and questions one existing dimension. The third evaluation, an applicability check, engages expert psychometricians who assess the system's importance, accessibility, and suitability. ALIGNS is freely available at nomologicalnetwork.org, complementing traditional validation methods with large-scale nomological analysis.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 62 references that are in the map. First posted on arXiv 10 Sep 2025.
Builds on
9 of 62 references.
References · 9
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2024The Platonic Representation Hypothesiscited by 382
- 2023Scaling Sentence Embeddings with Large Language Modelscited by 85
- 2024GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuningcited by 40
- 2025Validity in Design Sciencecited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Large Language Models are Highly Aligned with Human Ratings of Emotional Stimuli
- 2026Language Markers of Emotion Flexibility Predict Depression and Anxiety Treatment Outcomes
- 2025In Silico Development of Psychometric Scales: Feasibility of Representative Population Data Simulation with LLMs
- 2026Whose Assessment of Distress? Community Perspectives and LLM Alignment on Well-Being Posts
- 2026A Systematic Evaluation of Large Language Models for PTSD Severity Estimation: The Role of Contextual Knowledge and Modeling Strategies
- 2026Large Language Models as Simulative Agents for Neurodivergent Adult Psychometric Profiles
- 2026Aligning with Lived Experience: Heterogeneous Benefits of Fine Tuning in Mental Health Support Generation
- 2026Toward Contemplative LLM: A Modular Framework for Evaluating and Enhancing LLM Alignment in Mental Health