mlsanityData to 7 Oct 2026

Towards Nexus-Score: Metadata Gaps Limit Scholarly AI Attribution

arXiv 2607.22684 ↗First posted 14 Jul 2026cs.DL cs.AI cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence systems increasingly mediate how science is found and credited. We asked whether missing metadata prevents AI systems from crediting work. As a boundary test, an AI system citing without access to task-relevant paper lists often produced out-of-list identifiers, some fabricated. We then tested the mechanism in real scholarly infrastructure by using OpenAlex records to hide or restore author, institution, funder, reference, and text-access links while holding works and tasks fixed. Restoring the relevant link made the corresponding attribution possible; restoring the wrong kind did not, with 0 correct answers across 469 completed mismatched tests. Thus, in these tasks, one metadata facet did not substitute for another. Missing links led to invented answers, refusals, or tool-budget exhaustion, and web search did not recover hidden author links. In sum, AI systems credited work only when record connections were visible or recoverable. This motivates Nexus-Score, a record-level check for metadata gaps, to guide repair and help prepare the scholarly record for AI-mediated use.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 19 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

5 of 19 references.

References · 5

  1. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  2. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  3. 2022OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and conceptscited by 166
  4. 2024Reference Coverage Analysis of OpenAlex compared to Web of Science and Scopuscited by 10
  5. 2024Evaluating the Linguistic Coverage of OpenAlex: An Assessment of Metadata Accuracy and Completenesscited by 3

Built on by

Not cited yet.