mlsanityData to 14 Oct 2026

ADAM: A Diverse Archive of Mankind for Evaluating and Enhancing LLMs in Biographical Reasoning

arXiv 2509.22991 ↗First posted 26 Sep 2025cs.CL cs.AI cs.CVcited by 1

On the map: LLM reasoning → Reasoning benchmarks and evaluation

also in 1 more
Abstract (arXiv)

We introduce ADAM (A Diverse Archive of Mankind), a framework for evaluating and improving multimodal large language models (MLLMs) in biographical reasoning. To the best of our knowledge, this is the first work to systematically examine LLM capabilities in biography, a critical yet underexplored dimension of factual knowledge. At its core, AdamDB is a multilingual and multimodal dataset covering over 4 million individuals across geography, time, and profession, while AdamBench provides cognitively structured evaluations based on Bloom's taxonomy, spanning six reasoning levels in both English and native languages. To address hallucinations, particularly for lesser-known individuals, we propose AdamRAG, a retrieval-augmented generation system tailored to biographical contexts. Experiments show that AdamRAG substantially improves open-source models and modestly benefits closed-source ones, with the largest gains on lower-order reasoning. Popularity strongly mediates accuracy, and multimodal input via face images offers smaller, less consistent improvements than retrieval. ADAM establishes the first benchmark and framework for cognitively, culturally, and multimodally grounded biographical evaluation, advancing the development of multilingual, accurate, and hallucination-resistant MLLMs.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 8 of its 11 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

8 of 11 references.

References · 8

  1. 2020Language-agnostic BERT Sentence Embeddingcited by 627
  2. 2019Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Settingcited by 349
  3. 2019EventKG - the Hub of Event Knowledge on the Web - and Biographical Timeline Generationcited by 24
  4. 2024Khayyam Challenge (PersianMMLU): Is Your LLM Truly Wise to The Persian Language?cited by 22
  5. 2015Pantheon 1.0, a manually verified dataset of globally famous biographiescited by 8
  6. 2022Biographical: A Semi-Supervised Relation Extraction Datasetcited by 7
  7. 2025MEENA (PersianMMMU): Multimodal-Multilingual Educational Exams for N-level Assessmentcited by 3
  8. 2019BioGen: Automated Biography Generationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025FATHOMS-RAG: A Framework for the Assessment of Thinking and Observation in Multimodal Systems that use Retrieval Augmented Generation
  2. 2026UNREAL: Unifying Retrieval and Long-Context with a Single Model
  3. 2026KnowMe-Bench: Benchmarking Person Understanding for Lifelong Digital Companions
  4. 2024NeedleBench: Evaluating LLM Retrieval and Reasoning Across Varying Information Densities
  5. 2026When a Name Is Not a Name: A Benchmark Dataset and Distilled Reasoning for Culturally Entangled Bangla Homographs in Low-Resource LLMs
  6. 2026EduArt: An educational-level benchmark for evaluating art history knowledge in large language models
  7. 2026Blind Men and the Elephant: Probing the Epistemic Myopia of LLMs under Long-Tail Divergent Knowledge
  8. 2025A Controllable Examination for Long-Context Language Models