mlsanityData to 7 Oct 2026

PRISM-RAG: Multimodal Hypergraph Retrieval-Augmented Generation for Tobacco Product and Legislative Policy Reasoning

arXiv 2609.23769 ↗First posted 20 Sep 2026cs.CVcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG also fits: Legal and financial RAG

Abstract (arXiv)

The disambiguation of semantically similar statutory text across jurisdictions is a retrieval problem that existing methods do not solve. This inter-context conflict can steer generative models toward confidently produced answers grounded in topically relevant but jurisdictionally incorrect sources. Tobacco and nicotine regulations vary by US jurisdiction, often sharing similar language, thus, robust reasoning requires identifying which jurisdiction's law governs a given product, not merely retrieving relevant text. Emerging products (e.g., pouches) exploit ambiguous definitions to evade regulation. State-of-the-art (SOTA) document retrieval-augmented generation (RAG) methods struggle to address this inter-context conflict, and thus struggle to connect image attributes (e.g., rich attribute captions) to the set of similar legislation texts. We introduce NicoPRISM (Nicotine Product and Regulation Image-and-Text Surveillance Multimodal), comprising 161,563 images, attribute captions, a knowledge base of product, health, and legislative documents spanning 13 US jurisdictions, and 1,495 validated question-answer pairs across two tasks: policy compliance QA and product knowledge QA. We also propose PRISM-RAG, a multimodal hypergraph RAG framework built over images, captions, and entities without any LLM calls at index time, grounding every query in a product image and routes retrieval through a jurisdiction-aware context assembly mechanism guaranteeing that statutory text from the queried jurisdiction reaches the language model by construction. PRISM-RAG retrieves passages from the correct jurisdiction in 93.9% of policy compliance queries, a 48.6 percentage point advantage over standard RAG (p<0.001), using zero LLM calls at index time and one at query time, and is competitive with or outperforms SOTA RAG frameworks across keyword, semantic, jurisdiction-, and compliance-accuracy metrics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 28 of its 40 references that are in the map. First posted on arXiv 20 Sep 2026.

Builds on

28 of 40 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  9. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  10. 2020Learning to summarize from human feedbackcited by 2,562
  11. 2025Gemma 3 Technical Reportcited by 1,686
  12. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
16 more
  1. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  2. 2025Qwen-Image Technical Reportcited by 973
  3. 2025OpenAI GPT-5 System Cardcited by 910
  4. 2023Instruction Tuning with GPT-4cited by 676
  5. 2024A Survey on Hallucination in Large Vision-Language Modelscited by 352
  6. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 310
  7. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
  8. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 223
  9. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
  10. 2025LLaVA-Mini: Efficient Image and Video Large Multimodal Models with One Vision Tokencited by 164
  11. 2024GRAG: Graph Retrieval-Augmented Generationcited by 77
  12. 2025HyperGraphRAG: Retrieval-Augmented Generation via Hypergraph-Structured Knowledge Representationcited by 68
  13. 2025PathRAG: Pruning Graph-based Retrieval Augmented Generation with Relational Pathscited by 60
  14. 2024HelloBench: Evaluating Long Text Generation Capabilities of Large Language Modelscited by 42
  15. 2024Public Health Advocacy Dataset: A Dataset of Tobacco Usage Videos from Social Mediacited by 2
  16. 2023A multimodal deep learning architecture for smoking detection with a small data approachcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026NICO-RAG: Multimodal Hypergraph Retrieval-Augmented Generation for Understanding the Nicotine Public Health Crisis
  2. 2026Chunking, Retrieval, and Re-ranking: An Empirical Evaluation of RAG Architectures for Policy Document Question Answering
  3. 2025PolicyBot - Reliable Question Answering over Policy Documents
  4. 2026VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents
  5. 2026Navigating Global AI Regulation: A Multi-Jurisdictional Retrieval-Augmented Generation System
  6. 2025Retrieval Augmented Generation-based Large Language Models for Bridging Transportation Cybersecurity Legal Knowledge Gaps
  7. 2025Fishing for Answers: Exploring One-shot vs. Iterative Retrieval Strategies for Retrieval Augmented Generation
  8. 2025Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding