mlsanityData to 7 Oct 2026

On the Representational Limits of Quantum-Inspired 1024-D Document Embeddings: An Experimental Evaluation Framework

arXiv 2604.09430 ↗First posted 10 Apr 2026cs.IR cs.AI quant-phcited by 1

On the map: Retrieval-augmented generation → Generation and context integration

Abstract (arXiv)

Text embeddings are central to modern information retrieval and Retrieval-Augmented Generation (RAG). While dense models derived from Large Language Models (LLMs) dominate current practice, recent work has explored quantum-inspired alternatives motivated by the geometric properties of Hilbert-like spaces and their potential to encode richer semantic structure. This paper presents an experimental framework for constructing quantum-inspired 1024-dimensional document embeddings based on overlapping windows and multi-scale aggregation. The pipeline combines semantic projections (e.g., EigAngle), circuit-inspired feature mappings, and optional teacher-student distillation, together with a fingerprinting mechanism for reproducibility and controlled evaluation. We introduce a set of diagnostic tools for hybrid retrieval, including static and dynamic interpolation between BM25 and embedding-based scores, candidate union strategies, and a conceptual alpha-oracle that provides an upper bound for score-level fusion. Experiments on controlled corpora of Italian and English documents across technical, narrative, and legal domains, using synthetic queries, show that BM25 remains a strong baseline, teacher embeddings provide stable semantic structure, and standalone quantum-inspired embeddings exhibit weak and unstable ranking signals. Distillation yields mixed effects, improving alignment in some cases but not consistently enhancing retrieval performance, while hybrid retrieval can recover competitive results when lexical and embedding-based signals are combined. Overall, the results highlight structural limitations in the geometry of quantum-inspired embeddings, including distance compression and ranking instability, and clarify their role as auxiliary components rather than standalone retrieval representations.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 19 of its 35 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

19 of 35 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2017Billion-scale similarity search with GPUscited by 2,477
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  5. 2018Supervised learning with quantum enhanced feature spacescited by 654
  6. 2018Barren plateaus in quantum neural network training landscapescited by 624
  7. 2024Large Language Models: A Surveycited by 506
  8. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
  9. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
  10. 2020Overview of the TREC 2019 deep learning trackcited by 282
  11. 2024Better than classical? The subtle art of benchmarking quantum machine learning modelscited by 82
  12. 2020Autoencoding Improves Pre-trained Word Embeddingscited by 11
7 more
  1. 2020A Survey of Quantum Theory Inspired Approaches to Information Retrievalcited by 9
  2. 2018Quantum-inspired Complex Word Embeddingcited by 6
  3. 2022Compressing Sentence Representation for Semantic Retrieval via Homomorphic Projective Distillationcited by 5
  4. 2025Quantum-inspired Embeddings Projection and Similarity Metrics for Representation Learningcited by 4
  5. 2013Meaning-focused and Quantum-inspired Information Retrievalcited by 1
  6. 2018Exploiting "Quantum-like Interference" in Decision Fusion for Ranking Multimodal Documentscited by 1
  7. 2025Quantum-RAG and PunGPT2: Advancing Low-Resource Language Generation and Retrieval for the Punjabi Languagecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Quanta: A Self-Contained Python Library for Hybrid Retrieval over Quantised Embeddings, Lexical Indexes, and Knowledge Graphs
  2. 2026Semantic Entanglement in Vector-Based Retrieval: A Formal Framework and Context-Conditioned Disentanglement Pipeline for Agentic RAG Systems
  3. 2026HypRAG: Hyperbolic Dense Retrieval for Retrieval Augmented Generation
  4. 2026Real-Time Hybrid Retrieval in Hyperbolic Space for Retrieval-Augmented Generation on Edge Devices
  5. 2024HEAL: Hierarchical Embedding Alignment Loss for Improved Retrieval and Representation Learning
  6. 20254bit-Quantization in Vector-Embedding for RAG
  7. 2025ELITE: Embedding-Less retrieval with Iterative Text Exploration
  8. 2025Rethinking Hybrid Retrieval: When Small Embeddings and LLM Re-ranking Beat Bigger Models