DEO: Training-Free Direct Embedding Optimization for Negation-Aware Retrieval
On the map: Retrieval-augmented generation → Generation and context integration
Abstract (arXiv)
Recent advances in Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) have enabled diverse retrieval methods. However, existing retrieval methods often fail to accurately retrieve results for negation and exclusion queries. To address this limitation, prior approaches rely on embedding adaptation or fine-tuning, which introduce additional computational cost and deployment complexity. We propose Direct Embedding Optimization (DEO), a training-free method for negation-aware text and multimodal retrieval. DEO decomposes queries into positive and negative components and optimizes the query embedding with a contrastive objective. Without additional training data or model updates, DEO outperforms baselines on NegConstraint, with gains of +0.0738 nDCG@10 and +0.1028 MAP@100, while improving Recall@5 by +6% over OpenAI CLIP in multimodal retrieval. These results demonstrate the practicality of DEO for negation- and exclusion-aware retrieval in real-world settings.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 13 of its 19 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
13 of 19 references.
Closest ancestors · 2
Same direction, newest first
- 2024NUDGE: Lightweight Non-Parametric Fine-Tuning of Embeddings for Retrieval4 Sep
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks22 May
Other references · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2015VQA: Visual Question Answeringcited by 2,489
- 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 603
- 2025Vision-Language Models Do Not Understand Negationcited by 69
- 2024TripletCLIP: Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negativescited by 57
- 2023NevIR: Negation in Neural Information Retrievalcited by 28
- 2024Interpret and Control Dense Retrieval with Sparse Latent Featurescited by 9
- 2025TNG-CLIP:Training-Time Negation Data Generation for Negation Awareness of CLIPcited by 6
- 2025Logical Consistency is Vital: Neural-Symbolic Information Retrieval for Negative-Constraint Queriescited by 3
- 2021Visual Question Answering based on Local-Scene-Aware Referring Expression Generationcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Reason to Contrast: A Cascaded Multimodal Retrieval Framework
- 2025ELITE: Embedding-Less retrieval with Iterative Text Exploration
- 2026Skim and Skip: Hierarchical Adaptive Inference for Efficient Multimodal Retrieval
- 2025U-MARVEL: Unveiling Key Factors for Universal Multimodal Retrieval via Embedding Learning with MLLMs
- 2026HAKARI-Bench: A Lightweight Benchmark for Comparing Retrieval Architectures and Efficiency Settings under Unified Conditions
- 2024Embedding-Informed Adaptive Retrieval-Augmented Generation of Large Language Models
- 2025Exploring Reasoning-Infused Text Embedding with Large Language Models for Zero-Shot Dense Retrieval
- 2025Direct Retrieval-augmented Optimization: Synergizing Knowledge Selection and Language Models