NOSE: Neural Olfactory-Semantic Embedding with Tri-Modal Orthogonal Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Olfaction lies at the intersection of chemical structure, neural encoding, and linguistic perception, yet existing representation methods fail to fully capture this pathway. Current approaches typically model only isolated segments of the olfactory pathway, overlooking the complete chain from molecule to receptors to linguistic descriptions. Such fragmentation yields learned embeddings that lack both biological grounding and semantic interpretability. We propose NOSE (Neural Olfactory-Semantic Embedding), a representation learning framework that aligns three modalities along the olfactory pathway: molecular structure, receptor sequence, and natural language description. Rather than simply fusing these signals, we decouple their contributions via orthogonal constraints, preserving the unique encoded information of each modality. To address the sparsity of olfactory language, we introduce a weak positive sample strategy to calibrate semantic similarity, preventing erroneous repulsion of similar odors in the feature space. Extensive experiments demonstrate that NOSE achieves state-of-the-art (SOTA) performance and excellent zero-shot generalization, confirming the strong alignment between its representation space and human olfactory intuition.Code and data are available at https://github.com/Xianyusyy/NOSE
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 77 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
15 of 77 references.
References · 15
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2020On Layer Normalization in the Transformer Architecturecited by 922
- 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 339
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
- 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 265
- 2021Multimodal Contrastive Training for Visual Representation Learningcited by 124
- 2023Factorized Contrastive Learning: Going Beyond Multi-view Redundancycited by 75
- 2023FOCAL: Contrastive Learning for Multimodal Time-Series Sensing Signals in Factorized Orthogonal Latent Spacecited by 33
3 more
- 2019Machine Learning for Scent: Learning Generalizable Perceptual Representations of Small Moleculescited by 28
- 2021A Theory-Driven Self-Labeling Refinement Method for Contrastive Representation Learningcited by 7
- 2024Sniff AI: Is My 'Spicy' Your 'Spicy'? Exploring LLM's Perceptual Alignment with Human Smell Experiencescited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.