# Incorporation of Human Knowledge into Data Embeddings to Improve Pattern Significance and Interpretability

arXiv: https://arxiv.org/abs/2209.11364 · HTML: https://mlsanity.com/paper/2209.11364/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Sep 2022.

## Built on by (most cited first, 4 of 4)

- [LLM-Augmented Semantic Steering of Text Embedding Projection Spaces](https://mlsanity.com/paper/2605.01957/) (2026)
- [Infrared Spectra Prediction for Diazo Groups Utilizing a Machine Learning Approach with Structural Attention Mechanism](https://mlsanity.com/paper/2402.03112/) (2024)
- [Standardness Clouds Meaning: A Position Regarding the Informed Usage of Standard Datasets](https://mlsanity.com/paper/2406.13552/) (2024)
- [FADEx: Feature Attribution and Distortion-based Explanation of Dimensionality Reduction](https://mlsanity.com/paper/2607.27463/) (2026)

## Abstract (arXiv)

Embedding is a common technique for analyzing multi-dimensional data. However, the embedding projection cannot always form significant and interpretable visual structures that foreshadow underlying data patterns. We propose an approach that incorporates human knowledge into data embeddings to improve pattern significance and interpretability. The core idea is (1) externalizing tacit human knowledge as explicit sample labels and (2) adding a classification loss in the embedding network to encode samples' classes. The approach pulls samples of the same class with similar data features closer in the projection, leading to more compact (significant) and class-consistent (interpretable) visual structures. We give an embedding network with a customized classification loss to implement the idea and integrate the network into a visualization system to form a workflow that supports flexible class creation and pattern exploration. Patterns found on open datasets in case studies, subjects' performance in a user study, and quantitative experiment results illustrate the general usability and effectiveness of the approach.
