# Provenance Filtering for Multimedia Phylogeny

arXiv: https://arxiv.org/abs/1706.00447 · HTML: https://mlsanity.com/paper/1706.00447/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Jun 2017.

## Built on by (most cited first, 3 of 3)

- [Dataset and Case Studies for Visual Near-Duplicates Detection in the Context of Social Media](https://mlsanity.com/paper/2203.07167/) (2022)
- [Needle In A Haystack, Fast: Benchmarking Image Perceptual Similarity Metrics At Scale](https://mlsanity.com/paper/2206.00282/) (2022)
- [Detecting Near-Duplicate Face Images](https://mlsanity.com/paper/2408.07689/) (2024)

## Abstract (arXiv)

Departing from traditional digital forensics modeling, which seeks to analyze single objects in isolation, multimedia phylogeny analyzes the evolutionary processes that influence digital objects and collections over time. One of its integral pieces is provenance filtering, which consists of searching a potentially large pool of objects for the most related ones with respect to a given query, in terms of possible ancestors (donors or contributors) and descendants. In this paper, we propose a two-tiered provenance filtering approach to find all the potential images that might have contributed to the creation process of a given query q. In our solution, the first (coarse) tier aims to find the most likely "host" images --- the major donor or background --- contributing to a composite/doctored image. The search is then refined in the second tier, in which we search for more specific (potentially small) parts of the query that might have been extracted from other images and spliced into the query image. Experimental results with a dataset containing more than a million images show that the two-tiered solution underpinned by the context of the query is highly useful for solving this difficult task.