# Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural Network

arXiv: https://arxiv.org/abs/1502.06796 · HTML: https://mlsanity.com/paper/1502.06796/

## Key facts

- Cited by 31 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Feb 2015.

## Built on by (most cited first, 30 of 31)

- [SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detection](https://mlsanity.com/paper/2204.05585/) (2022)
- [Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusion](https://mlsanity.com/paper/2103.11832/) (2021)
- [TriTransNet: RGB-D Salient Object Detection with a Triplet Transformer Embedding Network](https://mlsanity.com/paper/2108.03990/) (2021)
- [Adjacent Context Coordination Network for Salient Object Detection in Optical Remote Sensing Images](https://mlsanity.com/paper/2203.13664/) (2022)
- [Machine Learning for Large-Scale Optimization in 6G Wireless Networks](https://mlsanity.com/paper/2301.03377/) (2023)
- [Wide and Deep Graph Neural Network with Distributed Online Learning](https://mlsanity.com/paper/2107.09203/) (2021)
- [Multi-Projection Fusion and Refinement Network for Salient Object Detection in 360deg Omnidirectional Image](https://mlsanity.com/paper/2212.12378/) (2022)
- [RGB-D Salient Object Detection with Ubiquitous Target Awareness](https://mlsanity.com/paper/2109.03425/) (2021)
- [Interpretable Sparsification of Brain Graphs: Better Practices and Effective Designs for Graph Neural Networks](https://mlsanity.com/paper/2306.14375/) (2023)
- [Rapid Salient Object Detection with Difference Convolutional Neural Networks](https://mlsanity.com/paper/2507.01182/) (2025)
- [SalienDet: A Saliency-based Feature Enhancement Algorithm for Object Detection for Autonomous Driving](https://mlsanity.com/paper/2305.06940/) (2023)
- [Quality-aware Selective Fusion Network for V-D-T Salient Object Detection](https://mlsanity.com/paper/2405.07655/) (2024)
- [Tracking by Joint Local and Global Search: A Target-aware Attention based Approach](https://mlsanity.com/paper/2106.04840/) (2021)
- [GroupTransNet: Group Transformer Network for RGB-D Salient Object Detection](https://mlsanity.com/paper/2203.10785/) (2022)
- [Rethinking Lightweight Salient Object Detection via Network Depth-Width Tradeoff](https://mlsanity.com/paper/2301.06679/) (2023)
- [Adaptive Siamese Tracking with a Compact Latent Network](https://mlsanity.com/paper/2302.00930/) (2023)
- [Boundary-semantic collaborative guidance network with dual-stream feedback mechanism for salient object detection in optical remote sensing imagery](https://mlsanity.com/paper/2303.02867/) (2023)
- [To be Critical: Self-Calibrated Weakly Supervised Learning for Salient Object Detection](https://mlsanity.com/paper/2109.01770/) (2021)
- [Salient Object Detection From Arbitrary Modalities](https://mlsanity.com/paper/2405.03352/) (2024)
- [Deep Convolutional Correlation Iterative Particle Filter for Visual Tracking](https://mlsanity.com/paper/2107.02984/) (2021)
- [LC3Net: Ladder context correlation complementary network for salient object detection](https://mlsanity.com/paper/2110.10869/) (2021)
- [Sharp Eyes: A Salient Object Detector Working The Same Way as Human Visual Characteristics](https://mlsanity.com/paper/2301.07431/) (2023)
- [A Visual Representation-guided Framework with Global Affinity for Weakly Supervised Salient Object Detection](https://mlsanity.com/paper/2302.10697/) (2023)
- [Beyond Global Scanning: Adaptive Visual State Space Modeling for Salient Object Detection in Optical Remote Sensing Images](https://mlsanity.com/paper/2508.10542/) (2025)
- [Continuity-Discrimination Convolutional Neural Network for Visual Object Tracking](https://mlsanity.com/paper/2104.08739/) (2021)
- [Deep Learning Image Recognition for Non-images](https://mlsanity.com/paper/2106.14350/) (2021)
- [a novel attention-based network for fast salient object detection](https://mlsanity.com/paper/2112.10481/) (2021)
- [Learning Video Salient Object Detection Progressively from Unlabeled Videos](https://mlsanity.com/paper/2204.02008/) (2022)
- [Rethinking Saliency-Guided Weakly-Supervised Semantic Segmentation](https://mlsanity.com/paper/2404.00918/) (2024)
- [DualGazeNet: A Biologically Inspired Dual-Gaze Query Network for Salient Object Detection](https://mlsanity.com/paper/2511.18865/) (2025)

## Abstract (arXiv)

We propose an online visual tracking algorithm by learning discriminative saliency map using Convolutional Neural Network (CNN). Given a CNN pre-trained on a large-scale image repository in offline, our algorithm takes outputs from hidden layers of the network as feature descriptors since they show excellent representation performance in various general visual recognition problems. The features are used to learn discriminative target appearance models using an online Support Vector Machine (SVM). In addition, we construct target-specific saliency map by backpropagating CNN features with guidance of the SVM, and obtain the final tracking result in each frame based on the appearance model generatively constructed with the saliency map. Since the saliency map visualizes spatial configuration of target effectively, it improves target localization accuracy and enable us to achieve pixel-level target segmentation. We verify the effectiveness of our tracking algorithm through extensive experiment on a challenging benchmark, where our method illustrates outstanding performance compared to the state-of-the-art tracking algorithms.