# Temporal Fusion Based Mutli-scale Semantic Segmentation for Detecting Concealed Baggage Threats

arXiv: https://arxiv.org/abs/2111.02651 · HTML: https://mlsanity.com/paper/2111.02651/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 19 of its 72 references that are in the map.
- First posted on arXiv 4 Nov 2021.

## Builds on (most cited first, 19 of 19)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Pyramid Scene Parsing Network](https://mlsanity.com/paper/1612.01105/) (2016)
- [SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation](https://mlsanity.com/paper/1511.00561/) (2015)
- [A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges](https://mlsanity.com/paper/2011.06225/) (2020)
- [GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training](https://mlsanity.com/paper/1805.06725/) (2018)
- [Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detection](https://mlsanity.com/paper/1901.08954/) (2019)
- [SIXray : A Large-scale Security Inspection X-ray Benchmark for Prohibited Item Discovery in Overlapping Images](https://mlsanity.com/paper/1901.00303/) (2019)
- [Occluded Prohibited Items Detection: an X-ray Security Inspection Benchmark and De-occlusion Attention Module](https://mlsanity.com/paper/2004.08656/) (2020)
- [Light-Weight RefineNet for Real-Time Semantic Segmentation](https://mlsanity.com/paper/1810.03272/) (2018)
- [Clinically Verified Hybrid Deep Learning System for Retinal Ganglion Cells Aware Grading of Glaucomatous Progression](https://mlsanity.com/paper/2010.03872/) (2020)
- [Cascaded Structure Tensor Framework for Robust Identification of Heavily Occluded Baggage Items from X-ray Scans](https://mlsanity.com/paper/2004.06780/) (2020)
- [SIP-SegNet: A Deep Convolutional Encoder-Decoder Network for Joint Semantic Segmentation and Extraction of Sclera, Iris and Pupil based on Periocular Region Suppression](https://mlsanity.com/paper/2003.00825/) (2020)
- [Unsupervised Anomaly Instance Segmentation for Baggage Threat Recognition](https://mlsanity.com/paper/2107.07333/) (2021)
- [Trainable Structure Tensors for Autonomous Baggage Threat Detection Under Extreme Occlusion](https://mlsanity.com/paper/2009.13158/) (2020)
- [A Dilated Residual Hierarchically Fashioned Segmentation Framework for Extracting Gleason Tissues and Grading Prostate Cancer from Whole Slide Images](https://mlsanity.com/paper/2011.00527/) (2020)
- [Tensor Pooling Driven Instance Segmentation Framework for Baggage Threat Recognition](https://mlsanity.com/paper/2108.09603/) (2021)
- [Incremental Cross-Domain Adaptation for Robust Retinopathy Screening via Bayesian Deep Learning](https://mlsanity.com/paper/2110.09319/) (2021)
- [Automated segmentation and extraction of posterior eye segment using OCT scans](https://mlsanity.com/paper/2109.10000/) (2021)

## Built on by (most cited first, 1 of 1)

- [A Novel Incremental Learning Driven Instance Segmentation Framework to Recognize Highly Cluttered Instances of the Contraband Items](https://mlsanity.com/paper/2201.02560/) (2022)

## Abstract (arXiv)

Detection of illegal and threatening items in baggage is one of the utmost security concern nowadays. Even for experienced security personnel, manual detection is a time-consuming and stressful task. Many academics have created automated frameworks for detecting suspicious and contraband data from X-ray scans of luggage. However, to our knowledge, no framework exists that utilizes temporal baggage X-ray imagery to effectively screen highly concealed and occluded objects which are barely visible even to the naked eye. To address this, we present a novel temporal fusion driven multi-scale residual fashioned encoder-decoder that takes series of consecutive scans as input and fuses them to generate distinct feature representations of the suspicious and non-suspicious baggage content, leading towards a more accurate extraction of the contraband data. The proposed methodology has been thoroughly tested using the publicly accessible GDXray dataset, which is the only dataset containing temporally linked grayscale X-ray scans showcasing extremely concealed contraband data. The proposed framework outperforms its competitors on the GDXray dataset on various metrics.