mlsanityData to 13 Oct 2026

Lung-SRAD: Spectral-Aware Regularized Audio DASS with Dual-Axis Patch-Mix Contrastive Learning for Respiratory Sound Classification

arXiv 2606.11922 ↗First posted 10 Jun 2026cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent respiratory sound classification (RSC) studies largely rely on CLS-token driven self-attention architectures such as the Audio Spectrogram Transformer (AST). While effective at modeling global context, recent analyses suggest a low-pass filtering behavior that may reduce sensitivity to localized abnormal patterns. In this work, we investigate State Space Models (SSMs) as an alternative backbone for RSC. Using the Distilled Audio State Space model, we analyze intermediate representations through spectral response curves and observe stronger preservation of mid-to-high spatial-frequency components. Based on these observations, we introduce spectral-aware layer regularization using Gaussian convolution applied to selected layers. We further propose Dual-Axis Patch-Mix contrastive learning tailored to SSM-based audio models for robust representation learning. Experiments on the ICBHI benchmark show that our approach achieves 64.48% score, outperforming the AST baseline by 5%. Code is available at https://github.com/RSC-Toolkit/Lung-SRAD.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

22 of 31 references.

References · 22

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,093
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,658
  3. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,137
  4. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,359
  5. 2024VMamba: Visual State Space Modelcited by 963
  6. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 713
  7. 2021AST: Audio Spectrogram Transformercited by 639
  8. 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 384
  9. 2022HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detectioncited by 175
  10. 2022Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practicecited by 136
  11. 2023Patch-Mix Contrastive Learning with Audio Spectrogram Transformer on Respiratory Sound Classificationcited by 24
  12. 2024Masked Modeling Duo: Towards a Universal Audio Pre-training Frameworkcited by 23
10 more
  1. 2023Stethoscope-guided Supervised Contrastive Learning for Cross-domain Adaptation on Respiratory Sound Classificationcited by 16
  2. 2025Attention Sinks: A 'Catch, Tag, Release' Mechanism for Embeddingscited by 16
  3. 2024RepAugment: Input-Agnostic Representation-Level Augmentation for Respiratory Sound Classificationcited by 12
  4. 2024BTS: Bridging Text and Sound Modalities for Metadata-Aided Respiratory Sound Classificationcited by 12
  5. 2023Adversarial Fine-tuning using Generated Respiratory Sound to Address Class Imbalancecited by 11
  6. 2024DASS: Distilled Audio State Space Models Are Stronger and More Duration-Scalable Learnerscited by 7
  7. 2025Empowering Multimodal Respiratory Sound Classification with Counterfactual Adversarial Debiasing for Out-of-Distribution Robustnesscited by 4
  8. 2025Tri-MTL: A Triple Multitask Learning Approach for Respiratory Disease Diagnosiscited by 3
  9. 2025Improving Respiratory Sound Classification with Architecture-Agnostic Knowledge Distillation from Ensemblescited by 3
  10. 2025Patient-Aware Feature Alignment for Robust Lung Sound Classification:Cohesion-Separation and Global Alignment Lossescited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Zero-Shot Respiratory Sound Classification through LLM-Augmented Audio-Text Alignment
  2. 2021Robust Deep Learning Frameworks for Acoustic Scene and Respiratory Sound Classification
  3. 2025Full-Frequency Temporal Patching and Structured Masking for Enhanced Audio Classification
  4. 2026Adaptive Test-Time Scaling for Zero-Shot Respiratory Audio Classification
  5. 2020CNN-MoE based framework for classification of respiratory anomalies and lung disease detection ↗
  6. 2026Synthetic Data Augmentation for Medical Audio Classification: A Preliminary Evaluation
  7. 2026Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergy
  8. 2025Improving Speech Enhancement by Cross- and Sub-band Processing with State Space Model