PanLUNA: An Efficient and Robust Query-Unified Multimodal Model for Edge Biosignal Intelligence
Not on the map. Why?
Abstract (arXiv)
Physiological foundation models (FMs) have shown promise for biosignal representation learning, yet most remain confined to a single modality such as EEG, ECG, or PPG, largely because paired multimodal datasets are scarce. In this paper, we present PanLUNA, a compact 5.4M-parameter pan-modal FM that jointly processes EEG, ECG, and PPG within a single shared encoder. Extending LUNA's channel-unification module, PanLUNA treats multimodal channels as entries in a unified query set augmented with sensor-type embeddings, enabling efficient cross-modal early fusion while remaining inherently robust to missing modalities at inference time. Despite its small footprint, PanLUNA matches or exceeds models up to 57× larger: 81.21% balanced accuracy on TUAB abnormal EEG detection and state-of-the-art 0.7416 balanced accuracy on HMC multimodal sleep staging. Quantization-aware training with INT8 weights recovers ≥96% of full-precision performance, and deployment on the GAP9 ultra-low-power RISC-V microcontroller for wearables achieves 325.6 ms latency and 18.8 mJ per 10-second, 12-lead ECG inference, and 1.206 s latency at 68.65 mJ for multimodal 5-channel sleep staging over 30-second epochs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 45 references that are in the map. First posted on arXiv 5 Apr 2026.
Builds on
22 of 45 references.
References · 22
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
- 2024PaPaGei: Open Foundation Models for Optical Physiological Signalscited by 69
- 2024Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancementcited by 67
- 2020Inter-database validation of a deep learning approach for automatic sleep scoringcited by 38
- 2025Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Modelcited by 36
- 2025LUNA: Efficient and Topology-Agnostic Foundation Model for EEG Signal Analysiscited by 26
- 2021Electrocardio Panorama: Synthesizing New ECG Views with Self-supervisioncited by 16
- 2025FEMBA: Efficient and Scalable EEG Analysis with a Bidirectional Mamba Foundation Modelcited by 16
10 more
- 2025From Token to Rhythm: A Multi-Scale Approach for ECG-Language Pretrainingcited by 16
- 2025CEReBrO: Compact Encoder for Representations of Brain Oscillations Using Efficient Alternating Attentioncited by 14
- 2024Promoting cross-modal representations to improve multimodal foundation models for physiological signalscited by 13
- 2025PhysioWave: A Multi-Scale Wavelet-Transformer for Physiological Signal Representationcited by 12
- 2025Towards Robust Multimodal Physiological Foundation Models: Handling Arbitrary Missing Modalitiescited by 11
- 2025TinyMyo: a Tiny Foundation Model for Flexible EMG Signal Processing at the Edgecited by 7
- 2020Choosing a sampling frequency for ECG QRS detection using convolutional networkscited by 3
- 2025Finetuning and Quantization of EEG-Based Foundational BioSignal Models on ECG and PPG Data for Blood Pressure Estimationcited by 1
- 2025PhysioME: A Robust Multimodal Self-Supervised Framework for Physiological Signals with Missing Modalitiescited by 1
- 2025Leveraging Foundational Models and Simple Fusion for Multi-modal Physiological Signal Analysiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Sense Less, Infer More: Agentic Multimodal Transformers for Edge Medical Intelligence
- 2025BioMamba: Leveraging Spectro-Temporal Embedding in Bidirectional Mamba for Enhanced Biosignal Classification
- 2026Multimodal LLMs Can Learn to Read Brain Signals: A Vision--Language Model for Unified Multi-Task EEG Decoding
- 2026Next-Token Prediction Learns Generalisable Representations of Sleep Physiology
- 2024EEG-Language Pretraining for Highly Label-Efficient Clinical Phenotyping
- 2024EEG-GPT: Exploring Capabilities of Large Language Models for EEG Classification and Interpretation
- 2026LuMamba: Latent Unified Mamba for Electrode Topology-Invariant and Efficient EEG Modeling
- 2026PRISM: Exploring Heterogeneous Pretrained EEG Foundation Model Transfer to Clinical Differential Diagnosis