Logi-PAR: Logic-Infused Patient Activity Recognition via Differentiable Rule
Not on the map. Why?
Abstract (arXiv)
Patient Activity Recognition (PAR) in clinical settings uses activity data to improve safety and quality of care. Although significant progress has been made, current models mainly identify which activity is occurring. They often spatially compose sub-sparse visual cues using global and local attention mechanisms, yet only learn logically implicit patterns due to their neural-pipeline. Advancing clinical safety requires methods that can infer why a set of visual cues implies a risk, and how these can be compositionally reasoned through explicit logic beyond mere classification. To address this, we proposed Logi-PAR, the first Logic-Infused Patient Activity Recognition Framework that integrates contextual fact fusion as a multi-view primitive extractor and injects neural-guided differentiable rules. Our method automatically learns rules from visual cues, optimizing them end-to-end while enabling the implicit emergence patterns to be explicitly labelled during training. To the best of our knowledge, Logi-PAR is the first framework to recognize patient activity by applying learnable logic rules to symbolic mappings. It produces auditable why explanations as rule traces and supports counterfactual interventions (e.g., risk would decrease by 65% if assistance were present). Extensive evaluation on clinical benchmarks (VAST and OmniFall) demonstrates state-of-the-art performance, significantly outperforming Vision-Language Models and transformer baselines. The code is available via: https://github.com/zararkhan985/Logi-PAR.git}
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 39 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
30 of 39 references.
References · 30
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
- 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 528
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 422
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
- 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 370
- 2021ActionCLIP: A New Paradigm for Video Action Recognitioncited by 320
- 2022Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Datacited by 75
- 2024VidHalluc: Evaluating Temporal Hallucinations in Multimodal Large Language Models for Video Understandingcited by 68
- 2024VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledgecited by 50
18 more
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
- 2025MedHallu: A Comprehensive Benchmark for Detecting Medical Hallucinations in Large Language Modelscited by 34
- 2024TILP: Differentiable Learning of Temporal Logical Rules on Knowledge Graphscited by 22
- 2022Unsupervised Video Domain Adaptation for Action Recognition: A Disentanglement Perspectivecited by 21
- 2024VisionUnite: A Vision-Language Foundation Model for Ophthalmology Enhanced with Clinical Knowledgecited by 19
- 2025OmniV-Med: Scaling Medical Vision-Language Model for Universal Visual Understandingcited by 17
- 2025The CASTLE 2024 Dataset: Advancing the Art of Multimodal Understandingcited by 16
- 2024NeSyCoCo: A Neuro-Symbolic Concept Composer for Compositional Generalizationcited by 13
- 2023Learning Differentiable Logic Programs for Abstract Visual Reasoningcited by 12
- 2023Unsupervised Video Domain Adaptation with Masked Pre-Training and Collaborative Self-Trainingcited by 12
- 2024Using Large Language Models to Compare Explainable Models for Smart Home Human Activity Recognitioncited by 9
- 2025NeuS-QA: Grounding Long-Form Video Understanding in Temporal Logic and Neuro-Symbolic Reasoningcited by 8
- 2024Continuous Patient Monitoring with AI: Real-Time Analysis of Video in Hospital Care Settingscited by 4
- 2025EMRRG: Efficient Fine-Tuning Pre-trained X-ray Mamba Networks for Radiology Report Generationcited by 3
- 2025Vision Language Models for Dynamic Human Activity Recognition in Healthcare Settingscited by 2
- 2026Differentiable Rule Induction from Raw Sequence Inputscited by 2
- 2024MedLogic-AQA: Enhancing Medical Question Answering with Abstractive Models Focusing on Logical Structurescited by 1
- 2025Cross-Modal Dual-Causal Learning for Long-Term Action Recognitioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Benchmarking Egocentric Clinical Intent Understanding Capability for Medical Multimodal Large Language Models
- 2023From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models
- 2026HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Care
- 2026Vital Trace: Protocol-Constrained Patient-State Reasoning for Longitudinal Clinical Trajectories
- 2026XAI-MeD: Explainable Knowledge Guided Neuro-Symbolic Framework for Domain Generalization and Rare Class Detection in Medical Imaging
- 2025OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoning
- 2026Detecting Clinical Discrepancies in Health Coaching Agents: A Dual-Stream Memory and Reconciliation Architecture
- 2024Critique of Impure Reason: Unveiling the reasoning behaviour of medical Large Language Models