# Towards a HIPAA Compliant Agentic AI System in Healthcare

arXiv: https://arxiv.org/abs/2504.17669 · HTML: https://mlsanity.com/paper/2504.17669/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- Builds on 4 of its 11 references that are in the map.
- First posted on arXiv 24 Apr 2025.

## Builds on (most cited first, 4 of 4)

- [Agentic LLM Workflows for Generating Patient-Friendly Medical Reports](https://mlsanity.com/paper/2408.01112/) (2024)
- [MedInsight: A Multi-Source Context Augmentation Framework for Generating Patient-Centric Medical Responses using Large Language Models](https://mlsanity.com/paper/2403.08607/) (2024)
- [CLINICSUM: Utilizing Language Models for Generating Clinical Summaries from Patient-Doctor Conversations](https://mlsanity.com/paper/2412.04254/) (2024)
- [An Agentic AI Workflow for Detecting Cognitive Concerns in Real-world Data](https://mlsanity.com/paper/2502.01789/) (2025)

## Built on by (most cited first, 8 of 8)

- [Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges](https://mlsanity.com/paper/2510.23883/) (2025)
- [LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarios](https://mlsanity.com/paper/2508.17692/) (2025)
- [A Survey on Agentic Security: Applications, Threats and Defenses](https://mlsanity.com/paper/2510.06445/) (2025)
- [Tiered Agentic Oversight: A Hierarchical Multi-Agent System for Healthcare Safety](https://mlsanity.com/paper/2506.12482/) (2025)
- [Agentic AI framework for End-to-End Medical Data Inference](https://mlsanity.com/paper/2507.18115/) (2025)
- [Federation of Agents: A Semantics-Aware Communication Fabric for Large-Scale Agentic AI](https://mlsanity.com/paper/2509.20175/) (2025)
- [Compiled AI: Deterministic Code Generation for LLM-Based Workflow Automation](https://mlsanity.com/paper/2604.05150/) (2026)
- [Constraint-aware Path Planning from Natural Language Instructions Using Large Language Models](https://mlsanity.com/paper/2603.19257/) (2026)

## Abstract (arXiv)

Agentic AI systems powered by Large Language Models (LLMs) as their foundational reasoning engine, are transforming clinical workflows such as medical report generation and clinical summarization by autonomously analyzing sensitive healthcare data and executing decisions with minimal human oversight. However, their adoption demands strict compliance with regulatory frameworks such as Health Insurance Portability and Accountability Act (HIPAA), particularly when handling Protected Health Information (PHI). This work-in-progress paper introduces a HIPAA-compliant Agentic AI framework that enforces regulatory compliance through dynamic, context-aware policy enforcement. Our framework integrates three core mechanisms: (1) Attribute-Based Access Control (ABAC) for granular PHI governance, (2) a hybrid PHI sanitization pipeline combining regex patterns and BERT-based model to minimize leakage, and (3) immutable audit trails for compliance verification.