mlsanityData to 7 Oct 2026

AspirinSum: an Aspect-based utility-preserved de-identification Summarization framework

arXiv 2406.13947 ↗First posted 20 Jun 2024cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Due to the rapid advancement of Large Language Model (LLM), the whole community eagerly consumes any available text data in order to train the LLM. Currently, large portion of the available text data are collected from internet, which has been thought as a cheap source of the training data. However, when people try to extend the LLM's capability to the personal related domain, such as healthcare or education, the lack of public dataset in these domains make the adaption of the LLM in such domains much slower. The reason of lacking public available dataset in such domains is because they usually contain personal sensitive information. In order to comply with privacy law, the data in such domains need to be de-identified before any kind of dissemination. It had been much research tried to address this problem for the image or tabular data. However, there was limited research on the efficient and general de-identification method for text data. Most of the method based on human annotation or predefined category list. It usually can not be easily adapted to specific domains. The goal of this proposal is to develop a text de-identification framework, which can be easily adapted to the specific domain, leverage the existing expert knowledge without further human annotation. We propose an aspect-based utility-preserved de-identification summarization framework, AspirinSum, by learning to align expert's aspect from existing comment data, it can efficiently summarize the personal sensitive document by extracting personal sensitive aspect related sub-sentence and de-identify it by substituting it with similar aspect sub-sentence. We envision that the de-identified text can then be used in data publishing, eventually publishing our de-identified dataset for downstream task use.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 110 references that are in the map. First posted on arXiv 20 Jun 2024.

Builds on

44 of 110 references.

References · 44

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  6. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  7. 2017Graph Attention Networkscited by 8,854
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  9. 2017Neural Discrete Representation Learningcited by 4,650
  10. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  11. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  12. 2020Extracting Training Data from Large Language Modelscited by 2,144
32 more
  1. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  2. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
  3. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  4. 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 415
  5. 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 194
  6. 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 128
  7. 2020DP-CGAN: Differentially Private Synthetic Data and Label Generationcited by 118
  8. 2020GS-WGAN: A Gradient-Sanitized Approach for Learning Differentially Private Generatorscited by 117
  9. 2021Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?cited by 91
  10. 2016De-identification of Patient Notes with Recurrent Neural Networkscited by 88
  11. 2020DP-MERF: Differentially Private Mean Embeddings with Random Features for Practical Privacy-Preserving Data Generationcited by 78
  12. 2020Extractive Opinion Summarization in Quantized Transformer Spacescited by 76
  13. 2018Summarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervisedcited by 75
  14. 2022Prompted Opinion Summarization with GPT-3.5cited by 44
  15. 2020OpinionDigest: A Simple Framework for Opinion Summarizationcited by 37
  16. 2024LLM Augmented LLMs: Expanding Capabilities through Compositioncited by 35
  17. 2017ALICE: Towards Understanding Adversarial Learning for Joint Distribution Matchingcited by 32
  18. 2019Earlier Isn't Always Better: Sub-aspect Analysis on Corpus and System Biases in Summarizationcited by 28
  19. 2014C-sanitized: a privacy model for document redaction and sanitizationcited by 27
  20. 2018Natural Language Generation for Electronic Health Recordscited by 27
  21. 2020Snippext: Semi-supervised Opinion Mining with Augmented Datacited by 26
  22. 2019Towards Automatic Generation of Shareable Synthetic Clinical Notes Using Neural Language Modelscited by 20
  23. 2020A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detectioncited by 13
  24. 2017W2VLDA: Almost Unsupervised System for Aspect Based Sentiment Analysiscited by 12
  25. 2019Weakly-Supervised Opinion Summarization by Leveraging External Informationcited by 11
  26. 2023Large-Scale and Multi-Perspective Opinion Summarization with Diverse Review Subsetscited by 10
  27. 2019Automatic end-to-end De-identification: Is high accuracy the only metric?cited by 4
  28. 2021Multi-Perspective Abstractive Answer Summarizationcited by 4
  29. 2019Obfuscation for Privacy-preserving Syntactic Parsingcited by 3
  30. 2021De-identification of Unstructured Clinical Texts from Sequence to Sequence Perspectivecited by 2
  31. 2022Attend to the Right Context: A Plug-and-Play Module for Content-Controllable Summarizationcited by 2
  32. 2015Privacy-Preserving Multi-Document Summarizationcited by 1

Built on by

Not cited yet.