GreaseVision: Rewriting the Rules of the Interface
Not on the map. Why?
Abstract (arXiv)
Digital harms can manifest across any interface. Key problems in addressing these harms include the high individuality of harms and the fast-changing nature of digital systems. As a result, we still lack a systematic approach to study harms and produce interventions for end-users. We put forward GreaseVision, a new framework that enables end-users to collaboratively develop interventions against harms in software using a no-code approach and recent advances in few-shot machine learning. The contribution of the framework and tool allow individual end-users to study their usage history and create personalized interventions. Our contribution also enables researchers to study the distribution of harms and interventions at scale.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 25 of its 98 references that are in the map. First posted on arXiv 7 Apr 2022.
Builds on
25 of 98 references.
References · 25
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
- 2020What is being transferred in transfer learning?cited by 368
- 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
- 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
- 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
- 2021A Survey of Human-in-the-loop for Machine Learningcited by 215
- 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 114
- 2021Exploring the Limits of Large Scale Pre-trainingcited by 104
- 2021On the Role of Neural Collapse in Transfer Learningcited by 100
13 more
- 2020ActionBert: Leveraging User Actions for Semantic Understanding of User Interfacescited by 43
- 2021Screen2Vec: Semantic Embedding of GUI Screens and GUI Componentscited by 41
- 2021Screen Parsing: Towards Reverse Engineering of UI Models from Screenshotscited by 32
- 2020'I Just Want to Hack Myself to Not Get Distracted': Evaluating Design Interventions for Self-Control on Facebookcited by 17
- 2021GUIGAN: Learning to Generate GUI Designs Using Generative Adversarial Networkscited by 17
- 2021GenNI: Human-AI Collaboration for Data-Backed Text Generationcited by 11
- 2020Optimizing User Interface Layouts via Gradient Descentcited by 6
- 2021Are iPhones Really Better for Privacy? Comparative Study of iOS and Android Appscited by 6
- 2018Third Party Tracking in the Mobile Ecosystemcited by 5
- 2021I Want My App That Way: Reclaiming Sovereignty Over Personal Devicescited by 4
- 2022Low-Loss Subspace Compression for Clean Gains against Multi-Agent Backdoor Attackscited by 4
- 2021Characteristics and Challenges of Low-Code Development: The Practitioners' Perspectivecited by 2
- 2021Mind-proofing Your Phone: Navigating the Digital Minefield with GreaseTerminatorcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1.
2 papers.