# More than One Step at a Time: Designing Procedural Feedback for Non-visual Makeup Routines

arXiv: https://arxiv.org/abs/2507.03942 · HTML: https://mlsanity.com/paper/2507.03942/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 14 of its 60 references that are in the map.
- First posted on arXiv 5 Jul 2025.

## Builds on (most cited first, 14 of 14)

- [WorldScribe: Towards Context-Aware Live Visual Descriptions](https://mlsanity.com/paper/2408.06627/) (2024)
- [Understanding Visual Arts Experiences of Blind People](https://mlsanity.com/paper/2301.12687/) (2023)
- [A Contextual Inquiry of People with Vision Impairments in Cooking](https://mlsanity.com/paper/2402.15108/) (2024)
- [Non-Visual Cooking: Exploring Practices and Challenges of Meal Preparation by People with Visual Impairments](https://mlsanity.com/paper/2107.05783/) (2021)
- ["It Feels Like Taking a Gamble": Exploring Perceptions, Practices, and Challenges of Using Makeup and Cosmetics for People with Visual Impairments](https://mlsanity.com/paper/2203.08864/) (2022)
- [A Recipe for Success? Exploring Strategies for Improving Non-Visual Access to Cooking Instructions](https://mlsanity.com/paper/2407.19065/) (2024)
- ["We are at the mercy of others' opinion": Supporting Blind People in Recreational Window Shopping with AI-infused Technology](https://mlsanity.com/paper/2405.06611/) (2024)
- [OSCAR: Object Status and Contextual Awareness for Recipes to Support Non-Visual Cooking](https://mlsanity.com/paper/2503.05962/) (2025)
- [Smart Mirror: Intelligent Makeup Recommendation and Synthesis](https://mlsanity.com/paper/1709.07566/) (2017)
- ["I Choose Assistive Devices That Save My Face" A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in China](https://mlsanity.com/paper/2101.09348/) (2021)
- [Revamp: Enhancing Accessible Information Seeking Experience of Online Shopping for Blind or Low Vision Users](https://mlsanity.com/paper/2102.00576/) (2021)
- [How Users Who are Blind or Low Vision Play Mobile Games: Perceptions, Challenges, and Strategies](https://mlsanity.com/paper/2502.09866/) (2025)
- [Exploring a Makeup Support System for Transgender Passing based on Automatic Gender Recognition](https://mlsanity.com/paper/2103.04544/) (2021)
- [Exploring Object Status Recognition for Recipe Progress Tracking in Non-Visual Cooking](https://mlsanity.com/paper/2507.03330/) (2025)

## Built on by (most cited first, 2 of 2)

- [Lost in Instructions: Study of Blind Users' Experiences with DIY Manuals and AI-Rewritten Instructions for Assembly, Operation, and Troubleshooting of Tangible Products](https://mlsanity.com/paper/2602.18630/) (2026)
- [Bespoke Visual Assistance: What and How do Blind and Low-Vision People Create with Agentic Programming?](https://mlsanity.com/paper/2607.21760/) (2026)

## Abstract (arXiv)

Makeup plays a vital role in self-expression, identity, and confidence - yet remains an underexplored domain for assistive technology, especially for people with vision impairments. While existing tools support isolated tasks such as color identification or product labeling, they rarely address the procedural complexity of makeup routines: coordinating step sequences, managing product placement, and assessing the final look with accessible feedback. To understand the real-world process, we conducted a contextual inquiry with 15 visually impaired makeup users, capturing real-time makeup application behaviors and their step-by-step information needs and assessment approaches. Our findings reveal embodied, tactile-first strategies; persistent challenges in blending, symmetry, and assessment; and a desire for honest, real-time, goal-aligned feedback. We also interviewed five professional makeup artists, who reviewed participant makeup videos and provided expert responses to participant-raised questions and assessment practices. We contribute a taxonomy of feedback needs in non-visual makeup, and outline design implications for future assistive systems - emphasizing hands-free, conversational interaction and context-aware, procedural support for expressive and independent beauty practices.