mlsanityData to 14 Oct 2026

Three Modalities, Two Design Probes, One Prototype, and No Vision: Experience-Based Co-Design of a Multi-modal 3D Data Visualization Tool

arXiv 2604.09426 ↗First posted 10 Apr 2026cs.HC cs.AI cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

Three-dimensional (3D) data visualizations, such as surface plots, are vital in STEM fields from biomedical imaging to spectroscopy, yet remain largely inaccessible to blind and low-vision (BLV) people. To address this gap, we conducted an Experience-Based Co-Design with BLV co-designers with expertise in non-visual data representations to create an accessible, multi-modal, web-native visualization tool. Using a multi-phase methodology, our team of five BLV and one non-BLV researcher(s) participated in two iterative sessions, comparing a low-fidelity tactile probe with a high-fidelity digital prototype. This process produced a prototype with empirically grounded features, including reference sonification, stereo and volumetric audio, and configurable buffer aggregation, which our co-designers validated as improving analytic accuracy and learnability. In this study, we target core analytic tasks essential for non-visual 3D data exploration: orientation, landmark and peak finding, comparing local maxima versus global trends, gradient tracing, and identifying occluded or partially hidden features. Our work offers accessibility researchers and developers a co-design protocol for translating tactile knowledge to digital interfaces, concrete design guidance for future systems, and opportunities to extend accessible 3D visualization into embodied data environments.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 109 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

18 of 109 references.

References · 18

  1. 2021Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Contentcited by 39
  2. 2021What Do We Mean by "Accessibility Research"? A Literature Survey of Accessibility Papers in CHI and ASSETS from 1994 to 2019cited by 14
  3. 2022Rich Screen Reader Experiences for Accessible Data Visualizationcited by 12
  4. 2019Sociotechnical Considerations for Accessible Visualization Designcited by 5
  5. 2024Umwelt: Accessible Structured Editing of Multimodal Data Representationscited by 5
  6. 2024MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representationcited by 5
  7. 2021Technology Developments in Touch-Based Accessible Graphics: A Systematic Review of Research 2010-2020cited by 4
  8. 2025A11yShape: AI-Assisted 3-D Modeling for Blind and Low-Vision Programmerscited by 4
  9. 2020Shared Surfaces and Spaces: Collaborative Data Visualisation in a Co-located Immersive Environmentcited by 3
  10. 2024When Refreshable Tactile Displays Meet Conversational Agents: Investigating Accessible Data Presentation and Analysis with Touch and Speechcited by 3
  11. 2025TactileNet: Bridging the Accessibility Gap with AI-Generated Tactile Graphics for Individuals with Vision Impairmentcited by 3
  12. 2017FluxMarker: Enhancing Tactile Graphics with Dynamic Tactile Markerscited by 2
6 more
  1. 2024Erie: A Declarative Grammar for Data Sonificationcited by 2
  2. 2024ChartA11y: Designing Accessible Touch Experiences of Visualizations with Blind Smartphone Userscited by 2
  3. 2025Using Tactile Charts to Support Comprehension and Learning of Complex Visualizations for Blind and Low-Vision Individualscited by 2
  4. 2024Open Your Ears and Take a Look: A State-of-the-Art Report on the Integration of Sonification and Visualizationcited by 1
  5. 2024Intents, Techniques, and Components: a Unified Analysis of Interaction Authoring Tasks in Data Visualizationcited by 1
  6. 2025Explore, Listen, Inspect: Supporting Multimodal Interaction with 3D Surface and Point Data Visualizationscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.