Text-based Tactile Graphics Generation for the Visually Impaired
Not on the map. Why?
Abstract (arXiv)
Tactile graphics are a primary medium for blind and low-vision (BLV) individuals to access non-textual information. However, they are difficult to scale or personalize. While recent generative models have revolutionized visual content creation, they are optimized for screen-based visual realism and fail to satisfy the haptic perceptual and physical fabrication constraints required for touch. We present the first integrated generative system that produces fabrication-ready 2.5D tactile graphics directly from natural language prompts, jointly generating global base geometry, fine-grained tactile surface textures, and standard-compliant braille within a unified 3D-printable representation. Our approach introduces fabrication-aware techniques, including template-guided relief generation, a fast diffusion-based text-to-texture module for high-resolution tileable normal maps, and strict base flattening to ensure tactile readability and printability, while supporting both automatic generation and interactive texture control. Extensive evaluations, together with in-person user studies with BLV participants and blindfolded sighted participants using physically 3D-printed outputs, show that participants consistently prefer our results over baselines. By extending generative graphics beyond screens to touchable reliefs, our work broadens access to generative AI for the BLV community and beyond.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 73 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
37 of 73 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2025Qwen-Image Technical Reportcited by 973
25 more
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
- 2025Native and Compact Structured Latents for 3D Generationcited by 157
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
- 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
- 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Modelscited by 50
- 2023MatFuse: Controllable Material Generation with Diffusion Modelscited by 39
- 2021GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Fingercited by 34
- 2024TexGaussian: Generating High-quality PBR Material via Octree-based 3D Gaussian Splattingcited by 28
- 2023Differential Diffusion: Giving Each Pixel Its Strengthcited by 27
- 2022SeamlessGAN: Self-Supervised Synthesis of Tileable Texture Mapscited by 19
- 2024Tiled Diffusioncited by 9
- 2023Controllable Visual-Tactile Synthesiscited by 8
- 2024TexTile: A Differentiable Metric for Texture Tileabilitycited by 7
- 2024Tactile DreamFusion: Exploiting Tactile Sensing for 3D Generationcited by 6
- 2023Generating Parametric BRDFs from Natural Language Descriptionscited by 3
- 2025TactileNet: Bridging the Accessibility Gap with AI-Generated Tactile Graphics for Individuals with Vision Impairmentcited by 3
- 2024Content-aware Tile Generation using Exterior Boundary Inpaintingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Touching and Feeling the Data: A Reusable Software Pipeline for Tactile Statistical Graphs in Accessible Education ↗
- 2024TextToucher: Fine-Grained Text-to-Touch Generation
- 2023Learning to Read Braille: Bridging the Tactile Reality Gap with Diffusion Models
- 2024ChartFormer: A Large Vision Language Model for Converting Chart Images into Tactile Accessible SVGs
- 2025ControlTac: Scaling Tactile Data with Physically Controlled Tactile Image Generation
- 2023Generating Visual Scenes from Touch
- 2026VQ-Touch: A Data-Efficient Tactile Generation Framework Across Sensors and Scenarios
- 2024Vision-based Tactile Image Generation via Contact Condition-guided Diffusion Model