Toward Automatic Interpretation of 3D Plots
Not on the map. Why?
Abstract (arXiv)
This paper explores the challenge of teaching a machine how to reverse-engineer the grid-marked surfaces used to represent data in 3D surface plots of two-variable functions. These are common in scientific and economic publications; and humans can often interpret them with ease, quickly gleaning general shape and curvature information from the simple collection of curves. While machines have no such visual intuition, they do have the potential to accurately extract the more detailed quantitative data that guided the surface's construction. We approach this problem by synthesizing a new dataset of 3D grid-marked surfaces (SurfaceGrid) and training a deep neural net to estimate their shape. Our algorithm successfully recovers shape information from synthetic 3D surface plots that have had axes and shading information removed, been rendered with a variety of grid types, and viewed from a range of viewpoints.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 56 references that are in the map. First posted on arXiv 14 Jun 2021.
Builds on
11 of 56 references.
References · 11
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 434
- 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 201
- 2018Geometry-Aware Network for Non-Rigid Shape Prediction from a Single Viewcited by 15
- 2020Reverse-engineering Bar Charts Using Neural Networkscited by 8
- 2020Vid2Curve: Simultaneous Camera Motion Estimation and Thin Structure Reconstruction from an RGB Videocited by 3
Built on by
Citing papers per year: 2023: 1.
1 paper.