PhysScene: A Scene Graph Dataset for Scientific Visual Reasoning in Physics Experiments
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Scene Graphs (SGs) provide structured representations of visual scenes by modeling objects and their pairwise relationships. Despite recent progress, existing datasets primarily focus on generic natural contexts, leaving domain-specific and function-oriented scenes largely underexplored. This limitation restricts the evaluation of relational reasoning in scientific experimental scenes, thereby hindering the development of intelligent monitoring, analysis, and related applications in such scenes. To address this gap, we introduce PhysScene, the first SG dataset tailored to physics experiments. PhysScene encompasses specialized instruments, structured experimental setups, and functional relations intrinsic to experimental environments, enabling reasoning that extends beyond spatial co-occurrence to logical dependencies. Rather than pursuing large data scale, PhysScene focuses on strong semantic constraints and high relation density in experimental scenes, posing new challenges for existing scene parsing algorithms while offering opportunities for further improvements. Extensive analyses and experiments show that PhysScene complements existing benchmarks and establishes a valuable testbed for advancing scientific visual reasoning. The dataset is publicly available at https://github.com/ZMH-SDUST/PhysScene.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 15 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
12 of 15 references.
References · 12
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2017Scene Graph Generation by Iterative Message Passingcited by 462
- 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 414
- 2020Unbiased Scene Graph Generation from Biased Trainingcited by 356
- 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
- 2019SpatialSense: An Adversarially Crowdsourced Benchmark for Spatial Relation Recognitioncited by 55
- 2022Towards Open-vocabulary Scene Graph Generation with Prompt-based Finetuningcited by 54
- 2022Review on Panoramic Imaging and Its Applications in Scene Understandingcited by 43
- 2024STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagerycited by 31
- 2022SR-GNN: Spatial Relation-aware Graph Neural Network for Fine-Grained Image Categorizationcited by 21
- 2023Haystack: A Panoptic Scene Graph Dataset to Evaluate Rare Predicate Classescited by 8
- 2025PhysLab: A Benchmark Dataset for Multi-Granularity Visual Parsing of Physics Experimentscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Modeling Scientific Experiment Scenes: Dataset and Modelcited by 0
- 2026Modeling Scientific Experiment Scenes: Dataset and Model3 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026PhysGraph: A Physics-aware 3D Scene Graph for Perception and Reasoning
- 2025CoPa-SG: Dense Scene Graphs with Parametric and Proto-Relations
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite
- 2026Towards Physics-Faithful Generation of Scientific Diagrams
- 2025Seeing is Not Reasoning: MVPBench for Graph-based Evaluation of Multi-path Visual Physical CoT
- 2026HyperVis: Continuous Latent Visual Relational Graphs on the Lorentz Hyperboloid for Compositional Reasoning
- 2025SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoning
- 2026FunFact: Building Probabilistic Functional 3D Scene Graphs via Factor-Graph Reasoning