mlsanityData to 7 Oct 2026

RayEmb: Arbitrary Landmark Detection in X-Ray Images Using Ray Embedding Subspace

arXiv 2410.08152 ↗First posted 10 Oct 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Intra-operative 2D-3D registration of X-ray images with pre-operatively acquired CT scans is a crucial procedure in orthopedic surgeries. Anatomical landmarks pre-annotated in the CT volume can be detected in X-ray images to establish 2D-3D correspondences, which are then utilized for registration. However, registration often fails in certain view angles due to poor landmark visibility. We propose a novel method to address this issue by detecting arbitrary landmark points in X-ray images. Our approach represents 3D points as distinct subspaces, formed by feature vectors (referred to as ray embeddings) corresponding to intersecting rays. Establishing 2D-3D correspondences then becomes a task of finding ray embeddings that are close to a given subspace, essentially performing an intersection test. Unlike conventional methods for landmark estimation, our approach eliminates the need for manually annotating fixed landmarks. We trained our model using the synthetic images generated from CTPelvic1K CLINIC dataset, which contains 103 CT volumes, and evaluated it on the DeepFluoro dataset, comprising real X-ray images. Experimental results demonstrate the superiority of our method over conventional methods. The code is available at https://github.com/Pragyanstha/rayemb.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 10 Oct 2024.

Builds on

29 of 42 references.

References · 29

  1. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  5. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  6. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
  7. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
  8. 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
  9. 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
  10. 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
  11. 2017BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depthcited by 225
  12. 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
17 more
  1. 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
  2. 2019DPOD: 6D Pose Object Detector and Refinercited by 189
  3. 2020EPOS: Estimating 6D Pose of Objects with Symmetriescited by 147
  4. 2018MAGSAC: marginalizing sample consensuscited by 122
  5. 2023GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondencecited by 113
  6. 2021SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddingscited by 95
  7. 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
  8. 2020SAM: Self-supervised Learning of Pixel-wise Anatomical Embeddings in Radiological Imagescited by 66
  9. 2020EfficientPose: An efficient, accurate and scalable end-to-end 6D multi object pose estimation approachcited by 46
  10. 2020Deep Learning to Segment Pelvic Bones: Large-scale CT Datasets and Baseline Modelscited by 45
  11. 2022Fast Auto-Differentiable Digitally Reconstructed Radiographs for Solving Inverse Problems in Intraoperative Imagingcited by 37
  12. 2019Automatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registrationcited by 29
  13. 2018Deep-6DPose: Recovering 6D Object Pose from a Single RGB Imagecited by 26
  14. 2023Intraoperative 2D/3D Image Registration via Differentiable X-ray Renderingcited by 24
  15. 2018X-ray-transform Invariant Anatomical Landmark Detection for Pelvic Trauma Surgerycited by 22
  16. 2021SAME: Deformable Image Registration based on Self-supervised Anatomical Embeddingscited by 21
  17. 2023X-Ray to CT Rigid Registration Using Scene Coordinate Regressioncited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

  1. 2025Intraoperative 2D/3D Registration via Spherical Similarity Learning and Differentiable Levenberg-Marquardt Optimizationcited by 1
  2. 2026LayersReg: A Layer-by-Layer Progressive Regressor for Reliable Intraoperative 3D/2D Registrationcited by 1
  3. 2025Rapid patient-specific neural networks for intraoperative X-ray to volume registrationcited by 0
  4. 2026Learning Dense 2D-3D Correspondence for X-ray-to-CT Registration of Knee Bonescited by 0
  5. 2026Patient-Agnostic Synthetic Pretraining for Efficient Patient-Specific Intraoperative 2D/3D Registrationcited by 0
  6. 2026FleXray: Universal Clinical X-ray Segmentationcited by 0