Row-Column Scanned Neural Signed Distance Fields for Freehand 3D Ultrasound Imaging Shape Reconstruction

(MICCAI 2024 Best Paper Award)

Hongbo Chen, Yuchong Gao, Shuhang Zhang, Jiangjie Wu, Yuexin Ma, Rui Zheng,
ShanghaiTech University

Thoracic Vertebrae T8

Row scan

Column scan

RoCoSDF

Thoracic Vertebrae T12

Row scan

Column scan

RoCoSDF

Abstract

The reconstruction of high-quality shape geometry is crucial for developing freehand 3D ultrasound imaging. However, the shape reconstruction of multi-view ultrasound data remains challenging due to the elevation distortion caused by thick transducer probes.

In this paper, we present a novel learning-based framework RoCoSDF, which can effectively generate an implicit surface through continuous shape representations derived from row-column scanned datasets. In RoCoSDF, we encode the datasets from different views into the corresponding neural signed distance function (SDF) and then operate all SDFs in a normalized 3D space to restore the actual surface contour. Without requiring pre-training on large-scale ground truth shapes, our approach can synthesize a smooth and continuous signed distance field from multi-view SDFs to implicitly represent the actual geometry. Furthermore, two regularizers are introduced to facilitate shape refinement by constraining the SDF near the surface.

The experiments on twelve shapes data acquired by two ultrasound transducer probes validate that RoCoSDF can effectively reconstruct accurate geometric shapes from multi-view ultrasound data, which outperforms current reconstruction methods.

RoCoSDF Figure

Method

Our proposed method, RoCoSDF, consists of four key steps to achieve high-quality shape reconstruction from multi-view ultrasound data.
a) Row-Column SDFs Prediction. Separately encode the row/column shape to neural SDFs.
b) SDFs Fusion. Implicitly fuse an SDF field from row-column SDFs.
c) SDF Sampling & Refinement. Sample the data in SDF field for shape refinement.
d) 3D Mesh. Extract the 3D mesh from the optimized SDF using the Marching Cube algorithm.

方法示意图

Results

Thoracic Vertabra T4

方法示意图

Lumbar Vertabra L1

方法示意图
方法示意图

Volume Rendering V.S. Surface Rendering

方法示意图

In Progress Project

Modeling-based Multi-view Human Lumbar Spine Shape Reconstruction

方法示意图
方法示意图

BibTeX

          
            @InProceedings{chenRoCoSDF,
              author="Chen, Hongbo
              and Gao, Yuchong
              and Zhang, Shuhang
              and Wu, Jiangjie
              and Ma, Yuexin
              and Zheng, Rui",
              editor="Linguraru, Marius George
              and Dou, Qi
              and Feragen, Aasa
              and Giannarou, Stamatia
              and Glocker, Ben
              and Lekadir, Karim
              and Schnabel, Julia A.",
              title="RoCoSDF: Row-Column Scanned Neural Signed Distance Fields for Freehand 3D Ultrasound Imaging Shape Reconstruction",
              booktitle="Medical Image Computing and Computer Assisted Intervention -- MICCAI 2024",
              year="2024",
              publisher="Springer Nature Switzerland",
              address="Cham",
              pages="721--731",
              isbn="978-3-031-72083-3"
              }