Research


-Current-

  • Neural Implicit Surface/Shape Reconstruction for 3D Ultrasound Imaging, Sep 2023 - present

    Currently, I mainly focus on the surface/shape reconstruction to improve the geometric quality and visualization appearance of the 3D ultrasound volume. Traditional methods, such as ISO-Surface and Poisson surface reconstruction, cannot produce a high-quality surface due to image noise. Despite improvements in smoothness, continuity, and resolution by deep learning approaches, research on surface reconstruction in freehand 3D ultrasound is still missing. However, deep learning-based approaches are challenging for 3D ultrasound due to the difficult-to-extract boundaries and unavailable large-scale training data or templates. In this project, we propose a self-supervised neural implicit surface/shape reconstruction method to learn (un)signed distance functions (SDF, UDF) from ultrasound volumes. The proposed method demonstrates its adaptability to various anatomical structures and improved high-resolution visual quality.

Framework

-Ongoing Projects-

  • Development of Portable Freehand 3D Ultrasound Imaging Systems, Sep 2019 - Present

    This project aims to build portable freehand 3D ultrasound imaging systems for various applications. The development of freehand 3D ultrasound imaging system is a rapid advancing technology to obtain the high-quality 3D volumes without the limitation of field-of-view. Such imaging system commonly compounds the collected 2D B-mode images from the transducer and the corresponding 3D poses from the tracking device into a volume to reconstruct the 3D internal structures of the human body. The system can be built following two main positioning strategies: 1) Electromagnetic tracking and 2) Optical tracking. The electromagnetic tracking method is simple to use, flexible to install, and low-cost, but it is limited by accuracy and magnetic field interference. The optical tracking method has the advantages of high accuracy and stable positioning, but it is easily affected by occlusion.

    In this project, we design our systems according to different clinical scenarios. We customize a Windows client for data collection, image processing and visualization.

    1) 3D Spine imaging system. A wireless convex ultrasound scanner (5 MHz) and an EM tracking device are used to build this system.

    2) 3D Photoacoustic Imaging System. A linear array ultrasound scanner (7.5 MHz) and an EM tracking device are used to build this system.

    3) 3D Carotid artery imaging system. A linear array ultrasound scanner (10 MHz) and an EM tracking device are used to build this system.

    4) 3D Intraoral Imaging System. An in-house designed high-frequency ultrasound transducer (20 MHz) and an optical tracking device are combined to build this system. I finished this project in University of Alberta supervised by Dr. Lawrence H Le during my visiting in 2023.

Framework
Framework
A volunteer is being scanned using 3D spine imaging system
——Customized Windows Client by Hongbo Chen

-Past Projects-

  • Automatic Assessment System for Spine Deformity using Freehand 3D Ultrasound Imager, Nov 2021 - Aug 2023

    This project aims to establish a general assessment framework to automatically estimate spinal deformity in ultrasound spine images. The proposed framework comprises four major components, a US spine image generator, a novel transformer-based lightweight spine detector network, an angle evaluator, and a 3-D modeler. This framework can be easily applied in the current large-scale scoliosis screening setup without radiation and demonstrate the potential of automatic 3-D parametric modeling for 3-D deformity visualization.

Framework
  • Fast Reconstruction of Freehand 3D Ultrasound Spine Imaging, 2018 - 2021

    This project is my first project at ShanghaiTech University. The purpose is to design a general accelerator that can accelerate existing traditional reconstruction algorithms. For large field-of-view 3-D ultrasound reconstruction such as spine imaging, 2-D transverse images and the corresponding spatial information are acquired by the ultrasound probe with a tracking sensor. In general, the number of 2-D images could be as high as 2000 depending on the scan length. Therefore, the process of fusing the data into a 3-D volume is time-consuming. To overcome this problem, we propose the Fast-Dot Projection (FDP) method, which simplifies the projection process in reconstruction by replacing a complex vector operation with numerical addition. The proposed method has the following advantages: (1) it can be adapted to various traditional reconstruction algorithms such as Voxel-based back mapping or Pixel-based forward mapping; (2) the fusion speed is fast, for example, the time of rebuilding a full spine image can drop to 26 sec when only using CPU; (3) the reduction (up to 5 times faster than conventional algorithms based on complex vector calculation) of computation cost permits real-time visualization during scanning, which enables clinical diagnosis and assessment possible at the point of care.

Pipeline