tunet
A Transformer-based Network for Deformable Medical Image Registration
Wang, Yibo, Qian, Wen, Zhang, Xuming
Deformable medical image registration plays an important role in clinical diagnosis and treatment. Recently, the deep learning (DL) based image registration methods have been widely investigated and showed excellent performance in computational speed. However, these methods cannot provide enough registration accuracy because of insufficient ability in representing both the global and local features of the moving and fixed images. To address this issue, this paper has proposed the transformer based image registration method. This method uses the distinctive transformer to extract the global and local image features for generating the deformation fields, based on which the registered image is produced in an unsupervised way. Our method can improve the registration accuracy effectively by means of self-attention mechanism and bi-level information flow. Experimental results on such brain MR image datasets as LPBA40 and OASIS-1 demonstrate that compared with several traditional and DL based registration methods, our method provides higher registration accuracy in terms of dice values.
End-to-End Cascaded U-Nets with a Localization Network for Kidney Tumor Segmentation
Vu, Minh H., Grimbergen, Guus, Simkó, Attila, Nyholm, Tufve, Löfstedt, Tommy
Kidney tumor segmentation emerges as a new frontier of computer vision in medical imaging. This is partly due to its challenging manual annotation and great medical impact. Within the scope of the Kidney Tumor Segmentation Challenge 2019, that is aiming at combined kidney and tumor segmentation, this work proposes a novel combination of 3D U-Nets--collectively denoted TuNet--utilizing the resulting kidney masks for the consecutive tumor segmentation. The proposed method achieves a Sørensen-Dice coefficient score of 0.902 for the kidney, and 0.408 for the tumor segmentation, computed from a fivefold cross-validation on the 210 patients available in the data. 1 Introduction Kidney cancer has an annual worldwide prevalence of over 400 000 new cases, with over 175 000 deaths in 2018 [1]. The most common type of kidney cancer is renal cell carcinoma (RCC) [10]. In Sweden, the indicidence of RCC is 1 125 per 100 000 people, with a 0.75 % risk of developing or dying from the disease [2].
TUNet: Incorporating segmentation maps to improve classification
Determining the localization of specific protein in human cells is important for understanding cellular functions and biological processes of underlying diseases. Among imaging techniques, high-throughput fluorescence microscopy imaging is an efficient biotechnology to stain the protein of interest in a cell. In this work, we present a novel classification model Twin U-Net (TUNet) for processing and classifying the belonging of protein in the Atlas images. Several notable Deep Learning models including GoogleNet and Resnet have been employed for comparison. Results have shown that our system obtaining competitive performance.