v-net
Understanding Vector-Valued Neural Networks and Their Relationship with Real and Hypercomplex-Valued Neural Networks
Despite the many successful applications of deep learning models for multidimensional signal and image processing, most traditional neural networks process data represented by (multidimensional) arrays of real numbers. The intercorrelation between feature channels is usually expected to be learned from the training data, requiring numerous parameters and careful training. In contrast, vector-valued neural networks are conceived to process arrays of vectors and naturally consider the intercorrelation between feature channels. Consequently, they usually have fewer parameters and often undergo more robust training than traditional neural networks. This paper aims to present a broad framework for vector-valued neural networks, referred to as V-nets. In this context, hypercomplex-valued neural networks are regarded as vector-valued models with additional algebraic properties. Furthermore, this paper explains the relationship between vector-valued and traditional neural networks. Precisely, a vector-valued neural network can be obtained by placing restrictions on a real-valued model to consider the intercorrelation between feature channels. Finally, we show how V-nets, including hypercomplex-valued neural networks, can be implemented in current deep-learning libraries as real-valued networks.
- South America > Brazil > São Paulo > Campinas (0.04)
- North America > United States > New York (0.04)
- North America > United States > California (0.04)
- (3 more...)
Dual-Domain Reconstruction Networks with V-Net and K-Net for fast MRI
Liu, Xiaohan, Pang, Yanwei, Jin, Ruiqi, Liu, Yu, Wang, Zhenchang
Purpose: To introduce a dual-domain reconstruction network with V-Net and K-Net for accurate MR image reconstruction from undersampled k-space data. Methods: Most state-of-the-art reconstruction methods apply U-Net or cascaded U-Nets in image domain and/or k-space domain. Nevertheless, these methods have following problems: (1) Directly applying U-Net in k-space domain is not optimal for extracting features in k-space domain; (2) Classical image-domain oriented U-Net is heavy-weight and hence is inefficient to be cascaded many times for yielding good reconstruction accuracy; (3) Classical image-domain oriented U-Net does not fully make use information of encoder network for extracting features in decoder network; and (4) Existing methods are ineffective in simultaneously extracting and fusing features in image domain and its dual k-space domain. To tackle these problems, we propose in this paper (1) an image-domain encoder-decoder sub-network called V-Net which is more light-weight for cascading and effective in fully utilizing features in the encoder for decoding, (2) a k-space domain sub-network called K-Net which is more suitable for extracting hierarchical features in k-space domain, and (3) a dual-domain reconstruction network where V-Nets and K-Nets are parallelly and effectively combined and cascaded. Results: Extensive experimental results on the challenging fastMRI dataset demonstrate that the proposed KV-Net can reconstruct high-quality images and outperform current state-of-the-art approaches with fewer parameters. Conclusions: To reconstruct images effectively and efficiently from incomplete k-space data, we have presented a parallel dual-domain KV-Net to combine K-Nets and V-Nets. The KV-Net is more lightweight than state-of-the-art methods but achieves better reconstruction performance.
Dilated deeply supervised networks for hippocampus segmentation in MRI
Folle, Lukas, Vesal, Sulaiman, Ravikumar, Nishant, Maier, Andreas
Tissue loss in the hippocampi has been heavily correlated with the progression of Alzheimer's Disease (AD). The shape and structure of the hippocampus are important factors in terms of early AD diagnosis and prognosis by clinicians. However, manual segmentation of such subcortical structures in MR studies is a challenging and subjective task. In this paper, we investigate variants of the well known 3D U-Net, a type of convolution neural network (CNN) for semantic segmentation tasks. We propose an alternative form of the 3D U-Net, which uses dilated convolutions and deep supervision to incorporate multi-scale information into the model. The proposed method is evaluated on the task of hippocampus head and body segmentation in an MRI dataset, provided as part of the MICCAI 2018 segmentation decathlon challenge. The experimental results show that our approach outperforms other conventional methods in terms of different segmentation accuracy metrics.
- North America > Canada > Alberta > Census Division No. 13 > Woodlands County (0.04)
- Europe > Germany > Bavaria > Middle Franconia > Nuremberg (0.04)
Tug the Student to Learn Right: Progressive Gradient Correcting by Meta-learner on Corrupted Labels
Shu, Jun, Xie, Qi, Yi, Lixuan, Zhao, Qian, Zhou, Sanping, Xu, Zongben, Meng, Deyu
While deep networks have strong fitting capability to complex input patterns, they can easily overfit tobiased training data with corrupted labels. Sample reweighting strategy is commonly used to alleviate this robust learning issue, through imposing zeroor possibly smaller weights to corrupted samples to suppress their negative influence to learning. Current reweighting algorithms, however, needelaborate tuning of additional hyperparameters orcareful designing of complex metalearner for learning to assign weights on samples. To address these issues, we propose a new metalearning methodwith few tuned hyper-parameters and simple structure of a meta-learner (one hidden layer MLP network). Guided by a small amount of unbiased metadata, the parameters of the proposed meta-learnercan be gradually evolved for finely tugging the classifier gradient approaching tothe right direction. This learning manner complies with a real teaching progress: A good teacher should more respect the student's own learning manner and help progressively correct his learning bias based on his/her current learning status.Experimental results substantiate the robustness of the new algorithm on corrupted label cases,as well as its stability and efficiency in learning. The dream begins with a teacher who believes in you, who tugs and pushes and leads you to the next plateau, sometimes pokingyou with a sharp stick called truth.
- Asia > China > Shaanxi Province > Xi'an (0.05)
- North America > United States (0.04)