Tian, Qiyuan
Artificial Intelligence without Restriction Surpassing Human Intelligence with Probability One: Theoretical Insight into Secrets of the Brain with AI Twins of the Brain
Huang, Guang-Bin, Westover, M. Brandon, Tan, Eng-King, Wang, Haibo, Cui, Dongshun, Ma, Wei-Ying, Wang, Tiantong, He, Qi, Wei, Haikun, Wang, Ning, Tian, Qiyuan, Lam, Kwok-Yan, Yao, Xin, Wong, Tien Yin
Artificial Intelligence (AI) has apparently become one of the most important techniques discovered by humans in history while the human brain is widely recognized as one of the most complex systems in the universe. One fundamental critical question which would affect human sustainability remains open: Will artificial intelligence (AI) evolve to surpass human intelligence in the future? This paper shows that in theory new AI twins with fresh cellular level of AI techniques for neuroscience could approximate the brain and its functioning systems (e.g. perception and cognition functions) with any expected small error and AI without restrictions could surpass human intelligence with probability one in the end. This paper indirectly proves the validity of the conjecture made by Frank Rosenblatt 70 years ago about the potential capabilities of AI, especially in the realm of artificial neural networks. Intelligence is just one of fortuitous but sophisticated creations of the nature which has not been fully discovered. Like mathematics and physics, with no restrictions artificial intelligence would lead to a new subject with its self-contained systems and principles. We anticipate that this paper opens new doors for 1) AI twins and other AI techniques to be used in cellular level of efficient neuroscience dynamic analysis, functioning analysis of the brain and brain illness solutions; 2) new worldwide collaborative scheme for interdisciplinary teams concurrently working on and modelling different types of neurons and synapses and different level of functioning subsystems of the brain with AI techniques; 3) development of low energy of AI techniques with the aid of fundamental neuroscience properties; and 4) new controllable, explainable and safe AI techniques with reasoning capabilities of discovering principles in nature.
Improved Unet brain tumor image segmentation based on GSConv module and ECA attention mechanism
Tian, Qiyuan, Wang, Zhuoyue, Cui, Xiaoling
An improved model of medical image segmentation for brain tumor is discussed, which is a deep learning algorithm based on U-Net architecture. Based on the traditional U-Net, we introduce GSConv module and ECA attention mechanism to improve the performance of the model in medical image segmentation tasks. With these improvements, the new U-Net model is able to extract and utilize multi-scale features more efficiently while flexibly focusing on important channels, resulting in significantly improved segmentation results. During the experiment, the improved U-Net model is trained and evaluated systematically. By looking at the loss curves of the training set and the test set, we find that the loss values of both rapidly decline to the lowest point after the eighth epoch, and then gradually converge and stabilize. This shows that our model has good learning ability and generalization ability. In addition, by monitoring the change in the mean intersection ratio (mIoU), we can see that after the 35th epoch, the mIoU gradually approaches 0.8 and remains stable, which further validates the model. Compared with the traditional U-Net, the improved version based on GSConv module and ECA attention mechanism shows obvious advantages in segmentation effect. Especially in the processing of brain tumor image edges, the improved model can provide more accurate segmentation results. This achievement not only improves the accuracy of medical image analysis, but also provides more reliable technical support for clinical diagnosis.
Enhance the Image: Super Resolution using Artificial Intelligence in MRI
Li, Ziyu, Li, Zihan, Li, Haoxiang, Fan, Qiuyun, Miller, Karla L., Wu, Wenchuan, Chaudhari, Akshay S., Tian, Qiyuan
Abstract: This chapter provides an overview of deep learning techniques for improving the spatial resolution of MRI, ranging from convolutional neural networks, generative adversarial networks, to more advanced models including transformers, diffusion models, and implicit neural representations. Our exploration extends beyond the methodologies to scrutinize the impact of super-resolved images on clinical and neuroscientific assessments. We also cover various practical topics such as network architectures, image evaluation metrics, network loss functions, and training data specifics--including downsampling methods for simulating lowresolution images and dataset selection. Finally, we discuss existing challenges and potential future directions regarding the feasibility and reliability of deep learning-based MRI superresolution, with the aim to facilitate its wider adoption to benefit various clinical and neuroscientific applications. Keywords: Single-image super-resolution, deep learning, convolutional neural network, generative adversarial network, transformer, diffusion model, implicit neural representation, loss function, transfer learning, uncertainty estimation. Introduction MRI with higher spatial resolution provides more detailed insights into the structure and function of living human bodies non-invasively, which is highly desirable for accurate clinical diagnosis and image analysis. The spatial resolution of MRI is characterized by in-plane and through-plane resolutions (Figure 1). On the other hand, the through-plane resolution, also referred to as slice thickness, is determined differently for 2D and 3D imaging. In 2D imaging, the slice thickness is defined by the full width at half maximum (FWHM) of the slice-selection radiofrequency (RF) pulse profile. In 3D imaging, the slice-selection direction is encoded by another phase encoding gradient. Consequently, the through-plane resolution is determined similarly to the in-plane resolution by the maximal extent of the k-space along slice-selection direction as in Eq. 1. The in-plane resolution is dictated by the k-space coverage, and a larger k-space coverage brings higher spatial resolution (a). The slice thickness is determined by the slice-selective RF pulse for 2D imaging, and by k-space extent along sliceselection direction for 3D imaging (b).
Artificial Intelligence for Neuro MRI Acquisition: A Review
Yang, Hongjia, Wang, Guanhua, Li, Ziyu, Li, Haoxiang, Zheng, Jialan, Hu, Yuxin, Cao, Xiaozhi, Liao, Congyu, Ye, Huihui, Tian, Qiyuan
Magnetic resonance imaging (MRI) has significantly benefited from the resurgence of artificial intelligence (AI). By leveraging AI's capabilities in large-scale optimization and pattern recognition, innovative methods are transforming the MRI acquisition workflow, including planning, sequence design, and correction of acquisition artifacts. These emerging algorithms demonstrate substantial potential in enhancing the efficiency and throughput of acquisition steps.
Quantifying the uncertainty of neural networks using Monte Carlo dropout for deep learning based quantitative MRI
Avci, Mehmet Yigit, Li, Ziyu, Fan, Qiuyun, Huang, Susie, Bilgic, Berkin, Tian, Qiyuan
Dropout is conventionally used during the training phase as regularization method and for quantifying uncertainty in deep learning. We propose to use dropout during training as well as inference steps, and average multiple predictions to improve the accuracy, while reducing and quantifying the uncertainty. The results are evaluated for fractional anisotropy (FA) and mean diffusivity (MD) maps which are obtained from only 3 direction scans. With our method, accuracy can be improved significantly compared to network outputs without dropout, especially when the training dataset is small. Moreover, confidence maps are generated which may aid in diagnosis of unseen pathology or artifacts.
Highly Accelerated Multishot EPI through Synergistic Combination of Machine Learning and Joint Reconstruction
Bilgic, Berkin, Chatnuntawech, Itthi, Manhard, Mary Kate, Tian, Qiyuan, Liao, Congyu, Cauley, Stephen F., Huang, Susie Y., Polimeni, Jonathan R., Wald, Lawrence L., Setsompop, Kawin
Purpose: To introduce a combined machine learning (ML) and physics-based image reconstruction framework that enables navigator-free, highly accelerated multishot echo planar imaging (msEPI), and demonstrate its application in high-resolution structural imaging. Methods: Singleshot EPI is an efficient encoding technique, but does not lend itself well to high-resolution imaging due to severe distortion artifacts and blurring. While msEPI can mitigate these artifacts, high-quality msEPI has been elusive because of phase mismatch arising from shot-to-shot physiological variations which disrupt the combination of the multiple-shot data into a single image. We employ Deep Learning to obtain an interim magnitude-valued image with minimal artifacts, which permits estimation of image phase variations due to shot-to-shot physiological changes. These variations are then included in a Joint Virtual Coil Sensitivity Encoding (JVC-SENSE) reconstruction to utilize data from all shots and improve upon the ML solution. Results: Our combined ML + physics approach enabled R=8-fold acceleration from 2 EPI-shots while providing 1.8-fold error reduction compared to the MUSSELS, a state-of-the-art reconstruction technique, which is also used as an input to our ML network. Using 3 shots allowed us to push the acceleration to R=10-fold, where we obtained a 1.7-fold error reduction over MUSSELS. Conclusion: Combination of ML and JVC-SENSE enabled navigator-free msEPI at higher accelerations than previously possible while using fewer shots, with reduced vulnerability to poor generalizability and poor acceptance of end-to-end ML approaches.