Deep Learning
Dual graph convolutional neural network for predicting chemical networks
Predicting of chemical compounds is one of the fundamental tasks in bioinformatics and chemoinformatics, because it contributes to various applications in metabolic engineering and drug discovery. The recent rapid growth of the amount of available data has enabled applications of computational approaches such as statistical modeling and machine learning method. Both a set of chemical interactions and chemical compound structures are represented as graphs, and various graph-based approaches including graph convolutional neural networks have been successfully applied to chemical network prediction. However, there was no efficient method that can consider the two different types of graphs in an end-to-end manner. We give a new formulation of the chemical network prediction problem as a link prediction problem in a graph of graphs (GoG) which can represent the hierarchical structure consisting of compound graphs and an inter-compound graph. We propose a new graph convolutional neural network architecture called dual graph convolutional network that learns compound representations from both the compound graphs and the inter-compound network in an end-to-end manner. Experiments using four chemical networks with different sparsity levels and degree distributions shows that our dual graph convolution approach achieves high prediction performance in relatively dense networks, while the performance becomes inferior on extremely-sparse networks.
Deep Learning A-Z : Hands-On Artificial Neural Networks
Learn to create Deep Learning Algorithms in Python from two Machine Learning & Data Science experts. Templates included. BESTSELLER,4.5 (24,785 ratings), Created by Kirill Eremenko, Hadelin de Ponteves, SuperDataScience Team, ย English, French [Auto-generated], 4 more Deep Learning A-Zโข: Hands-On Artificial Neural Networks Understand the intuition behind Artificial Neural Networks Apply Artificial Neural Networks in practice Understand the intuition behind Convolutional Neural Networks Apply Convolutional Neural Networks in practice Understand the intuition behind Recurrent Neural Networks Apply Recurrent Neural Networks in practice Understand the intuition behind Self-Organizing Maps Apply Self-Organizing Maps in practice Understand the intuition behind Boltzmann Machines Apply Boltzmann Machines in practice Understand the intuition behind AutoEncoders Apply AutoEncoders in practice PREVIEW THIS UDEMY COURSE -.> GET COUPON CODE Udemy Coupon . Free Udemy Courses . Online Classes
A Very Simple Introduction to Deep Learning on Amazon Sagemaker
In this article, I will walk you through loading your data to S3 and then spinning up a Jupyter notebook instance on Amazon Sagemaker for running deep learning jobs. The method I'm about to review is not the only method for running deep learning in the cloud (in fact it's not even the recommended method). But this method is a nice way to get started. Side note: there is a way to auto-shutdown using the "bring your training to Sagemaker" method, but it requires some additional coding. This is an option you can explore if you want.
Director - Deep Learning - NPAworldwide - Plantation, FL
Why a Great Opportunity This is an American startup company that released a head-mounted virtual retinal display, called Magic Leap One, which superimposes 3D computer-generated imagery over real world objects, by "projecting a digital light field into the user's eye" involving technologies potentially suited to applications in augmented reality and computer vision. It is attempting to construct a light-field chip using silicon photonics. Job Description Job Description We have an exciting opportunity on our Software team for a strong leader with exceptional development/research skills in the field of Deep Learning. The primary responsibility of the Director, Deep Learning is to lead the research and development of multiple core perception components across multiple organizations spanning beyond the Perception group. The candidate's responsibilities extend to working closely with the executive team to establish the scope and schedule of the product critical projects, driving the formation of technical teams and ensuring a cohesive alignment of all essential technical expertise by setting optimal communication strategies.
Hypatos, deep learning based document processing startup, raises $11.8M
Hypatos, a Germany and Poland based automation startup, raised around $11.8 million in a seed funding round. Many companies like Blackfin Tech, UVC Partners, Grazia Equity, and Plug Ventures participated in the round. The company will use these funds to widen its scope of documents for automated document processing. Hypatos will also focus on further expansion of the company across Europe, North America, and Asia. Hypatos started due to the need for an AI solution for an accounting startup called Smacc to apply deep learning algorithms to automate a more comprehensive range of back-office operations. The primary focus was on the financial and insurance sectors with heavy financial document processing needs.
Utilizing Citation Network Structure to Predict Citation Counts: A Deep Learning Approach
With the advancement of science and technology, the number of academic papers published in the world each year has increased almost exponentially. While a large number of research papers highlight the prosperity of science and technology, they also give rise to some problems. As we all know, academic papers are the most intuitive embodiment of the research results of scholars, which can reflect the level of researchers. It is also the evaluation standard for decision-making such as promotion and allocation of funds. Therefore, how to measure the quality of an academic paper is very important. The most common standard for measuring academic papers is the number of citation counts of papers, because this indicator is widely used in the evaluation of scientific publications, and it also serves as the basis for many other indicators (such as the h-index). Therefore, it is very important to be able to accurately predict the citation counts of academic papers. This paper proposes an end-to-end deep learning network, DeepCCP, which combines the effect of information cascade and looks at the citation counts prediction problem from the perspective of information cascade prediction. DeepCCP directly uses the citation network formed in the early stage of the paper as the input, and the output is the citation counts of the corresponding paper after a period of time. DeepCCP only uses the structure and temporal information of the citation network, and does not require other additional information, but it can still achieve outstanding performance. According to experiments on 6 real data sets, DeepCCP is superior to the state-of-the-art methods in terms of the accuracy of citation count prediction.
Spatio-Temporal Activation Function To Map Complex Dynamical Systems
Most of the real world is governed by complex and chaotic dynamical systems. All of these dynamical systems pose a challenge in modelling them using neural networks. Currently, reservoir computing, which is a subset of recurrent neural networks, is actively used to simulate complex dynamical systems. In this work, a two dimensional activation function is proposed which includes an additional temporal term to impart dynamic behaviour on its output. The inclusion of a temporal term alters the fundamental nature of an activation function, it provides capability to capture the complex dynamics of time series data without relying on recurrent neural networks.
Edge-variational Graph Convolutional Networks for Uncertainty-aware Disease Prediction
Huang, Yongxiang, Chung, Albert C. S.
There is a rising need for computational models that can complementarily leverage data of different modalities while investigating associations between subjects for population-based disease analysis. Despite the success of convolutional neural networks in representation learning for imaging data, it is still a very challenging task. In this paper, we propose a generalizable framework that can automatically integrate imaging data with non-imaging data in populations for uncertainty-aware disease prediction. At its core is a learnable adaptive population graph with variational edges, which we mathematically prove that it is optimizable in conjunction with graph convolutional neural networks. To estimate the predictive uncertainty related to the graph topology, we propose the novel concept of Monte-Carlo edge dropout. Experimental results on four databases show that our method can consistently and significantly improve the diagnostic accuracy for Autism spectrum disorder, Alzheimer's disease, and ocular diseases, indicating its generalizability in leveraging multimodal data for computer-aided diagnosis.
PSO-PS: Parameter Synchronization with Particle Swarm Optimization for Distributed Training of Deep Neural Networks
Ye, Qing, Han, Yuxuan, sun, Yanan, Lv, JIancheng
Parameter updating is an important stage in parallelism-based distributed deep learning. Synchronous methods are widely used in distributed training the Deep Neural Networks (DNNs). To reduce the communication and synchronization overhead of synchronous methods, decreasing the synchronization frequency (e.g., every $n$ mini-batches) is a straightforward approach. However, it often suffers from poor convergence. In this paper, we propose a new algorithm of integrating Particle Swarm Optimization (PSO) into the distributed training process of DNNs to automatically compute new parameters. In the proposed algorithm, a computing work is encoded by a particle, the weights of DNNs and the training loss are modeled by the particle attributes. At each synchronization stage, the weights are updated by PSO from the sub weights gathered from all workers, instead of averaging the weights or the gradients. To verify the performance of the proposed algorithm, the experiments are performed on two commonly used image classification benchmarks: MNIST and CIFAR10, and compared with the peer competitors at multiple different synchronization configurations. The experimental results demonstrate the competitiveness of the proposed algorithm.