Goto

Collaborating Authors

 Deep Learning


A Vertical Federated Learning Framework for Graph Convolutional Network

arXiv.org Artificial Intelligence

Recently, Graph Neural Network (GNN) has achieved remarkable success in various real-world problems on graph data. However in most industries, data exists in the form of isolated islands and the data privacy and security is also an important issue. In this paper, we propose FedVGCN, a federated GCN learning paradigm for privacy-preserving node classification task under data vertically partitioned setting, which can be generalized to existing GCN models. Specifically, we split the computation graph data into two parts. For each iteration of the training process, the two parties transfer intermediate results to each other under homomorphic encryption. We conduct experiments on benchmark data and the results demonstrate the effectiveness of FedVGCN in the case of GraphSage.


Continuous-Depth Neural Models for Dynamic Graph Prediction

arXiv.org Artificial Intelligence

We introduce the framework of continuous-depth graph neural networks (GNNs). Neural graph differential equations (Neural GDEs) are formalized as the counterpart to GNNs where the input-output relationship is determined by a continuum of GNN layers, blending discrete topological structures and differential equations. The proposed framework is shown to be compatible with static GNN models and is extended to dynamic and stochastic settings through hybrid dynamical system theory. Here, Neural GDEs improve performance by exploiting of the underlying dynamics geometry, further introducing the ability to accommodate irregularly sampled data. Results prove the effectiveness of the proposed models across applications, such as traffic forecasting or prediction in genetic regulatory networks.


A Comprehensive Review on Non-Neural Networks Collaborative Filtering Recommendation Systems

arXiv.org Artificial Intelligence

Over the past two decades, recommender systems have attracted a lot of interest due to the explosion in the amount of data in online applications. A particular attention has been paid to collaborative filtering, which is the most widely used in applications that involve information recommendations. Collaborative filtering (CF) uses the known preference of a group of users to make predictions and recommendations about the unknown preferences of other users (recommendations are made based on the past behavior of users). First introduced in the 1990s, a wide variety of increasingly successful models have been proposed. Due to the success of machine learning techniques in many areas, there has been a growing emphasis on the application of such algorithms in recommendation systems. In this article, we present an overview of the CF approaches for recommender systems, their two main categories, and their evaluation metrics. We focus on the application of classical Machine Learning algorithms to CF recommender systems by presenting their evolution from their first use-cases to advanced Machine Learning models. We attempt to provide a comprehensive and comparative overview of CF systems (with python implementations) that can serve as a guideline for research and practice in this area.


Explore, Exploit or Listen: Combining Human Feedback and Policy Model to Speed up Deep Reinforcement Learning in 3D Worlds

arXiv.org Artificial Intelligence

We describe a method to use discrete human feedback to enhance the performance of deep learning agents in virtual three-dimensional environments by extending deep-reinforcement learning to model the confidence and consistency of human feedback. This enables deep reinforcement learning algorithms to determine the most appropriate time to listen to the human feedback, exploit the current policy model, or explore the agent's environment. Managing the trade-off between these three strategies allows DRL agents to be robust to inconsistent or intermittent human feedback. Through experimentation using a synthetic oracle, we show that our technique improves the training speed and overall performance of deep reinforcement learning in navigating three-dimensional environments using Minecraft. We further show that our technique is robust to highly innacurate human feedback and can also operate when no human feedback is given.


Deep Learning for AI

Communications of the ACM

Yoshua Bengio, Yann LeCun, and Geoffrey Hinton are recipients of the 2018 ACM A.M. Turing Award for breakthroughs that have made deep neural networks a critical component of computing. Research on artificial neural networks was motivated by the observation that human intelligence emerges from highly parallel networks of relatively simple, non-linear neurons that learn by adjusting the strengths of their connections. This observation leads to a central computational question: How is it possible for networks of this general kind to learn the complicated internal representations that are required for difficult tasks such as recognizing objects or understanding language? Deep learning seeks to answer this question by using many layers of activity vectors as representations and learning the connection strengths that give rise to these vectors by following the stochastic gradient of an objective function that measures how well the network is performing. It is very surprising that such a conceptually simple approach has proved to be so effective when applied to large training sets using huge amounts of computation and it appears that a key ingredient is depth: shallow networks simply do not work as well. We reviewed the basic concepts and some of the breakthrough achievements of deep learning several years ago.63 Here we briefly describe the origins of deep learning, describe a few of the more recent advances, and discuss some of the future challenges. These challenges include learning with little or no external supervision, coping with test examples that come from a different distribution than the training examples, and using the deep learning approach for tasks that humans solve by using a deliberate sequence of steps which we attend to consciously--tasks that Kahneman56 calls system 2 tasks as opposed to system 1 tasks like object recognition or immediate natural language understanding, which generally feel effortless. There are two quite different paradigms for AI.


Math GPT: Can AI Help Solve Complex Equations?

#artificialintelligence

My code blocks zero-day exploits on hundreds of millions of computers. Always hoping to make the world a better place. What if we trained AI to complete equations instead of images of cats? Can AI help solve the Unified Theory? Remember that shock of seeing some breakthrough for the first time?


NVIDIA's DLSS upscaling comes to 'Rust' and a wave of Linux games

Engadget

NVIDIA's Deep Learning Super Sampling (DLSS) is about to reach a host of big-name games -- and more titles that don't rely on Windows. The company has announced that Facepunch Studios' survival hit Rust is adding DLSS support on July 1st. That's on top of a slew of already-revealed major titles receiving DLSS, including Doom Eternal (which also gets ray-traced reflections) on June 29th and, at an unspecified point, Red Dead Redemption 2. You can also expect to see DLSS in more Linux titles. A driver update arriving on June 22nd will enable DLSS in Vulkan-based games using the Proton compatibility layer. If a Windows game isn't quite running smoothly enough on your Linux rig, the AI-powered tech might make it more enjoyable.


Reading CSV(), Excel(), JSON () and HTML() File Formats in Pandas

#artificialintelligence

Pandas is a Python library containing a bunch of capacities and specific information structures that have been intended to help Python developers to perform information examination errands in an organized manner. Importing data is the most fundamental and absolute initial phase in any information-related work. The capacity to import the information accurately is a must have skill for every data scientist. Data exists in many different forms, and not only should we know how to import various data formats but also how to analyze and manipulate the data to infer insights. The majority of the things that pandas should do can be possible with fundamental Python, yet the gathered arrangement of pandas capacities and information structure makes the information examination assignments more reliable as far as punctuation and in this manner helps readability.


Ping An Makes Breakthrough in Artificial Intelligence-Driven Drug Research

#artificialintelligence

Research by Ping An Healthcare Technology Research Institute and Tsinghua University has led to a promising deep learning framework for drug discovery, announced Ping An Insurance (Group) Company of China, Ltd. (hereafter "Ping An" or the "Group", HKEX: 2318; SSE: 601318). The findings were published in "An effective self-supervised framework for learning expressive molecular global representations to drug discovery" in Briefings in Bioinformatics, a peer-reviewed bioinformatics journal. It marks a major technology breakthrough for the Group in the field of AI-driven pharmaceutical research. Drug discovery can take 10 to 15 years from invention to market. It can take a large number of experiments, with significant costs and high failure rates.


A Brief Intro to the GPT-3 Algorithm

#artificialintelligence

Generative Pre-trained Transformer 3 (GPT-3) embraces and augments the GPT-2 model architecture, including pre-normalization, modified initialization, and reversible tokenization. It exhibits strong performance on many Natural Language Processing (NLP) tasks. GPT-3 is an auto-regressive artificial intelligence algorithm developed by OpenAI, an AI-powered research laboratory located in San Francisco, California. It is a massive artificial neural network that takes help from deep learning to generate human-like text and is trained on huge text datasets with thousands of billions of words. It is the third-generation AI language prediction model in the GPT-n series and the successor to GPT-2. In simple words, OpenAI GPT-3 was fed inputs the ways how billions of people write and also was taught how to pick up on writing patterns based on user entry.