Deep Learning
Hybrid Intelligence
Dellermann, Dominik, Ebel, Philipp, Soellner, Matthias, Leimeister, Jan Marco
Research has a long history of discussing what is superior in predicting certain outcomes: statistical methods or the human brain. This debate has repeatedly been sparked off by the remarkable technological advances in the field of artificial intelligence (AI), such as solving tasks like object and speech recognition, achieving significant improvements in accuracy through deep-learning algorithms (Goodfellow et al. 2016), or combining various methods of computational intelligence, such as fuzzy logic, genetic algorithms, and case-based reasoning (Medsker 2012). One of the implicit promises that underlie these advancements is that machines will 1 day be capable of performing complex tasks or may even supersede humans in performing these tasks. This triggers new heated debates of when machines will ultimately replace humans (McAfee and Brynjolfsson 2017). While previous research has proved that AI performs well in some clearly defined tasks such as playing chess, playing Go or identifying objects on images, it is doubted that the development of an artificial general intelligence (AGI) which is able to solve multiple tasks at the same time can be achieved in the near future (e.g., Russell and Norvig 2016). Moreover, the use of AI to solve complex business problems in organizational contexts occurs scarcely, and applications for AI that solve complex problems remain mainly in laboratory settings instead of being implemented in practice. Since the road to AGI is still a long one, we argue that the most likely paradigm for the division of labor between humans and machines in the next decades is Hybrid Intelligence. This concept aims at using the complementary strengths of human intelligence and AI, so that they can perform better than each of the two could separately (e.g., Kamar 2016).
A novel hybrid methodology of measuring sentence similarity
Yoo, Yongmin, Heo, Tak-Sung, Park, Yeongjoon
The problem of measuring sentence similarity is an essential issue in the natural language processing (NLP) area. It is necessary to measure the similarity between sentences accurately. There are many approaches to measuring sentence similarity. Deep learning methodology shows a state-of-the-art performance in many natural language processing fields and is used a lot in sentence similarity measurement methods. However, in the natural language processing field, considering the structure of the sentence or the word structure that makes up the sentence is also important. In this study, we propose a methodology combined with both deep learning methodology and a method considering lexical relationships. Our evaluation metric is the Pearson correlation coefficient and Spearman correlation coefficient. As a result, the proposed method outperforms the current approaches on a KorSTS standard benchmark Korean dataset. Moreover, it performs a maximum of 65% increase than only using deep learning methodology. Experiments show that our proposed method generally results in better performance than those with only a deep learning model.
Schema-Aware Deep Graph Convolutional Networks for Heterogeneous Graphs
Manchanda, Saurav, Zheng, Da, Karypis, George
Graph convolutional network (GCN) based approaches have achieved significant progress for solving complex, graph-structured problems. GCNs incorporate the graph structure information and the node (or edge) features through message passing and computes 'deep' node representations. Despite significant progress in the field, designing GCN architectures for heterogeneous graphs still remains an open challenge. Due to the schema of a heterogeneous graph, useful information may reside multiple hops away. A key question is how to perform message passing to incorporate information of neighbors multiple hops away while avoiding the well-known over-smoothing problem in GCNs. To address this question, we propose our GCN framework 'Deep Heterogeneous Graph Convolutional Network (DHGCN)', which takes advantage of the schema of a heterogeneous graph and uses a hierarchical approach to effectively utilize information many hops away. It first computes representations of the target nodes based on their 'schema-derived ego-network' (SEN). It then links the nodes of the same type with various pre-defined metapaths and performs message passing along these links to compute final node representations. Our design choices naturally capture the way a heterogeneous graph is generated from the schema. The experimental results on real and synthetic datasets corroborate the design choice and illustrate the performance gains relative to competing alternatives.
Generative Art Using Neural Visual Grammars and Dual Encoders
Fernando, Chrisantha, Eslami, S. M. Ali, Alayrac, Jean-Baptiste, Mirowski, Piotr, Banarse, Dylan, Osindero, Simon
Whilst there are perhaps only a few scientific methods, there seem to be almost as many artistic methods as there are artists. Artistic processes appear to inhabit the highest order of open-endedness. To begin to understand some of the processes of art making it is helpful to try to automate them even partially. In this paper, a novel algorithm for producing generative art is described which allows a user to input a text string, and which in a creative response to this string, outputs an image which interprets that string. It does so by evolving images using a hierarchical neural Lindenmeyer system, and evaluating these images along the way using an image text dual encoder trained on billions of images and their associated text from the internet. In doing so we have access to and control over an instance of an artistic process, allowing analysis of which aspects of the artistic process become the task of the algorithm, and which elements remain the responsibility of the artist.
Dynamic Graph Convolutional Recurrent Network for Traffic Prediction: Benchmark and Solution
Li, Fuxian, Feng, Jie, Yan, Huan, Jin, Guangyin, Jin, Depeng, Li, Yong
Traffic prediction is the cornerstone of an intelligent transportation system. Accurate traffic forecasting is essential for the applications of smart cities, i.e., intelligent traffic management and urban planning. Although various methods are proposed for spatio-temporal modeling, they ignore the dynamic characteristics of correlations among locations on road networks. Meanwhile, most Recurrent Neural Network (RNN) based works are not efficient enough due to their recurrent operations. Additionally, there is a severe lack of fair comparison among different methods on the same datasets. To address the above challenges, in this paper, we propose a novel traffic prediction framework, named Dynamic Graph Convolutional Recurrent Network (DGCRN). In DGCRN, hyper-networks are designed to leverage and extract dynamic characteristics from node attributes, while the parameters of dynamic filters are generated at each time step. We filter the node embeddings and then use them to generate a dynamic graph, which is integrated with a pre-defined static graph. As far as we know, we are the first to employ a generation method to model fine topology of dynamic graph at each time step. Further, to enhance efficiency and performance, we employ a training strategy for DGCRN by restricting the iteration number of decoder during forward and backward propagation. Finally, a reproducible standardized benchmark and a brand new representative traffic dataset are opened for fair comparison and further research. Extensive experiments on three datasets demonstrate that our model outperforms 15 baselines consistently.
'I was terrible at crosswords so I built an AI to do them'
Michael Bowling, senior research scientist at DeepMind and professor of computing science at the University of Alberta, said of the win: "Congratulations to Dr Ginsburg and the Berkeley team. It's a terrific achievement and an inspiring collaboration, both seeing leading AI researchers combining forces, and seeing powerful AI building blocks of search and learning being employed together.
Complete Guide to Building a Chatbot with Deep Learning
Over the past month, I wanted to look for a project that encompasses the entire data science end-to-end workflow -- from the data pipeline, to deep learning, to deployment. It had to be challenging, but not pointlessly so -- it still had to be something useful. It took a little ideation and divergent thinking, but when the idea of making a personal assistant came up, it didn't take long for me to settle on it. Even my university is currently using Dr. Chatbot to track the health status of its members as an effective way to monitor this current pandemic. And it just makes sense: chatbots are faster, easier to interact with, and is super useful especially for things that we just want a fast response on.
Deep Learning in Marketing
Deep learning could be a set of AI that provides innovative applications in many various areas of life and technology. Algorithms battery-powered by deep learning are presently being employed to notice cancer, predict earthquakes, and make art associate AI-generated painting sold for over $400,000 at auction previously. Deep learning is however AI mimics the network of neurons within the human brain to resolve complicated issues quicker. In promoting, deep learning helps in content generation, period of time bidding on ad networks, chatbots, speech recognition, and language process. Deep learning helps you to use client information to supply a customized client expertise.
9 Data Science Programming Languages to Know
In Drew Conway's famous Venn diagram of data science skills, programming chops might be the most elusive target. New libraries and packages are constantly emerging -- and sometimes even entire new programming languages enter the stage. True, Python continues to dominate. But despite its widespread footing and ease of use, it hardly holds a monopoly in data science. And the alternatives extend well beyond R, despite what partisans in the tired Python vs. R debate might have you think.