Overview
SWAG: Item Recommendations using Convolutions on Weighted Graphs
Pande, Amit, Ni, Kai, Kini, Venkataramani
SW AG: Item Recommendations using Convolutions on Weighted Graphs Amit Pande, Kai Ni and V enkataramani Kini Data Sciences, Target Corporation Abstract --Recent advancements in deep neural networks for graph-structured data have led to state-of-the-art performance on recommender system benchmarks. In this work, we present a Graph Convolutional Network (GCN) algorithm SW AG (Sample Weight and AGgregate), which combines efficient random walks and graph convolutions on weighted graphs to generate embed-dings for nodes (items) that incorporate both graph structure as well as node feature information such as item-descriptions and item-images. The three important SWAG operations that enable us to efficiently generate node embeddings based on graph structures are (a) Sampling of graph to homogeneous structure, (b) W eighting the sampling, walks and convolution operations, and (c) using AGgregation functions for generating convolutions. The work is an adaptation of graphSAGE over weighted graphs. We deploy SW AG at T arget and train it on a graph of more than 500K products sold online with over 50M edges. Offline and online evaluations reveal the benefit of using a graph-based approach and the benefits of weighing to produce high quality embeddings and product recommendations. I NTRODUCTION Convolutional Neural Networks (CNNs) are used to establish state-of-the-art performance on many Computer Vision applications [2]. CNNs consist of a series of parameterized convolutional layers operating locally (around neighboring pixels of an image) to obtain hierarchy of features about an image. The first layer learns simple edge-oriented detectors. Higher layers build up on the learning of lower layers to learn more complex features and objects. The success of CNNs in Computer Vision has inspired efforts to extend the convolu-tional operation from regular grids (2D images), to graph-structured data [9]. Graphs, such as social networks, word co-occurrence networks, guest purchasing behavior, protein-protein interactions and communication networks, occur naturally in various real-world applications. Analyzing them yields insights into the structure of society, language, and different patterns of communication.
Technical report: supervised training of convolutional spiking neural networks with PyTorch
Zimmer, Romain, Pellegrini, Thomas, Singh, Srisht Fateh, Masquelier, Timothรฉe
Recently, it has been shown that spiking neural networks (SNNs) can be trained efficiently, in a supervised manner, using backpropagation through time. Indeed, the most commonly used spiking neuron model, the leaky integrate-and-fire neuron, obeys a differential equation which can be approximated using discrete time steps, leading to a recurrent relation for the potential. The firing threshold causes optimization issues, but they can be overcome using a surrogate gradient. Here, we extend previous approaches in two ways. Firstly, we show that the approach can be used to train convolutional layers. Convolutions can be done in space, time (which simulates conduction delays), or both. Secondly, we include fast horizontal connections \`a la Den\`eve: when a neuron N fires, we subtract to the potentials of all the neurons with the same receptive the dot product between their weight vectors and the one of neuron N. As Den\`eve et al. showed, this is useful to represent a dynamic multidimensional analog signal in a population of spiking neurons. Here we demonstrate that, in addition, such connections also allow implementing a multidimensional send-on-delta coding scheme. We validate our approach on one speech classification benchmarks: the Google speech command dataset. We managed to reach nearly state-of-the-art accuracy (94%) while maintaining low firing rates (about 5Hz). Our code is based on PyTorch and is available in open source at http://github.com/romainzimmer/s2net
Investigating bankruptcy prediction models in the presence of extreme class imbalance and multiple stages of economy
Islam, Sheikh Rabiul, Eberle, William, Ghafoor, Sheikh K., Bundy, Sid C., Talbert, Douglas A., Siraj, Ambareen
In the area of credit risk analytics, current Bankruptcy Prediction Models (BPMs) struggle with (a) the availability of comprehensive and real-world data sets and (b) the presence of extreme class imbalance in the data (i.e., very few samples for the minority class) that degrades the performance of the prediction model. Moreover, little research has compared the relative performance of well-known BPM's on public datasets addressing the class imbalance problem. In this work, we apply eight classes of well-known BPMs, as suggested by a review of decades of literature, on a new public dataset named Freddie Mac Single-Family Loan-Level Dataset with resampling (i.e., adding synthetic minority samples) of the minority class to tackle class imbalance. Additionally, we apply some recent AI techniques (e.g., tree-based ensemble techniques) that demonstrate potentially better results on models trained with resampled data. In addition, from the analysis of 19 years (1999-2017) of data, we discover that models behave differently when presented with sudden changes in the economy (e.g., a global financial crisis) resulting in abrupt fluctuations in the national default rate. In summary, this study should aid practitioners/researchers in determining the appropriate model with respect to data that contains a class imbalance and various economic stages.
AI is the Fourth Industrial Revolution Technology - ReadWrite
Artificial Intelligence (AI): The fundamental change in our daily work routine, the way we live and interact with others, is all going to be represented by the fourth industrial revolution. Moving from the third to the fourth industrial revolution is going to open a new chapter in human development โ incorporating the extraordinary technological advances. These advanced technologies are emerging and will continue to merge in the business world. We see the fourth industrial revolution changing the digital, physical, and biological worlds. It is creating novel opportunities and promises of a better future. On the other hand, the evolution of technology will become the reason for potential risks and dangers.
Emerging Technologies Need Diversity: Innovative Women in AI / Blockchain to Follow in 2019
Besides being a hot topic these days, emerging technologies such as artificial intelligence and blockchain have received a reputation for being especially male-dominated in an already bro-saturated tech world. However, the buzz around artificial intelligence and cryptography isn't without merit, as these technologies are much more than just one more thing to be mansplained. "It's expected that soon, artificial intelligence will combine the intricacy and pattern recognition strength of human intelligence with the speed, memory and knowledge sharing of machine intelligence." Similarly, decentralized blockchain systems have the potential to change our lives from the way we do business, to the way we drive, vote, make purchases and even prove our identity. With such diverse and far-reaching applications, it is clear that a diversity of perspectives will be necessary to create effective and sustainable solutions.
On First-Order Model-Based Reasoning
Bonacina, Maria Paola, Furbach, Ulrich, Sofronie-Stokkermans, Viorica
Reasoning semantically in first-order logic is notoriously a challenge. This paper surveys a selection of semantically-guided or model-based methods that aim at meeting aspects of this challenge. For first-order logic we touch upon resolution-based methods, tableaux-based methods, DPLL-inspired methods, and we give a preview of a new method called SGGS, for Semantically-Guided Goal-Sensitive reasoning. For first-order theories we highlight hierarchical and locality-based methods, concluding with the recent Model-Constructing satisfiability calculus.
Causality-based Feature Selection: Methods and Evaluations
Feature selection is a crucial preprocessing step in data analytics and machine learning. Classical feature selection algorithms select features based on the correlations between predictive features and the class variable and do not attempt to capture causal relationships between them. It has been shown that the knowledge about the causal relationships between features and the class variable has potential benefits for building interpretable and robust prediction models, since causal relationships imply the underlying mechanism of a system. Consequently, causality-based feature selection has gradually attracted greater attentions and many algorithms have been proposed. In this paper, we present a comprehensive review of recent advances in causality-based feature selection. To facilitate the development of new algorithms in the research area and make it easy for the comparisons between new methods and existing ones, we develop the first open-source package, called CausalFS, which consists of most of the representative causality-based feature selection algorithms (available at https://github.com/kuiy/CausalFS).
Meeting the challenge of automation with soft skills
Intelligent software is replacing humans doing repetitive and routine machine-focused jobs such as switchboard operators, front-desk hotel assistants, typists, manufacturing production and packaging operatives. We are even starting to see robots take and deliver orders at restaurants, provide banking assistance, serve coffee and drive cars. Increasingly, artificial intelligence (AI) is encroaching into knowledge worker roles. In the legal sector, AI is carrying out routine contract review work. In the financial and insurance sectors, intelligent apps are creating new business models that replace many of the activities of sales representatives, by cross-selling to consumers through the app, for example.
A Study on various state of the art of the Art Face Recognition System using Deep Learning Techniques
Chokkadi, Sukhada, S, Sannidhan M, B, Sudeepa K, Bhandary, Abhir
ABSTRACT Considering the existence of very large amount of available data repositories and reach to the very advanced system of hardware, systems meant for facial identification have evolved enormously over the past few decades. Sketch recognitio n is one of the most important areas that have evolved as an integral component adopted by the agencies of law administration in curren t trends of forensic science. Matching of derived sketches to photo images of face is also a difficult assignment as the considered sketches are produced upon the verbal explanation depicted by the eye witness of the crime scene and may have scarcity of se nsitive elements that exist in the photograph as one can accurately depict due to the natural human error. Substantial amount of the novel research work carried out in this area up late used recognition system through traditional extraction and classificat ion models . But very recently, few researches work focused on using deep learning techniques to take an advantage of learning models for the feature extraction and classification to rule out potential domain challenges. The first part of this review paper basically focuses on deep learning techniques used in face recognition and matching which as improved the accuracy of face recognition technique with training of huge sets of data. This paper also includes a survey on different techniques used to match com posite sketches to human images which includes component - based representation approach, automatic composite sketch recognition technique etc. INTRODUCTION As per the researches carried out, a complete face recognition system includes two patterns of face detection and face recognition: 1) Structural similarity and 2) individual local differences of human faces. Therefore, it is required to extract the features of the face through the face detection process. The evolution of face recognition is due to its technical challenges and huge potential application in video surveillance, identity authorization, multimedia applications, home and office security, law enforcement and different human - computer interaction activities. Facial recognition technology (FRT) is one of the most controversial new tools. It was first devel oped in the 1960s.
Knowledge Graph Entity Alignment with Graph Convolutional Networks: Lessons Learned
Berrendorf, Max, Faerman, Evgeniy, Melnychuk, Valentyn, Tresp, Volker, Seidl, Thomas
In this work, we focus on the problem of entity alignment in Knowledge Graphs (KG) and we report on our experiences when applying a Graph Convolutional Network (GCN) based model for this task. Variants of GCN are used in multiple state-of-the-art approaches and therefore it is important to understand the specifics and limitations of GCN-based models. Despite serious efforts, we were not able to fully reproduce the results from the original paper and after a thorough audit of the code provided by authors, we concluded, that their implementation is different from the architecture described in the paper. In addition, several tricks are required to make the model work and some of them are not very intuitive. We provide an extensive ablation study to quantify the effects these tricks and changes of architecture have on final performance. Furthermore, we examine current evaluation approaches and systematize available benchmark datasets. We believe that people interested in KG matching might profit from our work, as well as novices entering the field