Media
How Computers Think
I'm talking about true "intelligent" machines, sometimes called "hard" AI, or "general intelligence". That is, an artificial intelligence that is intelligent "like us", that is "conscious" or "self aware". This is a subject more discussed by philosophers and pop-culture commentators than by actual researchers in artificial intelligence. Its terms are too loosely-defined, its consequences of too little practical significance to interest most data scientists or software engineers. Philosophers and alarmist journalists might concern themselves with the line between simple maths and a thinking being, but for practical purposes, the current state-of-the-art in AI seems so far away from any truly intelligent machine as to make the question moot. But I think that is a missed opportunity.
ML Platform Meetup: Infra for Contextual Bandits and Reinforcement Learning
Infrastructure for Contextual Bandits and Reinforcement Learning -- theme of the ML Platform meetup hosted at Netflix, Los Gatos on Sep 12, 2019. Contextual and Multi-armed Bandits enable faster and adaptive alternatives to traditional A/B Testing. They enable rapid learning and better decision-making for product rollouts. Broadly speaking, these approaches can be seen as a stepping stone to full-on Reinforcement Learning (RL) with closed-loop, on-policy evaluation and model objectives tied to reward functions. At Netflix, we are running several such experiments.
Homo Cyberneticus: The Era of Human-AI Integration
Author Keywords HCI vision; human-augmentation; human-AI integration HUMAN-AUGMENTATION Neo: Can you fly that thing? In the movie "The Matrix," Trinity responds to Neo right before having the helicopter's maneuverability downloaded Will such a future come? The idea that technology enhances humanity has a long history. "There may be found many Mechanical Inventions to improve GUIs were tools to realize that goal. In that regard, J.C.R. Licklider's "Man-Computer Symbiosis" [12] is worth reviewing. Here, symbiosis means "living together in intimate association, or even close union, of two dissimilar organisms.
Shallow Art: Art Extension Through Simple Machine Learning
Shallow Art presents, implements, and tests the use of simple single-output classification and regression models for the purpose of art generation. V arious machine learning algorithms are trained on collections of computer generated images, artworks from Vincent van Gogh, and artworks from Rembrandt van Rijn. These models are then provided half of an image and asked to complete the missing side. The resulting images are displayed, and we explore implications for computational creativity.
Stability of Graph Neural Networks to Relative Perturbations
Gama, Fernando, Bruna, Joan, Ribeiro, Alejandro
ST ABILITY OF GRAPH NEURAL NETWORKS TO RELA TIVE PERTURBA TIONS Fernando Gama, Alejandro Ribeiro University of Pennsylvania Dept. of Electrical and Systems Engineering Philadelphia, P A Joan Bruna † New Y ork University Courant Institute of Mathematical Sciences New Y ork, NY ABSTRACT Graph neural networks (GNNs), consisting of a cascade of layers applying a graph convolution followed by a pointwise nonlinearity, have become a powerful architecture to process signals supported on graphs. Graph convolutions (and thus, GNNs), rely heavily on knowledge of the graph for operation. However, in many practical cases the GSO is not known and needs to be estimated, or might change from training time to testing time. In this paper, we are set to study the effect that a change in the underlying graph topology that supports the signal has on the output of a GNN. We prove that graph convolutions with integral Lipschitz filters lead to GNNs whose output change is bounded by the size of the relative change in the topology. Furthermore, we leverage this result to show that the main reason for the success of GNNs is that they are stable architectures capable of discriminating features on high eigenvalues, which is a feat that cannot be achieved by linear graph filters (which are either stable or discriminative, but cannot be both). Finally, we comment on the use of this result to train GNNs with increased stability and run experiments on movie recommendation systems.
The Illustrated GPT-2 (Visualizing Transformer Language Models)
This year, we saw a dazzling application of machine learning. The OpenAI GPT-2 exhibited impressive ability of writing coherent and passionate essays that exceed what we anticipated current language models are able to produce. The GPT-2 wasn't a particularly novel architecture – it's architecture is very similar to the decoder-only transformer. The GPT2 was, however, a very large, transformer-based language model trained on a massive dataset. In this post, we'll look at the architecture that enabled the model to produce its results. We will go into the depths of its self-attention layer. My goal here is to also supplement my earlier post, The Illustrated Transformer, with more visuals explaining the inner-workings of transformers, and how they've evolved since the original paper. My hope is that this visual language will hopefully make it easier to explain later Transformer-based models as their inner-workings continue to evolve.
iPR Software Introduces the First Artificial Intelligence Application for Online Newsrooms and Digital Publishing
LOS ANGELES, CA, Oct. 20, 2019 (GLOBE NEWSWIRE) -- via NEWMEDIAWIRE – iPR Software, the leader in Online Newsrooms, Digital Publishing, Digital Asset Management (DAM) solutions, and customized integrated solutions, announced its largest technology rollout to date at Public Relations Society of America's International Conference in San Diego, California. With the launch of "Metatron," iPR Software's new application empowers Artificial Intelligence (AI) cloud capabilities as well as integrating the power of machine learning into DAM and customized software platforms to increase productivity and corporate asset sharing across multiple customer ecosystems. This latest software release further advances the company's vision for clients to publish their news and information to Traditional and Social media channels and better engage their B2B & B2C audiences while increasing traffic to their branded media and corporate assets. Leading organization's today are utilizing cloud applications to access the latest technology with encryption algorithms they can securely manage, publish, and share rich branded media content. Metatron introduces core, cloud-based software features that enable customers to securely publish and share key digital media and corporate assets, target practical enterprise use cases, increase workflow efficiencies, and automate mundane tasks to reduce data and storage errors.
r/MachineLearning - [D] Benchmarking /Transformers on both PyTorch and TensorFlow
Since our recent release of Transformers (previously known as pytorch-pretrained-BERT and pytorch-transformers), we've been working on a comparison between the implementation of our models in PyTorch and in TensorFlow. We've released a detailed report where we benchmark each of the architectures hosted on our repository (BERT, GPT-2, DistilBERT, ...) in PyTorch with and without TorchScript, and in TensorFlow with and without XLA. We benchmark them for inference and the results are visible in the following spreadsheet. We would love to hear your thoughts on the process.