Media
r/deeplearning - [Research] Domain Adaptation for Vehicle Detection from Bird's Eye View LiDAR Point Cloud Data
Abstract: Point cloud data from 3D LiDAR sensors are one of the most crucial sensor modalities for versatile safety-critical applications such as self-driving vehicles. Since the annotations of point cloud data is an expensive and time-consuming process, therefore recently the utilization of simulated environments and 3D LiDAR sensors for this task started to get some popularity. With simulated sensors and environments, the process for obtaining an annotated synthetic point cloud data became much easier. However, the generated synthetic point cloud data are still missing the artifacts usually exist in point cloud data from real 3D LiDAR sensors. As a result, the performance of the trained models on this data for perception tasks when tested on real point cloud data is degraded due to the domain shift between simulated and real environments.
r/deeplearning - Hands-on Graph Neural Networks with PyTorch & PyTorch Geometric
Recently, Graph Neural Networks have gained increasing attention from the Machine Learning researchers and the community. With its strong expressiveness, they are likely to be the next game-changing Neural Networks. PyTorch Geometric is one of the fastest Graph Neural Networks frameworks in the world. This article about the basic usage of PyTorch Geometric and how to use it on real-world data.
Artificial Intelligence: How to remain relevant in a digital world - LCIBS -
Business managers currently spend 54% of an average work day on administration, according to an Accenture survey published in the Harvard Business Review. The research surveyed 1,770 managers from 14 countries and interviewed 37 executives in charge of digital transformation at their organisations. It found that after administrative chores, only 7% of time was left to develop people and engage with stakeholders, with 10% of time spent on strategy and innovation, and 30% on problem solving. If you ask me, this sounds like my dream role! Just take The Associated Press, for example, which expanded quarterly earnings by using AI to increase reporting from 300 stories to 4,400.
r/MachineLearning - [R] On Network Design Spaces for Visual Recognition
Abstract: Over the past several years progress in designing better neural network architectures for visual recognition has been substantial. To help sustain this rate of progress, in this work we propose to reexamine the methodology for comparing network architectures. In particular, we introduce a new comparison paradigm of distribution estimates, in which network design spaces are compared by applying statistical techniques to populations of sampled models, while controlling for confounding factors like network complexity. Compared to current methodologies of comparing point and curve estimates of model families, distribution estimates paint a more complete picture of the entire design landscape. As a case study, we examine design spaces used in neural architecture search (NAS).
Reinforcement Learning for Slate-based Recommender Systems: A Tractable Decomposition and Practical Methodology
Ie, Eugene, Jain, Vihan, Wang, Jing, Narvekar, Sanmit, Agarwal, Ritesh, Wu, Rui, Cheng, Heng-Tze, Lustman, Morgane, Gatto, Vince, Covington, Paul, McFadden, Jim, Chandra, Tushar, Boutilier, Craig
Recommender systems have become ubiquitous, transforming user interactions with products, services and content in a wide variety of domains. In content recommendation, recommenders generally surface relevant and/or novel personalized content based on learned models of user preferences (e.g., as in collaborative filtering [Breese et al., 1998, Konstan et al., 1997, Srebro et al., 2004, Salakhutdinov and Mnih, 2007]) or predictive models of user responses to specific recommendations. Well-known applications of recommender systems include video recommendations on YouTube [Covington et al., 2016], movie recommendations on Netflix [Gomez-Uribe and Hunt, 2016] and playlist construction on Spotify [Jacobson et al., 2016]. It is increasingly common to train deep neural networks (DNNs) [van den Oord et al., 2013, Wang et al., 2015, Covington et al., 2016, Cheng et al., 2016] to predict user responses (e.g., click-through rates, content engagement, ratings, likes) to generate, score and serve candidate recommendations. Practical recommender systems largely focus on myopic prediction--estimating a user's immediate response to a recommendation--without considering the long-term impact on subsequent user behavior. This can be limiting: modeling a recommendation's stochastic impact on the future affords opportunities to trade off user engagement in the near-term for longer-term benefit (e.g., by probing a user's interests, or improving satisfaction).
Forget rampant killer robots: AI's real danger is far more insidious
WHEN I was growing up, nobody promised me a flying car. But I was promised an AI apocalypse. Those shiny machines were going to crush our skulls underfoot, and we were all going to welcome our new robot overlords. Many people still seem to think it is likely to happen. But we might still get a deadly AI nightmare.
Neural Consciousness Flow
Xu, Xiaoran, Feng, Wei, Sun, Zhiqing, Deng, Zhi-Hong
The ability of reasoning beyond data fitting is substantial to deep learning systems in order to make a leap forward towards artificial general intelligence. A lot of efforts have been made to model neural-based reasoning as an iterative decision-making process based on recurrent networks and reinforcement learning. Instead, inspired by the consciousness prior proposed by Yoshua Bengio, we explore reasoning with the notion of attentive awareness from a cognitive perspective, and formulate it in the form of attentive message passing on graphs, called neural consciousness flow (NeuCFlow). Aiming to bridge the gap between deep learning systems and reasoning, we propose an attentive computation framework with a three-layer architecture, which consists of an unconsciousness flow layer, a consciousness flow layer, and an attention flow layer. We implement the NeuCFlow model with graph neural networks (GNNs) and conditional transition matrices. Our attentive computation greatly reduces the complexity of vanilla GNN-based methods, capable of running on large-scale graphs. We validate our model for knowledge graph reasoning by solving a series of knowledge base completion (KBC) tasks. The experimental results show NeuCFlow significantly outperforms previous state-of-the-art KBC methods, including the embedding-based and the path-based. The reproducible code can be found by the link below.
Matrix Completion in the Unit Hypercube via Structured Matrix Factorization
Bugliarello, Emanuele, Jain, Swayambhoo, Rakesh, Vineeth
Several complex tasks that arise in organizations can be simplified by mapping them into a matrix completion problem. In this paper, we address a key challenge faced by our company: predicting the efficiency of artists in rendering visual effects (VFX) in film shots. We tackle this challenge by using a two-fold approach: first, we transform this task into a constrained matrix completion problem with entries bounded in the unit interval [0, 1]; second, we propose two novel matrix factorization models that leverage our knowledge of the VFX environment. Our first approach, expertise matrix factorization (EMF), is an interpretable method that structures the latent factors as weighted user-item interplay. The second one, survival matrix factorization (SMF), is instead a probabilistic model for the underlying process defining employees' efficiencies. We show the effectiveness of our proposed models by extensive numerical tests on our VFX dataset and two additional datasets with values that are also bounded in the [0, 1] interval.
Hollywood is quietly using AI to help decide which movies to make
The film world is full of intriguing what-ifs. Will Smith famously turned down the role of Neo in The Matrix. Nicolas Cage was cast as the lead in Tim Burton's Superman Lives, but he only had time to try on the costume before the film was canned. Actors and directors are forever glancing off projects that never get made or that get made by someone else, and fans are left wondering what might have been. For the people who make money from movies, that isn't good enough.