Deep Learning
MWC 2019: Spotlight on AI & Robotics Innovations
Spotlight on AI & Robotics Innovations at MWC 2019 Every year as the calendar turns from February to March, the world's leading electronics and telecommunications companies, startups, inventors, and a herd of tech journalists and analysts head to the Mobile World Congress. MWC 2019 kicked off February 25 in Barcelona, Spain, and the leading congress of its type has already produced a plethora of news and products built on AI and robotics. MWC 2019: Intel's'network in a box' for smart cities Intel is targeting smart cities deployments by looking into providing a network-in-a-box offering that integrates its Movidius artificial intelligence (AI) accelerator, multi-access edge computing, and a 5G mobile network all into a single offering. "It's essentially a solution that can go into smart city where it sits like a beacon up on a wall," Intel GM of 5G Advanced Technologies Rob Topol told ZDNet at Mobile World Congress (MWC) 2019 in Barcelona. MWC 2019: Huawei Showcases Its 5G, SoftCOM AI Solutions Huawei is presenting its end-to-end 5G products and solutions at MWC 2019, such as simplified 5G sites, architecture, protocols, and operations & maintenance (O&M).
Artificial Intelligence Regulation May Be Impossible
Artificial intelligence is a tool humanity is wielding with increasing recklessness. We say it's for our common good with machine learning hype equal to business profits. But what happens when we don't have the code of ethics, laws, government accountability, corporate transparency and capability of monitoring the space to be able to achieve AI regulation? Artificial intelligence regulation isn't just complex terrain, it's uncharted territory for an age that is passing the baton from human leadership to machine learning emergence, automation, robotic manufacturing and deep learning reliance.
Is Deep Learning Already Hitting its Limitations? – Towards Data Science
Many believed an algorithm would transcend humanity with cognitive awareness. Machines would discern and learn tasks without human intervention and replace workers in droves. They quite literally would be able to "think". Many people even raised the question whether we could have robots for spouses. But I am not talking about today.
Top 5 Data Science GitHub Repositories, Reddit Discussions - Feb 2019
Let me know in the comments section below if you use it! I like this question because of how relevant it is in today's world. The thread has close to 200 comments from experienced data scientists and machine learning researchers debating whether these coding challenges are a good or bad thing in an interview round. There's a lot of experience here so this is a discussion you really should pay close attention to. The essential question it comes down to is – should data science/machine learning professionals be judged extremely tightly on their coding skills or should algorithms/concepts take preference?
DeepMind and Google Train AI To Predict Energy Output Of Wind Farms
DeepMind claims it has trained an artificial intelligence system how to predict the energy output of Google wind farms in the U.S. The variable nature of wind makes it difficult to accurately predict how much energy a wind farm could produce in any given time period. But DeepMind says that its AI system-- a neural network trained on widely available weather forecasts and historical turbine data -- can predict wind power output 36 hours ahead of actual generation with a reasonable degree of accuracy. "Based on these predictions, our model recommends how to make optimal hourly delivery commitments to the power grid a full day in advance," a team of DeepMind researchers wrote in a blog post on Tuesday. "This is important because energy sources that can be scheduled (i.e. can deliver a set amount of electricity at a set time) are often more valuable to the grid." Google claims that DeepMind's AI system has boosted the "value" of its wind energy by roughly 20 per cent.
[New] Handbook of Deep Learning Applications (Springer)
This book presents a broad range of deep-learning applications related to vision, natural language processing, gene expression, arbitrary object recognition, driverless cars, semantic image segmentation, deep visual residual abstraction, brain–computer interfaces, big data processing, hierarchical deep learning networks as game-playing artifacts using regret matching, and building GPU-accelerated deep learning frameworks. Deep learning, an advanced level of machine learning technique that combines class of learning algorithms with the use of many layers of nonlinear units, has gained considerable attention in recent times. Unlike other books on the market, this volume addresses the challenges of deep learning implementation, computation time, and the complexity of reasoning and modeling different type of data. As such, it is a valuable and comprehensive resource for engineers, researchers, graduate students and Ph.D. scholars.
In cybersecurity, it's AI vs. AI: Will the good guys or the bad guys win? - SiliconANGLE
Artificial intelligence research group OpenAI last month made the unusual announcement: It had built an AI-powered content creation engine so sophisticated that it wouldn't release the full model to developers. Anyone who works in cybersecurity immediately knew why. Phishing emails, which try to trick recipients into clicking malicious links, originated 91 percent of all cyberattacks in 2016, according to a study by Cofense Inc. Combining software bots to scrape personal information from social networks and public databases with such a powerful content generation engine could produce much more persuasive phishing emails that might even mimic a certain person's writing style, said Nicolas Kseib, lead data scientist at TruSTAR Technology LLC. The potential result: Cybercriminals could launch phishing attacks much faster and on an unprecedented scale. That danger neatly sums up the never-ending war that is the state of cybersecurity today, one in which no one can yet answer a central question: Will artificial intelligence provide more help to criminals or to the people trying to stop them?
Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks
Zhang, Ningyu, Deng, Shumin, Sun, Zhanlin, Wang, Guanying, Chen, Xi, Zhang, Wei, Chen, Huajun
We propose a distance supervised relation extraction approach for long-tailed, imbalanced data which is prevalent in real-world settings. Here, the challenge is to learn accurate "few-shot" models for classes existing at the tail of the class distribution, for which little data is available. Inspired by the rich semantic correlations between classes at the long tail and those at the head, we take advantage of the knowledge from data-rich classes at the head of the distribution to boost the performance of the data-poor classes at the tail. First, we propose to leverage implicit relational knowledge among class labels from knowledge graph embeddings and learn explicit relational knowledge using graph convolution networks. Second, we integrate that relational knowledge into relation extraction model by coarse-to-fine knowledge-aware attention mechanism. We demonstrate our results for a large-scale benchmark dataset which show that our approach significantly outperforms other baselines, especially for long-tail relations.
Ternary Hybrid Neural-Tree Networks for Highly Constrained IoT Applications
Gope, Dibakar, Dasika, Ganesh, Mattina, Matthew
Machine learning-based applications are increasingly prevalent in IoT devices. The power and storage constraints of these devices make it particularly challenging to run modern neural networks, limiting the number of new applications that can be deployed on an IoT system. A number of compression techniques have been proposed, each with its own trade-offs. We propose a hybrid network which combines the strengths of current neural- and tree-based learning techniques in conjunction with ternary quantization, and show a detailed analysis of the associated model design space. Using this hybrid model we obtained a 11.1% reduction in the number of computations, a 52.2% reduction in the model size, and a 30.6% reduction in the overall memory footprint over a state-of-the-art keyword-spotting neural network, with negligible loss in accuracy.
Theoretical guarantees for sampling and inference in generative models with latent diffusions
Tzen, Belinda, Raginsky, Maxim
We introduce and study a class of probabilistic generative models, where the latent object is a finite-dimensional diffusion process on a finite time interval and the observed variable is drawn conditionally on the terminal point of the diffusion. We make the following contributions: We provide a unified viewpoint on both sampling and variational inference in such generative models through the lens of stochastic control. We quantify the expressiveness of diffusion-based generative models. Specifically, we show that one can efficiently sample from a wide class of terminal target distributions by choosing the drift of the latent diffusion from the class of multilayer feedforward neural nets, with the accuracy of sampling measured by the Kullback-Leibler divergence to the target distribution. Finally, we present and analyze a scheme for unbiased simulation of generative models with latent diffusions and provide bounds on the variance of the resulting estimators. This scheme can be implemented as a deep generative model with a random number of layers.