Genre
AI Solutions Need Initial Big Investments and Innovation to be Successful
Adoption of modern technology like Artificial Intelligence by businesses is low. However, it is anybody's guess that such state-of-the-art technology would only make businesses more user-friendly, simpler and automated. Operational efficiency would improve and business processes would be streamlined. In fact, Artificial Intelligence (AI) is optimizing system-operating models and transforming business processes for enterprises and organizations across the globe. However, according to a recent survey, the number of business units and MSMEs utilizing such modern tech tools, particularly in India, is quite low.
Deep Learning Prerequisites: The Numpy Stack in Python
This is Deep Learning, Machine Learning, and Data Science Prerequisites: The Numpy Stack in Python. One question or concern I get a lot is that people want to learn deep learning and data science, so they take these courses, but they get left behind because they don't know enough about the Numpy stack in order to turn those concepts into code. Even if I write the code in full, if you don't know Numpy, then it's still very hard to read. This course is designed to remove that obstacle - to show you how to do things in the Numpy stack that are frequently needed in deep learning and data science. This forms the basis for everything else.
AI Predicts Heart Attacks Better Than Doctors: Study
It is no secret that timely diagnoses of heart ailments can prevent heart attacks and save lives. Heart attacks are hard to anticipate and doctors generally employ the American Heart Association's (AHA) guidelines in diagnosing them. A new method, which employs artificial intelligence (AI) based machine learning mechanisms, could change this -- according to a new study published in Science Magazine Friday, scientists have demonstrated that computers capable of machine learning can perform better than standard medical guidelines. "I can't stress enough how important it is and how much I really hope that doctors start to embrace the use of artificial intelligence to assist us in care of patients," Elsie Ross, a vascular surgeon at Stanford University commented on the technological development. Heart attacks are generally diagnosed based on risk factors such as age, cholesterol level and blood pressure.
Bezos says Artificial Intelligence to fuel Amazon's success - The Economic Times
By Spencer Soper Amazon.com is embracing artificial intelligence to deliver goods more quickly, enhance its voice-activated Alexa assistant and create new tools sold to others through its cloud-computing division, Chief Executive Officer Jeff Bezos said in his annual shareholder letter. Changes ushered in by artificial intelligence and machine learning will help the companies that embrace them and put up barriers for those who don't, the world's second- richest man wrote in a 1,700-word letter released Wednesday. Bezos repeated familiar themes, such as the need to operate a business like it's always "Day 1" to keep a startup mentality and the ability to act quickly on limited information to stay ahead, what he calls "high-velocity decision making." His emphasis on artificial intelligence and machine learning was the most concrete indication of areas in which the e-commerce giant will continue to invest. Machine learning is the science of getting computers to act without being programmed, and is used in autonomous cars, speech-recognition and internet search engines.
An Integrated Simulator and Dataset that Combines Grasping and Vision for Deep Learning
Veres, Matthew, Moussa, Medhat, Taylor, Graham W.
Deep learning is an established framework for learning hierarchical data representations. While compute power is in abundance, one of the main challenges in applying this framework to robotic grasping has been obtaining the amount of data needed to learn these representations, and structuring the data to the task at hand. Among contemporary approaches in the literature, we highlight key properties that have encouraged the use of deep learning techniques, and in this paper, detail our experience in developing a simulator for collecting cylindrical precision grasps of a multi-fingered dexterous robotic hand.
(Yet) Another Theoretical Model of Thinking
This paper presents a theoretical, idealized model of the thinking process with the following characteristics: 1) the model can produce complex thought sequences and can be generalized to new inputs, 2) it can receive and maintain input information indefinitely for the generation of thoughts and later use, and 3) it supports learning while executing. The crux of the model lies within the concept of internal consistency, or the generated thoughts should always be consistent with the inputs from which they are created. Its merit, apart from the capability to generate new creative thoughts from an internal mechanism, depends on the potential to help training to generalize better. This is consequently enabled by separating input information into several parts to be handled by different processing components with a focus mechanism to fetch information for each. This modularized view with the focus binds the model with the computationally capable Turing machines. And as a final remark, this paper constructively shows that the computational complexity of the model is at least, if not surpass, that of a universal Turing machine.
Hamiltonian Monte Carlo Acceleration Using Surrogate Functions with Random Bases
Zhang, Cheng, Shahbaba, Babak, Zhao, Hongkai
For big data analysis, high computational cost for Bayesian methods often limits their applications in practice. In recent years, there have been many attempts to improve computational efficiency of Bayesian inference. Here we propose an efficient and scalable computational technique for a state-of-the-art Markov Chain Monte Carlo (MCMC) methods, namely, Hamiltonian Monte Carlo (HMC). The key idea is to explore and exploit the structure and regularity in parameter space for the underlying probabilistic model to construct an effective approximation of its geometric properties. To this end, we build a surrogate function to approximate the target distribution using properly chosen random bases and an efficient optimization process. The resulting method provides a flexible, scalable, and efficient sampling algorithm, which converges to the correct target distribution. We show that by choosing the basis functions and optimization process differently, our method can be related to other approaches for the construction of surrogate functions such as generalized additive models or Gaussian process models. Experiments based on simulated and real data show that our approach leads to substantially more efficient sampling algorithms compared to existing state-of-the art methods.
Larger is Better: The Effect of Learning Rates Enjoyed by Stochastic Optimization with Progressive Variance Reduction
In this paper, we propose a simple variant of the original stochastic variance reduction gradient (SVRG), where hereafter we refer to as the variance reduced stochastic gradient descent (VR-SGD). Different from the choices of the snapshot point and starting point in SVRG and its proximal variant, Prox-SVRG, the two vectors of each epoch in VR-SGD are set to the average and last iterate of the previous epoch, respectively. This setting allows us to use much larger learning rates or step sizes than SVRG, e.g., 3/(7L) for VR-SGD vs 1/(10L) for SVRG, and also makes our convergence analysis more challenging. In fact, a larger learning rate enjoyed by VR-SGD means that the variance of its stochastic gradient estimator asymptotically approaches zero more rapidly. Unlike common stochastic methods such as SVRG and proximal stochastic methods such as Prox-SVRG, we design two different update rules for smooth and non-smooth objective functions, respectively. In other words, VR-SGD can tackle non-smooth and/or non-strongly convex problems directly without using any reduction techniques such as quadratic regularizers. Moreover, we analyze the convergence properties of VR-SGD for strongly convex problems, which show that VR-SGD attains a linear convergence rate. We also provide the convergence guarantees of VR-SGD for non-strongly convex problems. Experimental results show that the performance of VR-SGD is significantly better than its counterparts, SVRG and Prox-SVRG, and it is also much better than the best known stochastic method, Katyusha.
Bayesian Hybrid Matrix Factorisation for Data Integration
We introduce a novel Bayesian hybrid matrix factorisation model (HMF) for data integration, based on combining multiple matrix factorisation methods, that can be used for in- and out-of-matrix prediction of missing values. The model is very general and can be used to integrate many datasets across different entity types, including repeated experiments, similarity matrices, and very sparse datasets. We apply our method on two biological applications, and extensively compare it to state-of-the-art machine learning and matrix factorisation models. For in-matrix predictions on drug sensitivity datasets we obtain consistently better performances than existing methods. This is especially the case when we increase the sparsity of the datasets. Furthermore, we perform out-of-matrix predictions on methylation and gene expression datasets, and obtain the best results on two of the three datasets, especially when the predictivity of datasets is high.
Discriminative Bimodal Networks for Visual Localization and Detection with Natural Language Queries
Zhang, Yuting, Yuan, Luyao, Guo, Yijie, He, Zhiyuan, Huang, I-An, Lee, Honglak
Associating image regions with text queries has been recently explored as a new way to bridge visual and linguistic representations. A few pioneering approaches have been proposed based on recurrent neural language models trained generatively (e.g., generating captions), but achieving somewhat limited localization accuracy. To better address natural-language-based visual entity localization, we propose a discriminative approach. We formulate a discriminative bimodal neural network (DBNet), which can be trained by a classifier with extensive use of negative samples. Our training objective encourages better localization on single images, incorporates text phrases in a broad range, and properly pairs image regions with text phrases into positive and negative examples. Experiments on the Visual Genome dataset demonstrate the proposed DBNet significantly outperforms previous state-of-the-art methods both for localization on single images and for detection on multiple images. We we also establish an evaluation protocol for natural-language visual detection.