Deep Learning
Artificial Intelligence
Artificial intelligence (AI) is a branch of computer science that is developing machines capable of intelligent behaviour. This involves building machines that can learn from example and complete tasks that would normally require human intelligence, such as speech recognition, language translation, decision-making and visual perception. Artificial intelligence uses machine learning, including deep learning (i.e. Artificial intelligence is the science, whilst machine learning is the enabler for AI. Companies like Google and Nvidia are at the forefront of AI development, conducting research and applying the science to work in areas such as visual processing (e.g.
[R][1610.09027] Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes [DeepMind] โข /r/MachineLearning
I use episodic memory so there is no write head. The idea is that instead of determining what you want to store and where to store it, you store everything in one summary state. The summary state is written in memory at every time step. The problem is then to learn to retrieve a previous summary state that helps with the current computation. At every time step, the network generates a retrieval key and mask for one state retrieval.
[Research] [1610.10099] Neural Machine Translation in Linear Time โข /r/MachineLearning
I wouldn't call PixelRNN to be a direct application of dilated convolutions. They do mention dilation, but I don't think they apply it for their Gated PixelCNN architecture, which I believe is SOTA for image generation (at least in terms in NLL). The other important difference is that the authors don't have a dilated convolution LSTM model for 1-dimensional data i.e wavenet and bytenet. They did explore such a structure in their work on conditional image generation - PixelRNN, Pixel Bi-LSTM etc.
The current state of machine intelligence 3.0
Almost a year ago, we published our now-annual landscape of machine intelligence companies, and goodness have we seen a lot of activity since then. This year's landscape has a third more companies than our first one did two years ago, and it feels even more futile to try to be comprehensive, since this just scratches the surface of all of the activity out there. As has been the case for the last couple of years, our fund still obsesses over "problem first" machine intelligence--we've invested in 35 machine intelligence companies solving 35 meaningful problems in areas from security to recruiting to software development. At the same time, the hype around machine intelligence methods continues to grow: the words "deep learning" now equally represent a series of meaningful breakthroughs (wonderful) but also a hyped phrase like "big data" (not so good!). We care about whether a founder uses the right method to solve a problem, not the fanciest one.
Apple joins group devoted to keeping Artificial Intelligence nice
A technology industry alliance devoted to making sure smart machines don't turn against humanity said today that Apple has signed on and will have a seat on the board. Microsoft, Amazon, Google, Facebook, IBM, and Google-owned British AI firm DeepMind last year established the non-profit organization, called "Partnership on AI," which will have its inaugural board meeting in San Francisco on February 3. "Apple has been involved and collaborating with the partnership since before it was first announced and is thrilled to formalize its membership," the alliance said in an online post. Major technology firms joined forces in the group, with stated aims including cooperation on "best practices" for AI and using the technology "to benefit people and society." Creation of the group came amid concerns that new artificial intelligence efforts could spin out of control and end up being detrimental to society. The companies "will conduct research, recommend best practices, and publish research under an open license in areas such as ethics, fairness, and inclusivity; transparency, privacy, and interoperability; collaboration between people and AI systems; and the trustworthiness, reliability, and robustness of the technology," according to a statement.
healthcare.ai
This blog has been talking a lot about Machine Learning (ML) with regard to tabular data. That makes sense because predictive algorithms based on tabular data are often easy to implement and have a lot of potential to improve outcomes. Also, we have access to a lot of tabular data from the EHR. However, ML is capable of doing a lot more than predicting probabilities on tabular data, and there are incredible opportunities in other areas of healthcare. One in particular is in Radiology and Pathology departments.
AI is as accurate as a doctor at spotting skin cancer
Artificial intelligence that is as accurate as human specialists at identifying skin cancer has been developed by computer scientists and dermatologists. The breakthrough was made by a team at Stanford University, who trained a deep-learning algorithm to diagnose skin cancer using a database of around 130,000 skin disease images. "We realized it was feasible, not just to do something well, but as well as a human dermatologist," said Sebastian Thrun, a professor at the Stanford Artificial Intelligence Laboratory. A woman covers herself in suncream to stress the point that people should protect themselves from the sun as part of a Cancer Research Campaign, April 8, 1998. Researchers have developed an Artificial Intelligence program that can diagnose skin lesions as accurately as any specialist.
Has Deep Learning Made Traditional Machine Learning Irrelevant?
Summary: The data science press is so dominated by articles on AI and Deep Learning that it has led some folks to wonder whether Deep Learning has made traditional machine learning irrelevant. Here we explore both sides of that argument. On Quora the other day I saw a question from an aspiring data scientist that asked โ since all the competitions on Kaggle these days are being won by Deep Learning algorithms, does it even make sense to bother studying traditional machine learning methods? Has Deep Learning made traditional machine learning irrelevant? I can understand on a couple of levels why he asked the question.
Data Efficient Deep Learning with G-CNNS, a machine learning innovation
Post written by Jorn Peters & Taco Cohen When we humans see an object we've never seen before, we are almost immediately able to recognize the same object in many different situations. For example, when a child learns about its new teddy bear, it will still recognize the teddy if you turn it upside down. In contrast, while current-generation Deep Neural Networks (DNNs) can learn to recognize the teddy bear eventually, they will need to see many examples of rotated teddy bears, each one labelled "teddy". This hunger for data, or "statistical inefficiency" is perhaps the most significant practical limitation of current deep learning technology. Many of our clients at Scyfer have problems that could be solved by deep learning, but don't have large annotated datasets.
What's next for Artificial Intelligence?
What can we expect from Artificial Intelligence? Four experts share their vision of expected advances in algorithms that are capable of improving their programming on their own. Yann LeCun (Facebook) wonders about the most effective way to teach machines to self-program and believes that "deep learning" will take us further than "machine learning." Andrew Ng (Baidu) analyses the potential effects of AI on work organisation and predicts a major shake-up in employment that is "unprecedented since the 1930s." Nick Bostrom (Future of Humanity Institute in Oxford) ponders the need to control AI to prevent its freewheeling algorithms from posing a threat to humankind.