While the foundations for deep learning sate to the 1980s, researchers George Dahl and Abdel-rahman Mohamed broke new ground in 2010 when they developed advanced deep learning speech recognition tools. This paved the way for more deep learning advances focusing on anything from facial recognition to machine translation. In 2011 a question-answering computer system developed by IBM's DeepQA project made headlines when it outplayed Brad Rutter and Ken Jennings, two of the most successful contestants to take part in the popular American game show Jeopardy! Artificial intelligence took another stride forward in October 2011 when Apple launched Siri, it's signature personal assistant. From reciting the weather forecast to plotting a route on Google Maps, Siri is now used by hundreds of millions of people around the world.

Perhaps you've wondered how Facebook or Instagram is able to automatically recognize faces in an image, or how Google lets you search the web for similar photos just by uploading a photo of your own. These features are examples of computer vision, and they are powered by convolutional neural networks (CNNs). Yet what exactly are convolutional neural networks? Let's take a deep dive into the architecture of a CNN and understand how they operate. Before we begin talking about convolutional neural networks, let's take a moment to define regular neural networks.

Reinforcement learning, an AI training technique that employs rewards to drive software policies toward goals, has been applied successfully to domains from industrial robotics to drug discovery. But while firms including OpenAI and Alphabet's DeepMind have investigated its efficacy in video games like Dota 2, Quake III Arena, and StarCraft 2, few to date have studied its use under constraints like those encountered in the game industry. That's presumably why Ubisoft La Forge, game developer Ubisoft's eponymous prototyping space, proposed in a recent paper an algorithm that's able to handle discrete, continuous video game actions in a "principled" and predictable way. They set it loose on a "commercial game" (likely The Crew or The Crew 2, though neither is explicitly mentioned) and report that it's competitive with state-of-the-art benchmark tasks. "Reinforcement Learning applications in video games have recently seen massive advances coming from the research community, with agents trained to play Atari games from pixels or to be competitive with the best players in the world in complicated imperfect information games," wrote the coauthors of a paper describing the work.

Summary: For all the hype around winning game play and self-driving cars, traditional Reinforcement Learning (RL) has yet to deliver as a reliable tool for ML applications. Here we explore the main drawbacks as well as an innovative approach to RL that dramatically reduces the training compute requirement and time to train. Ever since Reinforcement Learning (RL) was recognized as a legitimate third style of machine learning alongside supervised and unsupervised learning we've been waiting for that killer app to prove its value. Yes RL has had some press-worthy wins in game play (Alpha Go), self-driving cars (not here yet), drone control, and even dialogue systems like personal assistants but the big breakthrough isn't here yet. RL ought to be our go-to solution for any problem requiring sequential decisions and these individual successes might make you think that RL is ready for prime time but the reality is that it's not.

While training the model, we want to get the best possible result according to the chosen metric. And at the same time we want to keep a similar result on the new data. The cruel truth is that we can't get 100% accuracy. And even if we did, the result is still not without errors. There are simply too few test situations to find them. You may ask, what is the matter?

In 2017 I decided to find out what would happen if I trained a neural net on 240 Christmas carols (collected by The Times of London and reader/neural net hobbyist Erik Svensson). Run, run Rudolph, run, run Rudolph, run, run Rudolph, run, run Rudolph, run, run Rudolph, run, run Rudolph, run, run Rudolph, run, run Rudolf the new born King. You can kind of understand where the confusion came from. But that was 2017, when I was training char-rnn from scratch on my laptop. Now in 2019 I have access to the much more powerful GPT-2, trained by OpenAI on 40GB of text from the internet.

Though we cannot tell what the future holds for us, we can make predictions based on trends. JT Kostman Ph.D – A global cyber crime pandemic ($6T annually) and an ever-expanding alphabet soup of data privacy/protection legislation will increasingly require Data Scientists to accept dual responsibilities as data fiduciaries. As the volume, velocity, variety, virality, and viciousness of cyber attacks inexorably increases, AI solutions will increasingly become the only way to compensate for the projected shortfall of 1.8 million cyber security professionals otherwise needed to combat increasingly sophisticated and determined adversaries – and keep corporate executives out of court. Cassie Kozurkov – We can expect to see improvements in tools for data science as more user experience designers take an interest in the data scientist as user. Image data will grow in importance as the camera becomes more than a way to capture memories, but evolves towards a more natural way for users to interact with apps.

There are a few core skills in every job. To perform that job, you need to be aware of core concepts, you need to be aware of the end to end process and you need to learn how to use related tools to perform that job. Artificial Intelligence is no different, it has its own core concepts, processes and tools. This post covers the core concepts you need to learn, the end-to-end process you need to be aware of & important tools you need to master to work as a data scientist. Please note that this post only outlines the concepts, processes and tools used by data scientists.

Healthcare organizations and technology vendors connect to Redox once, then authorize what data they send to and receive from partners through a centralized hub. Redox's cloud-based platform is vendor and standards agnostic and enables the secure and efficient exchange of healthcare data. This approach eradicates the need for point-to-point integrations and accelerates the discovery, adoption, and distribution of patient and provider-facing technology solutions. With hundreds of healthcare organizations and technology vendors exchanging data today, Redox represents the largest interoperable network in healthcare. Learn how you can leverage the Redox platform at www.redoxengine.com.

Recently deep neural networks (DNNs) have been successfully introduced to the field of lensless imaging through scattering media. By solving an inverse problem in computational imaging, DNNs can overcome several shortcomings in the conventional lensless imaging through scattering media methods, namely, high cost, poor quality, complex control, and poor anti-interference. However, for training, a large number of training samples on various datasets have to be collected, with a DNN trained on one dataset generally performing poorly for recovering images from another dataset. The underlying reason is that lensless imaging through scattering media is a high dimensional regression problem and it is difficult to obtain an analytical solution. In this work, transfer learning is proposed to address this issue. Our main idea is to train a DNN on a relatively complex dataset using a large number of training samples and fine-tune the last few layers using very few samples from other datasets. Instead of the thousands of samples required to train from scratch, transfer learning alleviates the problem of costly data acquisition. Specifically, considering the difference in sample sizes and similarity among datasets, we propose two DNN architectures, namely LISMU-FCN and LISMU-OCN, and a balance loss function designed for balancing smoothness and sharpness. LISMU-FCN, with much fewer parameters, can achieve imaging across similar datasets while LISMU-OCN can achieve imaging across significantly different datasets. What's more, we establish a set of simulation algorithms which are close to the real experiment, and it is of great significance and practical value in the research on lensless scattering imaging. In summary, this work provides a new solution for lensless imaging through scattering media using transfer learning in DNNs.