Deep Learning
Demis Hassabis: the deep mind Dominic Cummings turned to as the pandemic hit
At first glance, Demis Hassabis is an unusual figure for Dominic Cummings to have turned to for guidance in March 2020 about the threat of the novel coronavirus bearing down on the UK. The co-founder of Google subsidiary DeepMind, which is dedicated to high-level AI research, has a varied CV, but is no epidemiologist. A child chess prodigy, he hit the rank of master at 13 and was for a brief time the second-highest-rated player in the world in his age category. After completing his A-levels two years early, he joined video game studio Bullfrog, where he co-designed the hit classic Theme Park at just 17 years old, before leaving to study computer science at Cambridge. He returned to video game development for another decade, and, after switching back to academia and a PhD in cognitive neuroscience, founded DeepMind in 2011. In the decade since, during which DeepMind was sold to Google for £400m, the company has worked on a number of healthcare problems.
Microsoft announces first product features running on GPT-3
During its Build developers conference this year, Microsoft announced its first features for a product fueled by GPT-3, the natural language model from OpenAI developed to assist users in building applications without any programming knowledge. GPT-3 will come into play through Microsoft Power Apps, the low code app development platform that a helps a wide range of folks from those with no programming experienced to those considered experienced developers. So far, this platform has aided in the development of apps for travel during COVID-19, review of nonprofit gift donation and decreasing the amount of overtime needed for wind turbine maintenance. For example, the AI-powered platform will allow users to search for e-commerce products with a query such as "Find products where the name starts with'kids,'" similar to SQL. An efficient GPT-3 model will then convert that query as a formula into the open source Power Platform language, Microsoft Power Fx. Microsoft claims that this new platform solution will greatly benefit enterprises by using its new managed endpoints capability to solve real-world business problems, backed by familiar components such as Microsoft Azure for operation and Azure Machine Learning as a power source.
Batch Norm Explained Visually -- Why does it work
The Batch Norm layer is frequently used in deep learning models in association with a Convolutional or Linear layer. Many state-of-the-art Computer Vision architectures such as Inception and Resnet rely on it to create deeper networks that can be trained faster. In this article, we will explore why Batch Norm works and why it requires fewer training epochs when training a model. You might also enjoy reading my other article on Batch Norm which explains, in simple language, what Batch Norm is and walks through, step by step, how it operates under the hood. And if you're interested in Neural Network architectures in general, I have some other articles you might like.
Under the AI hood: A view from RSA Conference
Artificial intelligence and machine learning are often touted in IT as crucial tools for automated detection, response, and remediation. Enrich your defenses with finely honed prior knowledge, proponents insist, and let the machines drive basic security decisions at scale. This year's RSA Conference had an entire track dedicated to security-focused AI, while the virtual show "floor" featured no fewer than 45 vendors hawking some form of AI or machine learning capabilities. While the profile of AI in security has evolved over the past five years from a dismissible buzzword to a legitimate consideration, many question its efficacy and appropriateness -- and even its core definition. This year's conference may not have settled the debate, but it did highlight the fact that AI, ML, and other deep-learning technologies are making their way deeper into the fabric of mainstream security solutions.
AI is learning how to create itself
But it's not what the bots are learning that's exciting--it's how they're learning. POET generates the obstacle courses, assesses the bots' abilities, and assigns their next challenge, all without human involvement. Step by faltering step, the bots improve via trial and error. "At some point it might jump over a cliff like a kung fu master," says Wang. It may seem basic at the moment, but for Wang and a handful of other researchers, POET hints at a revolutionary new way to create supersmart machines: by getting AI to make itself. Wang's former colleague Jeff Clune is among the biggest boosters of this idea. Clune has been working on it for years, first at the University of Wyoming and then at Uber AI Labs, where he worked with Wang and others. Now dividing his time between the University of British Columbia and OpenAI, he has the backing of one of the world's top artificial-intelligence labs. Clune calls the attempt to build truly intelligent AI the most ambitious scientific quest in human history.
How to train your deep learning models in a distributed fashion.
Deep learning algorithms are well suited for large data sets and also training deep learning networks needs large computation power. With GPUs / TPUs easily available on pay per use basis or for free (like Google collab), it is possible today to train a large neural network on cloud-like say Resnet 152 (152 layers) on ImageNet database which has around 14 million images. But is a multi-core GPU-enabled machine just enough to train huge models. Technically yes, but it might take weeks to train the model. So how do we reduce the training time?
Microsoft Build 2021: Latest announcements include browser improvements, Teams updates, and new AI tools
Microsoft's annual Build conference saw a host of new product developments, many of which were focused on its cloud computing technology and updates for consumer services. The company's browser, Edge, and its video conferencing tool Teams, are where the average user is likely to see the most changes, but Microsoft also revealed some tools using GPT-3, the artificial intelligence language tool made by OpenAI. However, the biggest update that users might have been expecting – a new version of its Windows operating system – is still to come, with CEO Satya Nadella saying that the "the next generation of Windows" is coming "very soon". Microsoft says Edge is'best performing browser on Windows 10' The software giant's update to Edge 91 makes it, in the company's words, the best browser on Windows 10. Why Internet Explorer had to die Bitcoin price – live: Ethereum up $1,000 amid'highly positive' outlook for crypto Cryptocurrency has'no intrinsic value' and investors could'lose all your money', says Bank of England chief Cryptocurrency has'no intrinsic value' and investors could'lose all your money', says Bank of England chief There are two reasons for this, Microsoft wrote in a blog post explaining the updates: "Startup boost and sleeping tabs".
GPT-3's ability to 'write disinformation' is being wildly overstated by the media
GPT-3, the highly-touted text generator built by OpenAI, can do a lot of things. For example, Microsoft today announced a new AI-powered "autocomplete" system for coding that uses GPT-3 to build out code solutions for people without requiring them to do any developing. But one thing the technology can not do is "dupe humans" with its ability to write misinformation. Yet, you wouldn't know that if you were solely judging by the headlines in your news feed. Wired recently ran an article with the title "GPT-3 can write disinformation now – and dupe human readers," and it was picked up by other outlets who then reflected the coverage.
5 Topmost Programming Languages used by AI Engineers in 2021
As per the PwC estimates, AI will contribute up to USD 15.7 trillion to the global economy and business by 2030. This shows the pace at which AI is growing. The success potential of AI as defined by PwC offers an excellent array of job prospects for AI engineers. Programming language is the base on which AI stands firm, and keeps moving towards superior heights. Among many programming languages, AI engineers must choose the right one that fits their project's requirements.
Understanding Transformers, the machine learning model behind GPT-3
You know that expression When you have a hammer, everything looks like a nail? Well, in machine learning, it seems like we really have discovered a magical hammer for which everything is, in fact, a nail, and they're called Transformers. Transformers are models that can be designed to translate text, write poems and op eds, and even generate computer code. In fact, lots of the amazing research I write about on daleonai.com is built on Transformers, like AlphaFold 2, the model that predicts the structures of proteins from their genetic sequences, as well as powerful natural language processing (NLP) models like GPT-3, BERT, T5, Switch, Meena, and others. You might say they're more than meets the… ugh, forget it.