HPC blog Just as Intel, the king of CPUs and the very bloodstream of computing announced that it is ending its Intel Development Forum (IDF) annual event, this week in San Jose, NVIDIA, the king of GPUs and the fuel of Artificial Intelligence is holding its biggest GPU Technology Conference (GTC) annual event yet. With something north of 95 per cent market share in laptops, desktops, and servers, Intel-the-company is far from even looking weak. Indeed, it is systematically adding to its strengths with strong indigenous high-density processing CPUs of its own, acquisition of budding AI chip vendors, pushing on storage-class memory, and advanced interconnects. But a revolution is nevertheless afoot. The end of CPU-dominated computing is upon us.

Get a close-up look at how they're changing industries by coming to any of 40-plus talks, checking out the exhibits and even attending an awards gala honoring the winners of our $1.5 million AI startup competition. You can also get a picture of the deep learning startup ecosystem during NVIDIA CEO and founder Jensen Huang's keynote on Wednesday at 9 am PT. The ecosystem, displayed below, shows leading areas of innovation by members of our Inception virtual accelerator. The eight-month-old program supports fledgling businesses revolutionizing industries with AI. Here's a closer look at some of the best ways to learn more about AI startups at GTC: For participants in our Inception virtual accelerator program, there are opportunities to connect with NVIDIA experts for advice on how to build AI products and services, how to shift from machine learning to deep learning and more.

As the basic toolkit becomes more rounded, that's where the applications will be - using pretrained models, maybe with a little fine tuning. Some of these functions should be included directly in the OS (such as speech recognition). I hope AI tools and pretrained models will become more and more integrated and accessible, because now they just sit in separate repositories and libraries, needing a considerable amount of effort to make them work together. One model does age detection, another does sex detection, another action recognition, and so on, but we need them all in one place. As I see it, AI is slowly converging towards differentiable programming, flexible network structure (torch-style frameworks), graph based neural nets and hierarchically composing higher order skills from lower order ones, anyway.

After all, it's been a popular focus in movies such as The Terminator, The Matrix, and Ex Machina (a personal favorite of mine). But you may have recently been hearing about other terms like "Machine Learning" and "Deep Learning," sometimes used interchangeably with artificial intelligence. As a result, the difference between artificial intelligence, machine learning, and deep learning can be very unclear. I'll begin by giving a quick explanation of what Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL) actually mean and how they're different. Then, I'll share how AI and the Internet of Things are inextricably intertwined, with several technological advances all converging at once to set the foundation for an AI and IoT explosion.

AI is moving at a stellar speed and is probably one of most complex and present sciences. The complexity here is not meant as a level of difficulty in understanding and innovating (although of course, this is quite high), but as the degree of interrelation with other fields apparently disconnected. There are basically two schools of thought on how an AI should be properly built: the Connectionists start from the assumption that we should draw inspiration from the neural networks of the human brain, while the Symbolists prefer to move from banks of knowledge and fixed rules on how the world works. Given these two pillars, they think it is possible to build a system capable of reasoning and interpreting. In addition, a strong dichotomy is naturally taking shape in terms of problem-solving strategy: you can solve a problem through a simpler algorithm, which though it increases its accuracy in time (iteration approach), or you can divide the problem into smaller and smaller blocks (parallel sequential decomposition approach).

Google, Microsoft, IBM, Apple, and 885 other players in the A.I. market have all been spinning their wheels in the wrong direction. Using brute force in machine learning and natural language processing (NLP) with advanced statistics, bots such as Siri, Echo, Viv, Hound, Skype and others fall off a cliff the moment they receive a command that is not an exact match for the engine. This is because NLP can only approximate meaning. For all the progress that has been made in A.I., there is one hard problem that has remained fundamentally unsolved: natural language understanding (NLU). According to John Giannandrea, a Google senior vice president, "understanding language is the holy grail of [A.I.]." "[If machines cannot] have a meaningful conversation, it quickly goes off the rails," said Andrew Ng, deep learning expert and chief scientist at Baidu and an associate professor at Stanford.

One of the biggest limiting factors of artificial intelligence (AI) systems is that they can't think or conceptualize the world the way humans can. Rather than intuitively discerning patterns in chaos, like how you can identify a cat in a photograph instantly, traditional AI models require in-depth descriptions of what constitutes a "cat" object and how to identify one by evaluating individual groups of pixels within the image. Deep learning systems are starting to bypass the necessity for brute force computations, as evidenced by the landmark victory of AI program AlphaGo against an international champion of Go, a game once thought to be too intuitive and conceptual for AI to master. But a new, yet intuitively simple, leap forward in AI learning may be able to accelerate the pace of AI development even further. Google researcher and AI expert Ian Goodfellow is working on AI that belongs to a group of "generative models," which are designed to create images and sounds comparable to those you'd find in the real world.

GPU instances naturally pair with deep learning as neural network algorithms can take advantage of their massive parallel processing power. AWS provides GPU instance families, such as g2 and p2, which allow customers to run scalable GPU workloads. You can leverage such scalability efficiently with AWS Batch. AWS Batch manages the underlying compute resources on-your behalf, allowing you to focus on modeling tasks without the overhead of resource management. Compute environments (that is, clusters) in AWS Batch are pools of instances in your account, which AWS Batch dynamically scales up and down, provisioning and terminating instances with respect to the numbers of jobs.

Deep neural networks and Deep Learning are powerful and popular algorithms. And a lot of their success lays in the careful design of the neural network architecture. I wanted to revisit the history of neural network design in the last few years and in the context of Deep Learning. For a more in-depth analysis and comparison of all the networks reported here, please see our recent article. Reporting top-1 one-crop accuracy versus amount of operations required for a single forward pass in multiple popular neural network architectures. It is the year 1994, and this is one of the very first convolutional neural networks, and what propelled the field of Deep Learning.

ChainerMN is an additional package for Chainer, a flexible deep learning framework. This blog post provides our benchmark results using up to 128 GPUs. ChainerMN can be used for both inner-node (i.e., multiple GPUs inside a node) and inter-node settings. For inter-node settings, we highly recommend to use high-speed interconnects such as InfiniBand. In addition to Chainer, ChainerMN depends on the following software libraries: CUDA-Aware MPI, NVIDIA NCCL, and a few Python packages.