Deep Learning
Open-Ended Learning Leads to Generally Capable Agents
Open Ended Learning Team, null, Stooke, Adam, Mahajan, Anuj, Barros, Catarina, Deck, Charlie, Bauer, Jakob, Sygnowski, Jakub, Trebacz, Maja, Jaderberg, Max, Mathieu, Michael, McAleese, Nat, Bradley-Schmieg, Nathalie, Wong, Nathaniel, Porcel, Nicolas, Raileanu, Roberta, Hughes-Fitt, Steph, Dalibard, Valentin, Czarnecki, Wojciech Marian
In this work we create agents that can perform well beyond a single, individual task, that exhibit much wider generalisation of behaviour to a massive, rich space of challenges. We define a universe of tasks within an environment domain and demonstrate the ability to train agents that are generally capable across this vast space and beyond. The environment is natively multi-agent, spanning the continuum of competitive, cooperative, and independent games, which are situated within procedurally generated physical 3D worlds. The resulting space is exceptionally diverse in terms of the challenges posed to agents, and as such, even measuring the learning progress of an agent is an open research problem. We propose an iterative notion of improvement between successive generations of agents, rather than seeking to maximise a singular objective, allowing us to quantify progress despite tasks being incomparable in terms of achievable rewards. We show that through constructing an open-ended learning process, which dynamically changes the training task distributions and training objectives such that the agent never stops learning, we achieve consistent learning of new behaviours. The resulting agent is able to score reward in every one of our humanly solvable evaluation levels, with behaviour generalising to many held-out points in the universe of tasks. Examples of this zero-shot generalisation include good performance on Hide and Seek, Capture the Flag, and Tag. Through analysis and hand-authored probe tasks we characterise the behaviour of our agent, and find interesting emergent heuristic behaviours such as trial-and-error experimentation, simple tool use, option switching, and cooperation. Finally, we demonstrate that the general capabilities of this agent could unlock larger scale transfer of behaviour through cheap finetuning.
Artificial Intelligence May Find Signs Of Alzheimer's In Neuroimaging Data
Shuiwang Ji, associate professor in the Department of Computer Science and Engineering at Texas A&M University, is one of the principal investigators on a $6 million grant from the National Institutes of Health to develop artificial intelligence-driven methods to automate the process of finding subtle telltale signs of Alzheimer's disease in neuroimaging data. Ji will lead the research team tasked with developing advanced deep-learning methods for finding relevant neural signatures lurking within neuroimages taken using different techniques, such as PET scans and MRIs. "I feel very excited with this collaborative opportunity to make scientific discoveries in medical domains using deep learning and artificial intelligence," said Ji, who has extensive expertise in machine learning, deep learning and medical image analysis. Alzheimer's disease affects 5.6 million Americans over the age of 65, and its symptoms are most noticeably the progressive impairment of cognitive and memory functions. It is also currently the most common form of dementia in the elderly.
The Data Science Course 2021: Complete Data Science Bootcamp
The course provides the entire toolbox you need to become a data scientist Fill up your resume with in demand data science skills: Statistical analysis, Python programming with NumPy, pandas, matplotlib, and Seaborn, Advanced statistical analysis, Tableau, Machine Learning with stats models and scikit-learn, Deep learning with TensorFlow Impress interviewers by showing an understanding of the data science field Learn how to pre-process data Understand the mathematics behind Machine Learning (an absolute must which other courses don't teach!) Start coding in Python and learn how to use it for statistical analysis Perform linear and logistic regressions in Python Carry out cluster and factor analysis Be able to create Machine Learning algorithms in Python, using NumPy, statsmodels and scikit-learn Apply your skills to real-life business cases Use state-of-the-art Deep Learning frameworks such as Google's TensorFlowDevelop a business intuition while coding and solving tasks with big data Unfold the power of deep neural networks Improve Machine Learning algorithms by studying underfitting, overfitting, training, validation, n-fold cross validation, testing, and how hyperparameters could improve performance Warm up your fingers as you will be eager to apply everything you have learned here to more and more real-life situations No prior experience is required. We will start from the very basics You'll need to install Anaconda. We will show you how to do that step by step Microsoft Excel 2003, 2010, 2013, 2016, or 365 The Problem Data scientist is one of the best suited professions to thrive this century. It is digital, programming-oriented, and analytical. Therefore, it comes as no surprise that the demand for data scientists has been surging in the job marketplace.
Becoming Human: AI Progress
People can acquire and apply general knowledge to solve problems in a wide range of subject areas. Some of them are absorbed by all people, such as walking and talking. Over the past five years, AI has made a huge impact. Not a day goes by without media coverage of AI applications, and start-up activity skyrocketing and new ventures thriving in the field. For example, according to this report, AI companies increased their activity by 72% in 2018 compared to 2017.
Future of Artificial Intelligence (AI) for Business
Artificial intelligence (AI) is continuing its migration out of the research lab and into the world of business. Leading companies across hundreds of industries are harnessing its power -- from banks analyzing countless data points in seconds to detect fraud, to call centers deploying chatbots to improve customer interactions. These early uses are still fairly limited, but huge advances in deep learning (a subset of machine learning) are starting to impact AI in ways that will soon help society and business tackle a wider set of more general problems. Such advances will also make it possible to automate more complex physical tasks that require adaptability and agility. At Salesforce, we believe AI has tremendous potential for improving the way organizations operate (and you can learn how AI is built into our entire Salesforce Customer 360 here).
An endlessly changing playground teaches AIs how to multitask
They advance to more complex multiplayer games like hide and seek or capture the flag, where teams compete to be the first to find and grab their opponent's flag. The playground manager has no specific goal but aims to improve the general capability of the players over time. AIs like DeepMind's AlphaZero have beaten the world's best human players at chess and Go. But they can only learn one game at a time. As DeepMind cofounder Shane Legg put it when I spoke to him last year, it's like having to swap out your chess brain for your Go brain each time you want to switch games.
How Artificial Intelligence Detects Faces?
You might've heard about face recognition and its different applications. A face recognition system can identify people in videos or static images to put it in simple terms. Many fields use the technology for surveillance and tracking people. Some countries are using face recognition systems more widely than others. But while you may hear about it more frequently now, the technology has been in existence for decades.
Accelerating Quadratic Optimization Up to 3x With Reinforcement Learning
First-order methods for solving quadratic programs (QPs) are widely used for rapid, multiple-problem solving and embedded optimal control in large-scale machine learning. The problem is, these approaches typically require thousands of iterations, which makes them unsuitable for real-time control applications that have tight latency constraints. To address this issue, a research team from the University of California, Princeton University and ETH Zurich has proposed RLQP, an accelerated QP solver based on operator-splitting QP (OSQP) that uses deep reinforcement learning (RL) to compute a policy that adapts the internal parameters of a first-order quadratic program (QP) solver to speed up the solver's convergence rate. The team performed their speed-up on the OSQP solver, which solves QPs using a first-order alternating direction method of multipliers (ADMM), an efficient first-order optimization algorithm. The RLQP strives to learn a policy to adapt the internal parameters of the ADMM algorithm between iterations in order to minimize solve times.
Deep Learning-based Frozen Section to FFPE Translation
Frozen sectioning (FS) is the preparation method of choice for microscopic evaluation of tissues during surgical operations. The high speed of the procedure allows pathologists to rapidly assess the key microscopic features, such as tumour margins and malignant status to guide surgical decision-making and minimise disruptions to the course of the operation. However, FS is prone to introducing many misleading artificial structures (histological artefacts), such as nuclear ice crystals, compression, and cutting artefacts, hindering timely and accurate diagnostic judgement of the pathologist. Additional training and prolonged experience is often required to make highly effective and time-critical diagnosis on frozen sections. On the other hand, the gold standard tissue preparation technique of formalin-fixation and paraffin-embedding (FFPE) provides significantly superior image quality, but is a very time-consuming process (12-48 hours), making it unsuitable for intra-operative use. In this paper, we propose an artificial intelligence (AI) method that improves FS image quality by computationally transforming frozen-sectioned whole-slide images (FS-WSIs) into whole-slide FFPE-style images in minutes.
AI system learns to see better through blurry images - Innovation Origins
Dutch and Spanish computer scientists have discovered how systems that use artificial intelligence (AI) learn in practice. In many systems that are based on so-called'deep learning', it was not clear how that learning process actually took place. The researchers have now managed to figure out how an image recognition system learns about its environment. Then they simplified that learning system by forcing it to focus on less important information as well. AI systems for image recognition are of great importance for autonomous driving cars, for a start.