Using Machine Learning to Address AI Risk - Future of Life Institute

The following article and talk are by Jessica Taylor and they were originally posted on MIRI. At the EA Global 2016 conference, I gave a talk on "Using Machine Learning to Address AI Risk": It is plausible that future artificial general intelligence systems will share many qualities in common with present-day machine learning systems. If so, how could we ensure that these systems robustly act as intended? We discuss the technical agenda for a new project at MIRI focused on this question. The talk serves as a quick survey (for a general audience) of the kinds of technical problems we're working on under the "Alignment for Advanced ML Systems" research agenda. Included below is a version of the talk in blog post form.1 This talk is about a new research agenda aimed at using machine learning to make AI systems safe even at very high capability levels.