Deep reinforcement learning (deep RL) has achieved superior performance in complex sequential tasks by using a deep neural network as its function approximator and by learning directly from raw images. A drawback of using raw images is that deep RL must learn the state feature representation from the raw images in addition to learning a policy. As a result, deep RL can require a prohibitively large amount of training time and data to reach reasonable performance, making it difficult to use deep RL in real-world applications, especially when data is expensive. In this work, we speed up training by addressing half of what deep RL is trying to solve --- learning features. Our approach is to learn some of the important features by pre-training deep RL network's hidden layers via supervised learning using a small set of human demonstrations. We empirically evaluate our approach using deep Q-network (DQN) and asynchronous advantage actor-critic (A3C) algorithms on the Atari 2600 games of Pong, Freeway, and Beamrider. Our results show that: 1) pre-training with human demonstrations in a supervised learning manner is better at discovering features relative to pre-training naively in DQN, and 2) initializing a deep RL network with a pre-trained model provides a significant improvement in training time even when pre-training from a small number of human demonstrations.

Google is ending a new artificial intelligence ethics council just one week after launching it, following protests from employees over the appointment of a rightwing thinktank leader. The rapid downfall of the Advanced Technology External Advisory Council (ATEAC), which was dedicated to "the responsible development of AI", came after more than 2,000 Google workers signed a petition criticizing the company's selection of an anti-LGBT advocate. "It's become clear that in the current environment, ATEAC can't function as we wanted. So we're ending the council and going back to the drawing board," a Google spokesperson told the Guardian in a statement on Thursday. Google faced intense backlash soon after announcing that one of the eight council members was Kay Coles James, the president of the Heritage Foundation, a conservative thinktank with close ties to Donald Trump's administration.

WASHINGTON - Embattled U.S. aviation giant Boeing on Thursday insisted on the "fundamental safety" of its 737 Max aircraft but pledged to take all necessary steps to ensure the jets' airworthiness. The statements came hours after Ethiopian officials said pilots of a doomed plane that crashed last month, leaving 157 people dead, had followed the company's recommendations. The preliminary findings released Thursday by transportation authorities in Addis Ababa put the American aircraft giant under even greater pressure to restore public trust amid mounting signs the company's onboard anti-stall systems were at fault in crashes involving its formerly top-selling 737 Max aircraft -- incidents that left nearly 350 people dead in less than five months. "We remain confident in the fundamental safety of the 737 Max," CEO Dennis Muilenburg said in a statement, adding that impending software fixes would make the aircraft "among the safest airplanes ever to fly." Muilenburg also acknowledged, however, that an "erroneous activation" of Boeing's Maneuvering Characteristics Augmentation System had occurred. The system is designed to prevent stalls but may have forced the Ethiopian and Indonesian jets into the ground.

Slate Plus members get extended, ad-free versions of our podcasts--and much more. Sign up today and try it free for two weeks. Copy this link and add it in your podcast app. For detailed instructions, see our Slate Plus podcasts page. Click on the play button to hear this episode, or listen to the show via Apple Podcasts, Overcast, Spotify, Stitcher, or Google Play.

"Oh, that looks gorgeous," drawls an onlooker in a Texas accent, as I guide my fighter through a gloomy, broken-down shack in a video game called Metro Exodus. I'm struggling in hand-to-hand combat with a zombie, so Dmitry Zhdan, who worked on the game, grabs the controls and beats my foe to death with a rifle butt.

God of War has won most of the big prizes at this year's Bafta Games Awards, including being crowned the best game of the year. The tough action-adventure game saw off other contenders such as Red Dead Redemption 2 and Assassin's Creed Odyssey to dominate the awards, picking up a variety of technical praise as well as the top prize. Other big winners included Nintendo Labo, the cardboard toys that can be played with the Switch. We'll tell you what's true. You can form your own view.

Gamers who pay for online services on Nintendo Switch, PlayStation and Xbox could be getting unfairly hit by fees. The competition watchdog has launched an investigation into the gaming platforms to understand whether their automatically renewing subscriptions are cheating gamers. The Competition and Markets Authority (CMA) said on Friday that its consumer law investigation will seek to determine if the consoles' business practices are legal. We'll tell you what's true. You can form your own view.

In an earlier post today, we distilled half a dozen DARPA-dense docs into an easy-to-follow overview of the DARPA Subterranean Challenge (SubT), a new competition that will task teams of humans and robots to explore complex underground environments. In this post, we have an interview with SubT program manager Timothy Chung, whom we met late last year at DARPA's D60 Conference. "I think for many of the technologies we're seeking to advance--it's one of those, aim for the moon, even if you miss you hit the stars type of an approach," he told us about the new challenge. "So we envision some component technologies being immediately operationally of value, but we've set the bar ambitiously high enough for it to be DARPA-worthy and also provide a vision for how that kind of impact could be magnified if and when we're successful." IEEE Spectrum: What are the SubT courses going to be like?

As part of the very first event in the DARPA Subterranean Challenge (SubT), the organizers have invited nine teams (and their robots) to Edgar Experimental Mine in Idaho Springs, Colo., for a sort of test run called the SubT Integration Exercise, or STIX. These nine teams have already demonstrated their systems to DARPA, showing that they can navigate autonomously over rough terrain, locate objects, and respond to an e-stop command if they go berserk. For the teams, this will be an opportunity to test out their robots in an actual tunnel system, and at the same time DARPA itself will be able to make sure all of their testing infrastructure and whatnot works, well in advance of the Tunnel Circuit Challenge itself, which will take place in August. Our detailed post on SubT and interview with DARPA program manager Timothy Chung cover all of this stuff, along with the guidelines that teams have to follow when designing and deploying their systems, but all that information doesn't necessarily give a sense of what kind of hardware teams will likely be deploying at SubT. Fortunately, many of the teams participating in STIX have posted pictures or videos of their robots, so we've put together this article to introduce each team and have a look at what they'll be working with.

Griffin Spikoski spends as much as 18 hours a day glued to his computer screen playing the wildly popular, multi-player video game Fortnite. His YouTube channel -- where he regularly uploads videos of himself playing the online game -- has nearly 1.2 million subscribers and more than 71 million views; figures that have netted him advertisers, sponsorships and a steady stream of income. Last year, that income totaled nearly $200,000. The healthy sum -- more than enough to comfortably raise a family in most American cities -- is all the more impressive considering Spikoski is 14 years old. Still, he approaches video games the way an elite student athlete would approach a sport like football or basketball: when he's not playing, Spikoski, who goes by the name "Sceptic" on YouTube, completes school work online.