How do you defeat "deepfakes"? According to Google, you develop more of them. Google just released a large, free database of deepfake videos to help research develop detection tools. Google collaborated with "Jigsaw", a tech "incubator" founded by Google, and the FaceForesenics Benchmark Program at the Technical University of Munich and the University Federico II of Naples. They worked with several paid actors to create hundreds of real videos and then used popular deepfake technologies to generate thousands of fake videos.
Watch -- very closely -- as an ambitious group of A.I. engineers and machine-learning specialists try to mimic reality with such accuracy that you may not be able to tell what's real from what's not. If successful, they'll have created the ultimate deepfake, an ultrarealistic video that makes people appear to say and do things they haven't. Experts warn it may only be a matter of time before someone creates a bogus video that's convincing enough to fool millions of people. Over several months, "The Weekly" embedded with a team of creative young engineers developing the perfect deepfake -- not to manipulate markets or game an election, but to warn the public about the dangers of technology meant to dupe them. The team picked one of the internet's most recognizable personalities, the comedian and podcaster Joe Rogan, who unwittingly provided the inspiration for the engineers' deepfake moonshot.
The furor around deepfakes, porn videos that use machine learning to convincingly edit celebrities into sex scenes, has largely died down since many hosting sites banned the clips months ago. But deepfakes are still out there, even on sites where they're not technically allowed. Popular streaming site PornHub, which classifies deepfakes as nonconsensual and theoretically doesn't permit them, still hosts dozens of the videos. BuzzFeed's Charlie Warzel wrote on Wednesday that he'd found more than 100 deepfake videos on PornHub, and they weren't particularly well-hidden. Searches like "deepfake" and "fake deeps" brought up dozens of clips.
The Cyberspace Administration of China (CAC) announced on Friday that it is making it illegal for fake news to be created with deepfake video and audio, according to Reuters. "Deepfakes" are video or audio content that have been manipulated using AI to make it look like someone said or did something they have never done. In its statement, the CAC said "With the adoption of new technologies, such as deepfake, in online video and audio industries, there have been risks in using such content to disrupt social order and violate people's interests, creating political risks and bringing a negative impact to national security and social stability," according to the South China Morning Post reporting on the new regulations. The CAC's regulations, which go into effect on January 1, 2020, require publishers of deepfake content to disclose that a piece of content is, indeed, a deepfake. It also requires content providers to detect deepfake content themselves, according to the South China Morning Post.
The social media giant is putting $10 million into the "Deepfake Detection Challenge," which aims to spur detection research. As part of the project, Facebook is commissioning researchers to produce realistic deepfakes to create a data set for testing detection tools. The company said the videos, which will be released in December, will feature paid actors and that no user data would be utilized. In the run-up to the U.S. presidential election in November 2020, social platforms have been under pressure to tackle the threat of deepfakes, which use artificial intelligence to create hyper-realistic videos where a person appears to say or do something they did not. While there has not been a well-crafted deepfake video with major political consequences in the United States, the potential for manipulated video to cause turmoil was recently demonstrated by a "cheapfake" clip of House Speaker Nancy Pelosi, manually slowed down to make her speech seem slurred.