Generative AI
AI proves 'too good' at writing fake news, held back by researchers
The organization created a machine learning algorithm, GPT-2, that can produce natural-looking language largely indistinguishable from that of a human writer while largely "unsupervised" โ it needs only a small prompt text to provide the subject and context for the task. The team have made some strides toward this lofty goal, but have also somewhat inadvertently admitted that, once perfected, the device can mass-produce fake news on an unprecedented scale. "We have observed various failure modes," the team observed. "Such as repetitive text, world modelling failures (eg the model sometimes writes about fires happening under water), and unnatural topic switching." Here's a short story i generated using OpenAI's GPT-2 tool (prompt in bold) pic.twitter.com/DGIVwGuAUV
Elon Musk-backed AI Company Claims It Made a Text Generator That's Too Dangerous to Release
Researchers at the non-profit AI research group OpenAI just wanted to train their new text generation software to predict the next word in a sentence. It blew away all of their expectations and was so good at mimicking writing by humans they've decided to pump the brakes on the research while they explore the damage it could do. Elon Musk has been clear that he believes artificial intelligence is the "biggest existential threat" to humanity. Musk is one of the primary funders of OpenAI and though he has taken a backseat role at the organization, its researchers appear to share his concerns about opening a Pandora's box of trouble. This week, OpenAI shared a paper covering their latest work on text generation technology but they're deviating from their standard practice of releasing the full research to the public out of fear that it could be abused by bad actors.
Too scary? Elon Musk's OpenAI company won't release tech that can generate fake news
The spread of fake news is already a very real problem. Artificial intelligence could make the problem even worse. That prospect is so frightening that an Elon Musk-backed non-profit called OpenAI has decided not to publicly circulate AI-based text generation technology that enables researchers to spin an all-too-convincing--and yes, fabricated--machine-written article. "Due to our concerns about malicious applications of the technology, we are not releasing the trained model," OpenAI blogged. Such concerns go beyond just generating misleading news articles.
Fears of OpenAI's super-trolling artificial intelligence are overblown
Recycling is NOT good for the world. It is bad for the environment, it is bad for our health, and it is bad for our economy. These are the words of GPT-2, an artificially intelligent super-troll. It needs just a few words to prompt a rant hundreds of words long on almost any topic and its creators say it may be too dangerous to release to the public because of potential misuse. However, these fears are overblown.
Amazing new AI churns out "coherent paragraphs of text"
OpenAI, the artificial intelligence research company founded by tech heavyweights including Elon Musk and Peter Thiel, says it's developed the most advanced language-processing algorithm so far. Sample outputs suggest that the AI system is an extraordinary step forward, producing text rich with context, nuance and even something approaching humor. It's so good, in fact, that OpenAI says it's not releasing its code to the public because its researchers are scared it could be misused, according to a new blog post. The algorithm, GPT-2, was trained on some 8 million web pages, according to the new research. Given a prompt, GPT-2 is tasked with predicting the next word based how those words have been used on the websites it read.
Researchers create 'malicious' writing AI
A team of researchers who have built an artificially-intelligent writer say they are withholding the technology as it might be used for "malicious" purposes. OpenAI, based in San Francisco, is a research institute backed by Silicon Valley luminaries including Elon Musk and Peter Thiel. It shared some new research on using machine learning to create a system capable of producing natural language, but in doing so the team expressed concern the tool could be used to mass-produce convincing fake news. Which, to put it another way, is of course also an admission that what its system puts out there is unreliable, made-up rubbish. Still, when it works well, the results are impressively realistic in tone - which is why I've shared a sample of it below.
AI can write disturbingly believable fake news
AI is getting better and better at writing convincing material, and that's leading its creators to wonder whether they should release the technology in the first place. Elon Musk's OpenAI has developed an algorithm that can generate plausible-looking fake news stories on any topic using just a handful of words as a starting point. It was originally designed as a generalized language AI that could answer questions, summarizing stories and translating text, but researchers soon realized that it could be used for far more sinister purposes, like pumping out disinformation in large volumes. As a result, the team only plans to make a "simplified version" of its AI available to the public, according to MIT Technology Review. The technology thankfully has some rough edges at the moment. It frequently writes stories that are either plagiarized or are only cohesive on the surface, and only occasionally hits the jackpot.
The AI Text Generator That's Too Dangerous to Make Public
In 2015, car-and-rocket man Elon Musk joined with influential startup backer Sam Altman to put artificial intelligence on a new, more open course. They cofounded a research institute called OpenAI to make new AI discoveries and give them away for the common good. Now, the institute's researchers are sufficiently worried by something they built that they won't release it to the public. The AI system that gave its creators pause was designed to learn the patterns of language. It does that very well--scoring better on some reading-comprehension tests than any other automated system.
What Games Are Humans Still Better at Than AI?
Artificial intelligence (AI) systems' rapid advances are continually crossing rows off the list of things humans do better than our computer compatriots. AI has bested us at board games like chess and Go, and set astronomically high scores in classic computer games like Ms. Pacman. More complex games form part of AI's next frontier. While a team of AI bots developed by OpenAI, known as the OpenAI Five, ultimately lost to a team of professional players last year, they have since been running rampant against human opponents in Dota 2. Not to be outdone, Google's DeepMind AI recently took on--and beat--several professional players at StarCraft II.
Deep Generative Learning via Variational Gradient Flow
Gao, Yuan, Jiao, Yuling, Wang, Yang, Wang, Yao, Yang, Can, Zhang, Shunkang
Learning the generative model, i.e., the underlying data generating distribution, based on large amounts of data is one the fundamental task in machine learning and statistics [46].Recent advances in deep generative models have provided novel techniques for unsupervised and semi-supervised learning, with broad application varying from image synthesis [44], semantic image editing [60], image-to-image translation [61] to low-level image processing [29]. Implicit deep generative model is a powerful and flexible framework to approximate the target distribution by learning deep samplers [38] including Generative adversarialnetworks (GAN) [16] and likelihood based models, such as variational auto-encoders (VAE) [23] and flow based methods [11], as their main representatives. The above mentioned implicit deep generative models focus on learning a deterministic or stochastic nonlinear mapping that can transform low dimensional latent samples from referenced simple distribution to samples that closely match the target distribution. GANs build a minmax two player game between the generator and discriminator. During the training, the generator transforms samples from a simple reference distribution into samples that would hopefully to deceive the discriminator, while the discriminator conducts a differential two-sample test to distinguish the generated samples from the observed samples. The objective of vanilla GANs amounts to the Jensen-Shannon (JS) divergence between the learned distribution and target distributions. The vanilla GAN generates sharp image samples but suffers form the instability issues [3]. A myriad of extensions to vanilla GANs have been investigated, both theoretically or empirically, in order to achieve a stable training and high quality sample generation.