Generative AI
AI: The Ghost-writer From the Future -- AI Daily - Artificial Intelligence News
The applications of this system are truly remarkable. GPT 2 has the potential to completely reshape the landscape of article writing, as human input could very soon start to be replaced by AI technologies. This could be realised in writing and research assistance, as vast amounts of data could be summarised and rewritten without requiring human input. However, as is so often the case with AI, there exist various issues with the system. Primarily, the misuse of such technology could allow cybercriminals to more easily carry out malicious activity e.g. by automating the generation of spam content. Furthermore, despite being ahead of its competitors, OpenAI admits to having observed various failures of GPT-2 e.g.
OpenAI's commercial release of API raises serious questions about AI misuse
Originally, the artificial intelligence (AI) development and research organization, OpenAI, was founded as a nonprofit with the ambitious mission of ensuring artificial general intelligence would benefit all humanity. Since then, much has happened, starting with original founder Elon Musk leaving OpenAI's board in 2018. In July of 2019, the narrative changed yet again after the company received a $1 billion investment from Microsoft. The company exists today as a "capped-profit" organization. Most notably during this time, the company developed a text-generating language system it chose to not release "due to our concerns about malicious applications of the technology," then subsequently released said system.
How APIs Can Save AI Research Labs: Lessons From OpenAI
"It is not a dream, it is a simple feat of scientific engineering, only expensive -- blind, faint-hearted, doubting world!" Discovering a new medicine is a billion-dollar research endeavour. At least, it can draw in the money as the results are kind of self-explanatory; life-saving. But, in case of AI, which is usually riddled by speculations and scepticism, it is an uphill task for the researchers to sell their idea or to churn profits to keep fueling their AI labs. For example, OpenAI, which started as a non-profit research lab, changed its stance when it partnered with Microsoft. A year later, they have announced that they are making all their exotic deep learning innovations available to the public through an API that comes with a price tag.
OpenAI API
We're releasing an API for accessing new AI models developed by OpenAI. Unlike most AI systems which are designed for one use-case, the API today provides a general-purpose "text in, text out" interface, allowing users to try it on virtually any English language task. You can now request access in order to integrate the API into your product, develop an entirely new application, or help us explore the strengths and limits of this technology. Given any text prompt, the API will return a text completion, attempting to match the pattern you gave it. You can "program" it by showing it just a few examples of what you'd like it to do; its success generally varies depending on how complex the task is.
Elon Musk-backed OpenAI to release text tool it called dangerous
OpenAI, the machine learning nonprofit co-founded by Elon Musk, has released its first commercial product: a rentable version of a text generation tool the organisation once deemed too dangerous to release. Dubbed simply "the API", the new service lets businesses directly access the most powerful version of GPT-3, OpenAI's general purpose text generation AI. The tool is already a more than capable writer. Feeding an earlier version of the opening line of George Orwell's Nineteen Eighty-Four โ "It was a bright cold day in April, and the clocks were striking thirteen" โ the system recognises the vaguely futuristic tone and the novelistic style, and continues with: "I was in my car on my way to a new job in Seattle. I put the gas in, put the key in, and then I let it run. I just imagined what the day would be like. In 2045, I was a teacher in some school in a poor part of rural China. I started with Chinese history and history of science."
TG-GAN: Continuous-time Temporal Graph Generation with Deep Generative Models
Zhang, Liming, Zhao, Liang, Qin, Shan, Pfoser, Dieter
The recent deep generative models for static graphs that are now being actively developed have achieved significant success in areas such as molecule design. However, many real-world problems involve temporal graphs whose topology and attribute values evolve dynamically over time, including important applications such as protein folding, human mobility networks, and social network growth. As yet, deep generative models for temporal graphs are not yet well understood and existing techniques for static graphs are not adequate for temporal graphs since they cannot 1) encode and decode continuously-varying graph topology chronologically, 2) enforce validity via temporal constraints, or 3) ensure efficiency for information-lossless temporal resolution. To address these challenges, we propose a new model, called ``Temporal Graph Generative Adversarial Network'' (TG-GAN) for continuous-time temporal graph generation, by modeling the deep generative process for truncated temporal random walks and their compositions. Specifically, we first propose a novel temporal graph generator that jointly model truncated edge sequences, time budgets, and node attributes, with novel activation functions that enforce temporal validity constraints under recurrent architecture. In addition, a new temporal graph discriminator is proposed, which combines time and node encoding operations over a recurrent architecture to distinguish the generated sequences from the real ones sampled by a newly-developed truncated temporal random walk sampler. Extensive experiments on both synthetic and real-world datasets demonstrate TG-GAN significantly outperforms the comparison methods in efficiency and effectiveness.
Data-driven topology design using a deep generative model
Yamasaki, Shintaro, Yaji, Kentaro, Fujita, Kikuo
In this paper, we propose a structural design methodology called \textit{data-driven topology design}, which aims to obtain high-performance material distributions for a multi-objective optimization problem from the initially given material distributions in a given design domain. Its basic idea is iterating the following processes: (i) selecting the material distributions from a dataset according to Pareto optimality, (ii) generating new material distributions using a deep generative model with the selected material distributions as the training data, and (iii) integrating the generated material distributions into the dataset. Because of the nature of a deep generative model, the generated material distributions are diverse and inheriting features of the training data, which are material distributions on the Pareto front at that specific point. Therefore, it is expected that some of the generated material distributions are superior to the training data, whereas some are inferior, and the Pareto front is improved by integrating the generated material distributions into the dataset. The Pareto front is further improved by iterating the above processes. Data-driven topology design is used to enhance a support system for determining appropriate formulations of topology optimization problems, and its usefulness is demonstrated through numerical examples.
Microsoft Just Built a World-Class Supercomputer Exclusively for OpenAI
Last year, Microsoft announced a billion-dollar investment in OpenAI, an organization whose mission is to create artificial general intelligence and make it safe for humanity. Just computers with general intelligence helping us solve our biggest problems. A year on, we have the first results of that partnership. At this year's Microsoft Build 2020, a developer conference showcasing Microsoft's latest and greatest, the company said they'd completed a supercomputer exclusively for OpenAI's machine learning research. But this is no run-of-the-mill supercomputer.
Why AI Won't Take Over the World Yet
Brooks, the Chairman, and CTO of Rethink Robotics has stated that much of the misunderstanding has come from the overhyping of certain parts of AI, such as engines beating out professional players in video games like Dota 2 (OpenAI) and board games like Go. "An AI system can play chess fantastically, but it doesn't even know that it's playing a game," says Brooks, CTO of Rethink Robotics. When you see how a program learned something that a human can learn, you make the mistake of thinking it has the richness of understanding that you would have." Even then, for example, it took many attempts (around 459 attempts and 10, 000 hours of'AI' simulated gameplay) for OpenAI to beat a top e-sports team in a game of Dota 2. In the end, machine learning is usually a mundane task of using data to form patterns or understandings for the AI to do a specified job. To give an example, for computer vision, data needs to be'labeled'. This could be identifying cars within a photo (see the example below with vehicles).
Elon Musk: Everyone, "including Tesla," needs AI regulation
Musk was responding to a massive feature story published in the MIT Technology Review about OpenAI, the AI research lab founded in part by Elon Musk, alongside others. The lab operates with the mission of developing safe and ethical AI that'll be good for the world. But MIT Tech's reporting tells of how Open AI went from being a transparent organization to a relatively opaque one (hence Musk's preceding Tweet about OpenAI needing to "be more open"). Musk's ability to self-aggrandize or self-flagellate is usually surprising in equal measure, but never shocking: Industries often argue for their own regulation as a way to keep government regulators off their backs. Though credit where it's due: Musk has been, as in the case of when he argued in favor of regulating autonomous weapons, more substantially -- and more effectively -- vocal than most when it comes to regulating AI. Whether or not this will have any substantial effects on other companies (statements from CEOs, regulatory commission efforts, etc) let alone Tesla or OpenAI will be nothing if not a compelling plot to watch.