Generative AI
A.I. software called DALL-E turns your words into pictures
In scrolling through your social media feeds of late, there's a good chance you've noticed illustrations accompanied by captions. The pictures you're seeing are likely made possible by a text-to-image program called DALL-E. Before posting the illustrations, people are inserting words, which are then being converted into images through artificial intelligence models. For example, a Twitter user posted a tweet with the text, "To be or not to be, rabbi holding avocado, marble sculpture." The attached picture, which is quite elegant, shows a marble statue of a bearded man in a robe and a bowler hat, grasping an avocado.
Introduction to Diffusion Models for Machine Learning
Diffusion Models are generative models which have been gaining significant popularity in the past several years, and for good reason. A handful of seminal papers released in the 2020s alone have shown the world what Diffusion models are capable of, such as beating GANs[6] on image synthesis. Most recently, practitioners will have seen Diffusion Models used in DALL-E 2, OpenAI's image generation model released last month. Given the recent wave of success by Diffusion Models, many Machine Learning practitioners are surely interested in their inner workings. In this article, we will examine the theoretical foundations for Diffusion Models, and then demonstrate how to generate images with a Diffusion Model in PyTorch.
From Trump Nevermind babies to deep fakes: DALL-E and the ethics of AI art
Want to see a picture of Jesus Christ laughing at a meme on his phone, Donald Trump as the Nevermind baby, or Karl Marx being slimed at the Nikelodeon Kid's Choice awards? If you've been on Twitter or Instagram in the past couple of weeks, it's been hard to miss odd-looking formulations of these kinds of scenarios in the form of AI art. DALL-E (and DALL-E mini), the creator of these artworks, is a neural network that can take a text phrase and transform it an image. It was trained by looking at millions of images on the internet along with accompanying text and it learned to create pictures of things you'd never expect to be combined, such as an avocado armchair. Text to image technology is proceeding at a rapid pace, and the full DALL-E model is able to produce scarily clear images based on the input you provide, while the mini version is still clunky enough to capture the weird internet style that makes them instantly meme-able.
What is generative artificial intelligence (AI)?
We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Many artificial intelligence (AI) algorithms are used to classify, organize or reason about data. Generative algorithms create data using models of the world to synthesize images, sounds and videos that often look increasingly realistic. The algorithms begin with models of what a world must be like and then they create a simulated world that fits the model. Generative AIs are frequently found in various content creation roles.
OpenAI!
I have some exciting news (for me, anyway). Starting next week, I'll be going on leave from UT Austin for one year,to work at OpenAI. They're the creators of the astonishing GPT-3 and DALL-E2, which have not only endlessly entertained me and my kids, but recalibrated my understanding of what, for better and worse, the world is going to look like for the rest of our lives. Working with an amazing team at OpenAI, including Jan Leike, John Schulman, and Ilya Sutskever, my job will be think about the theoretical foundations of AI safety and alignment. What, if anything, can computational complexity contribute to a principled understanding of how to get an AI to do what we want and not do what we don't want?
What is GPT-4 and what does it mean for businesses?
The scale and power of artificial intelligence (AI) is improving exponentially, with businesses increasingly able to access an array of cutting-edge tools to implement across their organisations. OpenAI, the non-profit AI research institute, is at the heart of much of this innovation, and the recently released DALL-E 2 image generation platform shows just how powerful AI tools are becoming. For years, OpenAI has also been working on text generation in the form of the Generative Pre-trained Transformer (GPT), an autoregressive language model that uses deep learning to produce human-like text, and its latest iteration, GPT-4, is on the verge of launch. It's been two years since GPT-3 was launched, with this neural network applying machine learning on streams of internet data to generate any type of text, on queue. Fascinatingly, only a small amount of input text is needed to create reams of pertinent and high-level machine-generated text.
Give this AI a few words of description and it produces a stunning image, but is it art?
A picture may be worth a thousand words, but thanks to an artificial intelligence program called DALL-E 2, you can have a professional-looking image with far fewer. DALL-E 2 is a new neural network algorithm that creates a picture from a short phrase or sentence that you provide. The program, which was announced by the artificial intelligence research laboratory OpenAI in April 2022, hasn't been released to the public. But a small and growing number of people โ myself included โ have been given access to experiment with it. As a researcher studying the nexus of technology and art, I was keen to see how well the program worked.
It Happened One Frame: incredibly accurate video content search with OpenAI CLIP
I love movies, so as a fun exercise for my fast.ai It's named "It Happened One Frame", in tribute to the classic 1934 romantic comedy "It Happened One Night". To use this app, all you need is the link to a Youtube video. For example, you could search "Macaulay Culkin screams with hands on his cheeks" in a Home Alone movie clip and get the screenshots that capture the most iconic scene in this classic. This particular image is so popular that you can easily get it from a google search.
Google's New Imagen AI Outperforms DALL-E on Text-to-Image Generation Benchmarks
Researchers from Google's Brain Team have announced Imagen, a text-to-image AI model that can generate photorealistic images of a scene given a textual description. Imagen outperforms DALL-E 2 on the COCO benchmark, and unlike many similar models, is pre-trained only on text data. The model and several experiments were described in a paper published on arXiv. Imagen uses a Transformer language model to convert the input text into a sequence of embedding vectors. A series of three diffusion models then convert the embeddings into a 1024x1024 pixel image.