Goto

Collaborating Authors

 text-to-image ai model


Text-to-image AI models can be tricked into generating disturbing images

MIT Technology Review

Their work, which they will present at the IEEE Symposium on Security and Privacy in May next year, shines a light on how easy it is to force generative AI models into disregarding their own guardrails and policies, known as "jailbreaking." It also demonstrates how difficult it is to prevent these models from generating such content, as it's included in the vast troves of data they've been trained on, says Zico Kolter, an associate professor at Carnegie Mellon University. He demonstrated a similar form of jailbreaking on ChatGPT earlier this year but was not involved in this research. "We have to take into account the potential risks in releasing software and tools that have known security flaws into larger software systems," he says. All major generative AI models have safety filters to prevent users from prompting them to produce pornographic, violent, or otherwise inappropriate images. The models won't generate images from prompts that contain sensitive terms like "naked," "murder," or "sexy."


Meta is using AI to generate videos from just a few words

#artificialintelligence

Artificial intelligence is getting better and better at generating an image in response to a handful of words, with publicly available AI image generators such as DALL-E 2 and Stable Diffusion. Now, Meta researchers are taking AI a step further: they're using it to concoct videos from a text prompt. Meta CEO Mark Zuckerberg posted on Facebook on Thursday about the research, called Make-A-Video, with a 20-second clip that compiled several text prompts that Meta researchers used and the resulting (very short) videos. The prompts include "A teddy bear painting a self portrait," "A spaceship landing on Mars," "A baby sloth with a knitted hat trying to figure out a laptop," and "A robot surfing a wave in the ocean." The videos for each prompt are just a few seconds long, and they generally show what the prompt suggests (with the exception of the baby sloth, which doesn't look much like the actual creature), in a fairly low-resolution and somewhat jerky style.


Making pictures with words

#artificialintelligence

I was young when I first listened to the song Video Killed the Radio Star by the Buggles. I thought it was a fun and catchy song, almost like a jingle, even though I had no idea what the song was all about. But that was ok, I was just a young boy listening to the radio and watching videos on VCR machines. I didn't really pay much attention to the title or the lyrics. It was much later I realised what the lyrics actually meant. In my mind and in my car We can't rewind, we've gone too far Pictures came and broke your heart Put the blame on VCR The song was part of the Age of Plastic album, which had themes of nostalgia, anxiety of the effects of modern technology. While the album was released more than 40 years ago (it was released in 1980) these themes still ring true and clear.