Goto

Collaborating Authors

 Generative AI


Creator of fake PM video says 'little joke' took an hour to make

The Japan Times

The creator of a viral video purporting to show Japanese Prime Minister Fumio Kishida making explicit sexual admissions in a live news broadcast said he made it in about an hour as a "little joke." "I didn't think it would create such a stir," the man in his 20s said of the video, explaining that he used generative artificial intelligence technology to create Kishida's voice and mouth movements. The video shows the prime minister speaking to the camera during a live news program on Japanese broadcaster Nippon Television Network. The company's logo appears in the top right corner of the screen along with a ticker saying, "Breaking News."


The Humane Ai Pin launches its campaign to replace phones

The Japan Times

Humane, the startup founded by former Apple design and engineering team Imran Chaudhri and Bethany Bongiorno, has officially launched its long-awaited Ai Pin -- making a splashy foray into the nascent field of artificial intelligence hardware. The device can magnetically clip onto clothing and will cost $699 with a $24-a-month subscription -- which will come with unlimited data and phone calls. The company also said it would partner with T-Mobile for phone service and Microsoft and OpenAI for AI technology. The device will be available to order starting Nov. 16. "For the technology you are getting, we set a high bar for ourselves in terms of pricing it at a level we think is approachable and accessible," Bongiorno, Humane's chief executive officer, said in an interview on Bloomberg TV Thursday.


SneakyPrompt: Jailbreaking Text-to-image Generative Models

arXiv.org Artificial Intelligence

Text-to-image generative models such as Stable Diffusion and DALL$\cdot$E raise many ethical concerns due to the generation of harmful images such as Not-Safe-for-Work (NSFW) ones. To address these ethical concerns, safety filters are often adopted to prevent the generation of NSFW images. In this work, we propose SneakyPrompt, the first automated attack framework, to jailbreak text-to-image generative models such that they generate NSFW images even if safety filters are adopted. Given a prompt that is blocked by a safety filter, SneakyPrompt repeatedly queries the text-to-image generative model and strategically perturbs tokens in the prompt based on the query results to bypass the safety filter. Specifically, SneakyPrompt utilizes reinforcement learning to guide the perturbation of tokens. Our evaluation shows that SneakyPrompt successfully jailbreaks DALL$\cdot$E 2 with closed-box safety filters to generate NSFW images. Moreover, we also deploy several state-of-the-art, open-source safety filters on a Stable Diffusion model. Our evaluation shows that SneakyPrompt not only successfully generates NSFW images, but also outperforms existing text adversarial attacks when extended to jailbreak text-to-image generative models, in terms of both the number of queries and qualities of the generated NSFW images. SneakyPrompt is open-source and available at this repository: \url{https://github.com/Yuchen413/text2image_safety}.


Here's How Violent Extremists Are Exploiting Generative AI Tools

WIRED

Extremist groups have begun to experiment with artificial intelligence, and in particular generative AI, in order to create a flood of new propaganda. Experts now fear the growing use of generative AI tools by these groups will overturn the work Big Tech has done in recent years to keep their content off the internet. "Our biggest concern is that if terrorists start using gen AI to manipulate imagery at scale, this could well destroy hash-sharing as a solution," Adam Hadley, the executive director of Tech Against Terrorism, tells WIRED. "This is a massive risk." For years, Big Tech platforms have worked hard to create databases of known violent extremist content, known as hashing databases, which are shared across platforms to quickly and automatically remove such content from the internet.


OpenAI wants to work with organizations to build new AI training datasets

Engadget

OpenAI is rolling out a new partnership program to collect datasets from third parties that it intends to use to train its AI models. The initiative, OpenAI Data Partnerships, will seek large-scale private and public information that it says is "not already easily accessible online to the public." The company says the data it will collect doesn't necessarily have to be quantitative or in text formats -- the program will also accept images, audio or video. Notably, the company says it's on the lookout for data on "any topic" and in "any language" so long as it "expresses human intention," which it likens to long-form essays or transcribed conversations. Human-centric data collected by OpenAI is expected to help the company improve tools like its automatic speech recognition technology which is used to transcribe spoken words. This initiative also lines up with ChatGPT's recent expansion to support voice queries to engage with users in a conversational manner.


Can an AI Device Replace the Smartphone?

WSJ.com: WSJD - Technology

A group of former Apple executives is launching a consumer device that will be among the first to use a ChatGPT-powered voice assistant, one of a number of new hardware offerings seeking to free users from the ubiquity of smartphones. On Thursday, the San Francisco-based startup Humane announced the availability of a wearable device, called the Ai Pin, which sits on a user's chest like a Star Trek badge. The company said its main function is to access an artificial-intelligence assistant that uses ChatGPT, the hugely popular chatbot created by Microsoft-backed OpenAI, primarily to understand commands.


This New Breed of AI Assistant Wants to Do Your Boring Office Chores

WIRED

This week, OpenAI announced a service that makes it possible for just about anyone to build a custom version of ChatGPT, no coding skills required. The company suggests that users may want to build a bot that knows the rules of all board games, teaches kids about math, or can offer culinary advice. These GPTs, as OpenAI calls them, can also perform simple actions by connecting with internet services, for example searching through emails or ordering products from an online store. You can't fault OpenAI for trying to build on the success of its smash hit ChatGPT. But maybe more chatbots is not what we need?


The Morning After: Samsung made its own generative AI model

Engadget

Developed by Samsung Research, Gauss (named after mathematician Carl Friedrich Gauss) powers several on-device AI technologies across Samsung products. It will have a few different facets but will do a lot of the same stuff we've seen from other generative AI (GAI) models. Gauss Language will handle tasks like translations and summarizing documents, while Gauss Code is a coding assistant. The latter can create images based on prompts and handle edits like style changes and additions. It will be able to upscale low-resolution images too.


Big Tech wants AI regulation. The rest of Silicon Valley is skeptical.

Washington Post - Technology News

"We are still in the very early days of generative AI, and it's imperative that governments don't preemptively anoint winners and shut down competition through the adoption of onerous regulations only the largest firms can satisfy," said Garry Tan, the head of Y Combinator, a San Francisco-based start-up incubator that helped nurture companies including Airbnb and DoorDash when they were just starting. The current discussion hasn't incorporated the voices of smaller companies enough, Tan said, which he believes is key to fostering competition and engineering the safest ways to harness AI.


SAG-AFTRA ends strike after securing a deal that protects members 'from the threat of AI'

Engadget

The Screen Actors Guild-American Federation of Television and Radio Artists (SAG-AFTRA) has officially ended its strike, which lasted for 118 days, after reaching a tentative agreement with Hollywood studios. In its announcement, it said it was able to secure a contract "valued at over 1 billion dollars" and that it was able to negotiate "above-pattern" compensation increases, as well as "unprecedented provisions for consent and compensation that will protect members from the threat of AI." In a contract valued at over one billion dollars, we have achieved a deal of extraordinary scope that includes "above-pattern" minimum compensation increases, unprecedented provisions for consent and compensation that will protect members from the threat of AI,... pic.twitter.com/lQe6snkQsY The union will release more details about the agreement after its national board looks it over on Friday for "review and consideration." However, generative AI became the sticking point that prevented both parties from being able to strike a deal earlier than this.