Goto

Collaborating Authors

 Generative AI


OpenAI's new video generation tool could learn a lot from babies John Naughton

The Guardian

"First text, then images, now OpenAI has a model for generating videos," screamed Mashable the other day. The makers of ChatGPT and Dall-E had just announced Sora, a text-to-video diffusion model. Cue excited commentary all over the web about what will doubtless become known as T2V, covering the usual spectrum โ€“ from "Does this mark the end of [insert threatened activity here]?" to "meh" and everything in between. Sora (the name is Japanese for "sky") is not the first T2V tool, but it looks more sophisticated than earlier efforts like Meta's Make-a-Video AI. It can turn a brief text description into a detailed, high-definition film clip up to a minute long.


Bezos and Nvidia join OpenAI in funding humanoid robot startup

The Japan Times

Jeff Bezos, Nvidia and other big technology names are investing in a business that's developing human-like robots, according to people with knowledge of the situation, part of a scramble to find new applications for artificial intelligence. The startup Figure AI -- also backed by OpenAI and Microsoft -- is raising about 675 million in a funding round that carries a pre-money valuation of roughly 2 billion, said the people, who asked not to be identified because the matter is private. Through his firm Explore Investments, Bezos has committed 100 million. Microsoft is investing 95 million, while Nvidia and an Amazon.com-affiliated Robots have emerged as a critical new frontier for the AI industry, letting it apply cutting-edge technology to real-world tasks.


Generative AI Degrades Online Communities

Communications of the ACM

Imagine you are at a crossroads in a complex project and you need quick answers on how to grapple with a problem. It is quite likely that you might turn to an online knowledge community for answers, one hosted by your company, or perhaps Stack Overflow, Quora, or Reddit. These communities have come to play a central role in knowledge exchange, in many corners of the economy and society, but they depend on voluntary participation from users just like you and me. Our recent research indicates an intriguing shift is now taking place: generative AI technologies, such as OpenAI's large language model (LLM) ChatGPT, are disrupting the status quo. Increasingly, users are gravitating toward these new AI tools to obtain answers, bypassing traditional knowledge communities.


U.S. Copyright Office's Questions about Generative AI

Communications of the ACM

In late October, the Office received approximately 10,000 comments in response to the NOI questions. The Office expects to publish a report in 2024 offering its perspective on how these questions should be answered and perhaps recommending legislation.


Why has Nvidia driven stock markets to record highs?

The Guardian

Investor excitement over artificial intelligence reached a new peak this week when better-than-expected results from chipmaker Nvidia drove stock markets in three continents to record highs. The rally began on Thursday and continued into Friday, as Nvidia overtook Google's parent group, Alphabet, to become the third most valuable company in the US. Its market capitalisation hit 2tn ( 1.58tn), surpassed only by Microsoft and Apple. The artificial intelligence (AI) boom has raised many questions, not least over safety and the impact on jobs, but there are also concerns that it might be driving unsustainable market exuberance. Here we look at the latest share price rise and whether it can be maintained.


Tyler Perry halts 800m studio expansion after being shocked by AI

The Guardian

Tyler Perry has paused an 800m ( 630m) expansion of his Atlanta studio complex after the release of OpenAI's video generator Sora and warned that "a lot of jobs" in the film industry will be lost to artificial intelligence. The US film and TV mogul said he was in the process of adding 12 sound stages to his studio but has halted those plans indefinitely after he saw demonstrations of Sora and its "shocking" capabilities. "All of that is currently and indefinitely on hold because of Sora and what I'm seeing," Perry said in an interview with the Hollywood Reporter. "I had gotten word over the last year or so that this was coming, but I had no idea until I saw recently the demonstrations of what it's able to do. The AI tool was launched on 15 February โ€“ with limited access to a few researchers and video creators โ€“ and caused widespread astonishment with its ability to produce realistic footage a minute long from simple text prompts. Perry, whose successes include the Madea film series, said Sora's achievements meant he would no longer have to travel to locations or build a set: "I can sit in an office and do this with a computer, which is shocking to me." Demonstrations released by OpenAI, the developer of the groundbreaking ChatGPT chatbot, show photorealistic scenes in response to prompts such as asking for a shot of people walking through "beautiful, snowy Tokyo city" where "gorgeous sakura petals are flying through the wind along with snowflakes". Sora can create videos of up to 60 seconds featuring highly detailed scenes, complex camera motion, and multiple characters with vibrant emotions. Perry said the breakthroughs presented by Sora would affect a range of jobs throughout the film industry, including those of actors, editors, sound specialists and transportation crew. He said: "I am very, very concerned that in the near future, a lot of jobs are going to be lost.


Microsoft is giving Windows Photos a boost with a generative AI-powered eraser

Engadget

Microsoft has announced a generative-AI powered eraser for pictures, which gives you an easy way of removing unwanted elements from your photos. Windows Photos has long had a Spot Fix tool that can remove parts of an image for you, but the company says Generative erase is an enhanced version of the feature. Apparently, this newer tool can create "more seamless and realistic" results even when large objects, such as bystanders or clutter in the background, are removed from an image. If you'll recall, both Google and Samsung have their own versions of AI eraser tools on their mobile devices. Google's used to be exclusively available on newer Pixel phones until it was rolled out to older models.


AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent System

arXiv.org Artificial Intelligence

The booming success of LLMs initiates rapid development in LLM agents. Though the foundation of an LLM agent is the generative model, it is critical to devise the optimal reasoning strategies and agent architectures. Accordingly, LLM agent research advances from the simple chain-of-thought prompting to more complex ReAct and Reflection reasoning strategy; agent architecture also evolves from single agent generation to multi-agent conversation, as well as multi-LLM multi-agent group chat. However, with the existing intricate frameworks and libraries, creating and evaluating new reasoning strategies and agent architectures has become a complex challenge, which hinders research investigation into LLM agents. Thus, we open-source a new AI agent library, AgentLite, which simplifies this process by offering a lightweight, user-friendly platform for innovating LLM agent reasoning, architectures, and applications with ease. AgentLite is a task-oriented framework designed to enhance the ability of agents to break down tasks and facilitate the development of multi-agent systems. Furthermore, we introduce multiple practical applications developed with AgentLite to demonstrate its convenience and flexibility. Get started now at: \url{https://github.com/SalesforceAIResearch/AgentLite}.


BSPA: Exploring Black-box Stealthy Prompt Attacks against Image Generators

arXiv.org Artificial Intelligence

Extremely large image generators offer significant transformative potential across diverse sectors. It allows users to design specific prompts to generate realistic images through some black-box APIs. However, some studies reveal that image generators are notably susceptible to attacks and generate Not Suitable For Work (NSFW) contents by manually designed toxin texts, especially imperceptible to human observers. We urgently need a multitude of universal and transferable prompts to improve the safety of image generators, especially black-box-released APIs. Nevertheless, they are constrained by labor-intensive design processes and heavily reliant on the quality of the given instructions. To achieve this, we introduce a black-box stealthy prompt attack (BSPA) that adopts a retriever to simulate attacks from API users. It can effectively harness filter scores to tune the retrieval space of sensitive words for matching the input prompts, thereby crafting stealthy prompts tailored for image generators. Significantly, this approach is model-agnostic and requires no internal access to the model's features, ensuring its applicability to a wide range of image generators. Building on BSPA, we have constructed an automated prompt tool and a comprehensive prompt attack dataset (NSFWeval). Extensive experiments demonstrate that BSPA effectively explores the security vulnerabilities in a variety of state-of-the-art available black-box models, including Stable Diffusion XL, Midjourney, and DALL-E 2/3. Furthermore, we develop a resilient text filter and offer targeted recommendations to ensure the security of image generators against prompt attacks in the future.


Stable Diffusion 3 is a new AI image generator that won't mess up text in pictures, its makers claim

Engadget

Stability AI, the startup behind Stable Diffusion, the tool that uses generative AI to create images from text prompts, revealed Stable Diffusion 3, a next-generation model, on Thursday. Stability AI claimed that the new model, which isn't widely available yet, improves image quality, works better with prompts containing multiple subjects, and can more accurate text as part of the generated image, something that previous Stable Diffusion models weren't great at. Stability AI CEO Emad Mosque posted some examples of this on X. The announcement comes days after Stability AI's largest rival, OpenAI, unveiled Sora, a brand new AI model capable of generating nearly-realistic, high-definition videos from simple text prompts. Sora, which isn't available to the general public yet either, sparked concerns about its potential to create realistic-looking fake footage.