Media
AGILE: A Novel Framework of LLM Agents
Feng, Peiyuan, He, Yichen, Huang, Guanhua, Lin, Yuan, Zhang, Hanchong, Zhang, Yuchen, Li, Hang
We introduce a novel framework of LLM agents named AGILE (AGent that Interacts and Learns from Environments) designed to perform complex conversational tasks with users, leveraging LLMs, memory, tools, and interactions with experts. The agent's abilities include not only conversation but also reflection, utilization of tools, and consultation with experts. We formulate the construction of such an LLM agent as a reinforcement learning problem, in which the LLM serves as the policy model. We fine-tune the LLM using labeled data of actions and the PPO algorithm. We focus on question answering and release a dataset for agents called ProductQA, comprising challenging questions in online shopping. Our extensive experiments on ProductQA and MedMCQA show that AGILE agents based on 13B and 7B LLMs trained with PPO can outperform GPT-4 agents. Our ablation study highlights the indispensability of memory, tools, consultation, reflection, and reinforcement learning in achieving the agent's strong performance.
OpenAI will reportedly pay 250 million to put News Corp's journalism in ChatGPT
OpenAI and News Corp, the owner of The Wall Street Journal, MarketWatch, The Sun, and more than a dozen other publishing brands, have struck a multi-year deal to display news from these publications in ChatGPT, News Corp announced on Wednesday. OpenAI will be able to access both current and well as archived content from News Corp's publications and use the data to further train its AI models. Neither company disclosed the terms of the deal, but a report in The Wall Street Journal estimated that News Corp would get 250 million over five years in cash and credits. "The pact acknowledges that there is a premium for premium journalism," News Corp Chief Executive Robert Thomson reportedly said in a memo to employees on Wednesday. "The digital age has been characterized by the dominance of distributors, often at the expense of creators, and many media companies have been swept away by a remorseless technological tide. The onus is now on us to make the most of this providential opportunity."
OpenAI and Wall Street Journal owner News Corp sign content deal
ChatGPT developer OpenAI has signed a deal to bring news content from the Wall Street Journal, New York Post, the Times and the Sunday Times to the artificial intelligence platform, the companies said on Wednesday. Neither party disclosed a dollar figure for the deal. The deal will give OpenAI access to current and archived content from all of News Corp's publications. The deal comes weeks after the AI heavyweight signed a deal with the Financial Times to license its content for the development of AI models. Other publications, including the New York Times, have taken a different tack: suing OpenAI and Microsoft, the startup's key backer, over the use of its content to train generative AI and large-language model systems.
This seemingly ordinary podcast is anything but - can YOU tell what makes it so different?
It seems like every Z-list celebrity and reality star has a podcast these days, but can you tell what makes this one truly unique? Eagle-eyed viewers may have spotted that its co-host, Jake, appears a bit stiff and robotic - and it's not because he's camera shy. Jake is a fully artificial intelligence-generated avatar. Human podcast host Jakob Wredstrรธm, who created Jake as a digital clone of himself, says his is the first AI podcast. Jakob Wredstrรธm, the creator of the podcast Sound Connections, created an AI version of himself called Jake (pictured).
A Road Warrior's Driving Lessons in the Thrilling, Sprawling "Furiosa"
The last time we saw Imperator Furiosa, in the dystopian chase thriller "Mad Max: Fury Road" (2015), she had just returned from the heat of battle, her face streaked with blood, one eye swollen shut, her body so fatigued and battered that she could hardly stand. Furiosa, played by a stupendous Charlize Theron, had spent several days and nights driving an enormous truck, the War Rig, across miles of open desert, withstanding fiery assaults, a lethal sandstorm, and the surly company of a reluctant ally named Max (Tom Hardy). But triumph, at last, was hers: the vile warlord Immortan Joe (Hugh Keays-Byrne) lay dead at her feet, and hundreds of newly liberated desert dwellers were erupting in celebration. Amid the chaos, Furiosa scanned the crowd for Max and caught him slinking away. For a moment, he looked back and gave her an approving nod--then turned and vanished into the throng.
Faux ScarJo and the Descent of the A.I. Vultures
On May 13th, during a live event, the artificial-intelligence company OpenAI unveiled the next generation of its technology, GPT-4o, the successor to GPT-3. When OpenAI first released its product to the public in late 2022, as the text-based tool ChatGPT, it nearly single-handedly ushered in the A.I. era. The latest version is far more powerful still. The "o" in the name stands for "omni"; the model can communicate seamlessly across various forms of media at once, including text, audio, and video, receiving prompts in one medium and responding in another. It can maintain a memory of everything you tell it.
Fox News AI Newsletter: Scarlett Johansson's AI accusation
'IN DISBELIEF': Scarlett Johansson is "angered and in disbelief" by tech company OpenAI over its ChatGPT app's voice, Sky, noting it uses a voice very similar to hers. NVIDIA'S RISE: Wall Street is eagerly awaiting the latest earnings report Wednesday from Nvidia, which has experienced rapid growth amid the boom in artificial intelligence technology. ELECTRIC RUNNING ROBOT: Standing as tall as an average human and powered by a symphony of sensors and processors, Tiangong has the ability to jog at a steady pace, navigate complex terrain and perform tasks with precision. Tiangong represents a future where robots could possibly become our companions, helpers and perhaps even our friends. GOOGLE'S BIG REVEALS: Google's flagship developer conference called I/O just wrapped up with interesting leaps in how the Big Tech giant is planning to change the world.
South Korea urges global cooperation for AI development at Seoul summit
UPenn Wharton School Associate Professor Ethan Mollick weighs in on the Biden White House's new guidelines for artificial intelligence in the workplace on'Fox News Live.' South Korea's science and information technology minister said on Wednesday the world must cooperate to ensure the successful development of AI, as a global summit on the rapidly evolving technology hosted by his country wrapped up. A separate pledge was signed on Wednesday by 14 companies including Alphabet's Google, Microsoft, OpenAI and six Korean companies to use methods such as watermarking to help identify AI-generated content, as well as ensure job creation and help for socially vulnerable groups. "Cooperation is not an option, it is a necessity," Lee Jong-Ho, South Korea's Minister of Science and ICT (information and communication technologies), said in an interview with Reuters. Han Duck-soo, South Korean Prime Minister, gives a speech during the opening ceremony of the AI Global Forum in Seoul, South Korea, on May 22, 2024. South Korea's science and information technology minister said on Wednesday the world must cooperate to ensure the successful development of AI, as the summit on the rapidly evolving technology hosted by his country wrapped up.
Emory University awarded two students 10,000 for their AI study tool, then suspended them
Individuals and organizations are still struggling with how and how much to integrate AI into daily life. Rarely has that been more clear than a case out of Emory University in which the school went from awarding students with an entrepreneurship prize worth 10,000 for their AI-powered studying tool to suspending them for it, 404 Media reports. No, the students didn't suddenly misuse the tool, known as Eightball, in any way; they did just as they said they would, and all the while, Emory promoted them -- until they didn't. Eightball allowed students to turn any coursework or readings into practice tests or flashcards for studying. It also connected to Canvas -- the platform professors at Emory use to share course documents with their students.
End-to-End Real-World Polyphonic Piano Audio-to-Score Transcription with Hierarchical Decoding
Piano audio-to-score transcription (A2S) is an important yet underexplored task with extensive applications for music composition, practice, and analysis. However, existing end-to-end piano A2S systems faced difficulties in retrieving bar-level information such as key and time signatures, and have been trained and evaluated with only synthetic data. To address these limitations, we propose a sequence-to-sequence (Seq2Seq) model with a hierarchical decoder that aligns with the hierarchical structure of musical scores, enabling the transcription of score information at both the bar and note levels by multi-task learning. To bridge the gap between synthetic data and recordings of human performance, we propose a two-stage training scheme, which involves pre-training the model using an expressive performance rendering (EPR) system on synthetic audio, followed by fine-tuning the model using recordings of human performance. To preserve the voicing structure for score reconstruction, we propose a pre-processing method for **Kern scores in scenarios with an unconstrained number of voices. Experimental results support the effectiveness of our proposed approaches, in terms of both transcription performance on synthetic audio data in comparison to the current state-of-the-art, and the first experiment on human recordings.