Goto

Collaborating Authors

 Generative AI


Panmodal Information Interaction

arXiv.org Artificial Intelligence

The emergence of generative artificial intelligence (GenAI) is transforming information interaction. For decades, search engines such as Google and Bing have been the primary means of locating relevant information for the general population. They have provided search results in the same standard format (the so-called "10 blue links"). The recent ability to chat via natural language with AI-based agents and have GenAI automatically synthesize answers in real-time (grounded in top-ranked results) is changing how people interact with and consume information at massive scale. These two information interaction modalities (traditional search and AI-powered chat) coexist in current search engines, either loosely coupled (e.g., as separate options/tabs) or tightly coupled (e.g., integrated as a chat answer embedded directly within a traditional search result page). We believe that the existence of these two different modalities, and potentially many others, is creating an opportunity to re-imagine the search experience, capitalize on the strengths of many modalities, and develop systems and strategies to support seamless flow between them. We refer to these as panmodal experiences. Unlike monomodal experiences, where only one modality is available and/or used for the task at hand, panmodal experiences make multiple modalities available to users (multimodal), directly support transitions between modalities (crossmodal), and seamlessly combine modalities to tailor task assistance (transmodal). While our focus is search and chat, with learnings from insights from a survey of over 100 individuals who have recently performed common tasks on these two modalities, we also present a more general vision for the future of information interaction using multiple modalities and the emergent capabilities of GenAI.


Scarlett Johansson Says OpenAI Ripped Off Her Voice for ChatGPT

WIRED

Last week OpenAI revealed a new conversational interface for ChatGPT with an expressive synthetic voice strikingly similar to that of the AI assistant played by Scarlett Johansson in the sci-fi movie Her--only to suddenly disable the new voice over the weekend. On Monday, Johansson issued a statement claiming to have forced that reversal, after her lawyers demanded OpenAI clarify how the new voice was created. Johansson's statement, relayed to WIRED by her publicist, claims that OpenAI CEO Sam Altman asked her last September to provide ChatGPT's new voice but that she declined. She describes being astounded to see the company demo a new voice for ChatGPT last week that sounded like her anyway. "When I heard the release demo I was shocked, angered, and in disbelief that Mr. Altman would pursue a voice that sounded so eerily similar to mine that my closest friends and news outlets could not tell the difference," the statement reads.


Scarlett Johansson says OpenAI used her likeness without permission for its 'Sky' voice assistant

Engadget

Actor Scarlett Johansson has accused OpenAI of copying her voice for one of the voice assisstants in ChatGPT despite denying the company permission to do so. Johansson's statement on Monday came hours after OpenAI said that the company would no longer use the voice in ChatGPT but did not provide a reason why. "Last September, I received an offer from Sam Altman, who wanted to hire me to voice the current ChatGPT 4.0 system," Johansson wrote in the statement that was first shared with NPR. "He told me that he felt that by my voicing the system, I could bridge the gap between tech companies and creatives and help consumers to feel comfortable with the seismic shift concerning humans and AI. He said he felt that my voice would be comforting to people."


Scarlett Johansson claims OpenAI copied her voice for ChatGPT

Washington Post - Technology News

In a statement provided to The Washington Post by Johansson's publicist, she claimed that she received an offer from OpenAI CEO Sam Altman in September to be the voice of its AI system. Johansson, who famously voiced the role of the all-knowing AI in the 2013 movie "Her," said she declined Altman's offer.


Microsoft's AI chatbot will 'recall' everything you do on its new PCs

The Guardian

Microsoft wants laptop users to get so comfortable with its artificial intelligence chatbot that it will remember everything you're doing on your computer and help figure out what you want to do next. The software giant on Monday revealed an upgraded version of Copilot, its AI assistant, as it confronts heightened competition from big tech rivals in pitching generative AI technology that can compose documents, make images and serve as a lifelike personal assistant at work or home. The announcements ahead of Microsoft's annual Build developer conference in Seattle centered on imbuing AI features into a product where Microsoft already has the eyes of millions of consumers: the Windows operating system for personal computers. The new features will include Windows Recall, enabling the AI assistant to "access virtually what you have seen or done on your PC in a way that feels like having photographic memory". Microsoft promises to protect users' privacy by giving them the option to filter out what they don't want tracked.


Microsoft unveils Copilot PCs with generative AI capabilities baked in

Engadget

We've been hearing rumblings for months now that Microsoft was working on so-called "AI PCs." At a pre-Build event, the company spelled out its vision for AI PCs. Microsoft is calling its version Copilot PCs, which CEO Satya Nadella described as a "new class of Windows PCs." These include hardware designed to handle more generative AI Copilot processes locally, rather than relying on the cloud. That requires a chipset with a neural processing unit (NPU) and manufacturers such as Qualcomm have been laying the groundwork with chips like the Snapdragon X Elite.


ChatGPT suspends AI voice that sounds like Scarlett Johansson

The Guardian

OpenAI removed a heavily promoted voice option from ChatGPT on Monday, following a widespread reaction to the flirtatious, feminine voice that sounded almost identical to Scarlett Johansson. The company used the voice, which it calls "Sky", during its widely publicized event last week debuting the capabilities of the new ChatGPT-4o artificial intelligence model. Researchers talked with the AI assistant to show off Sky's personable and responsive affectations, which users and members of the media immediately compared to Johansson's AI companion character in the 2013 Spike Jonze film Her. Even OpenAI's CEO, Sam Altman, seemed to suggest that the vocal design was intentionally mimicking Johansson's character, posting a one-word tweet after the presentation that simply said "her". Less than a week later, OpenAI felt compelled to explicitly clarify that Sky was not based on Johansson.


RIP ChatGPT's knockoff Scarlett Johansson voice [2023 -- 2024]

Engadget

When OpenAI showed off GPT-4o's seemingly more-human like voice mode last week, observers were quick to point out that one of ChatGPT's voices sounds like Scarlett Johansson, particularly her character in Her. The company says the similarity between the flirty AI voice Sky (which it actually rolled out in September) and Johansson was unintentional. However, it's "working to pause the use of Sky" while it addresses some questions about the voice. "We believe that AI voices should not deliberately mimic a celebrity's distinctive voice -- Sky's voice is not an imitation of Scarlett Johansson but belongs to a different professional actress using her own natural speaking voice," OpenAI wrote in a blog post detailing how it picked ChatGPT's five voices. "To protect their privacy, we cannot share the names of our voice talents."



A review on the use of large language models as virtual tutors

arXiv.org Artificial Intelligence

Transformer architectures contribute to managing long-term dependencies for Natural Language Processing, representing one of the most recent changes in the field. These architectures are the basis of the innovative, cutting-edge Large Language Models (LLMs) that have produced a huge buzz in several fields and industrial sectors, among the ones education stands out. Accordingly, these generative Artificial Intelligence-based solutions have directed the change in techniques and the evolution in educational methods and contents, along with network infrastructure, towards high-quality learning. Given the popularity of LLMs, this review seeks to provide a comprehensive overview of those solutions designed specifically to generate and evaluate educational materials and which involve students and teachers in their design or experimental plan. To the best of our knowledge, this is the first review of educational applications (e.g., student assessment) of LLMs. As expected, the most common role of these systems is as virtual tutors for automatic question generation. Moreover, the most popular models are GTP-3 and BERT. However, due to the continuous launch of new generative models, new works are expected to be published shortly.