Generative AI
RIP ChatGPT's knockoff Scarlett Johansson voice [2023 -- 2024]
When OpenAI showed off GPT-4o's seemingly more-human like voice mode last week, observers were quick to point out that one of ChatGPT's voices sounds like Scarlett Johansson, particularly her character in Her. The company says the similarity between the flirty AI voice Sky (which it actually rolled out in September) and Johansson was unintentional. However, it's "working to pause the use of Sky" while it addresses some questions about the voice. "We believe that AI voices should not deliberately mimic a celebrity's distinctive voice -- Sky's voice is not an imitation of Scarlett Johansson but belongs to a different professional actress using her own natural speaking voice," OpenAI wrote in a blog post detailing how it picked ChatGPT's five voices. "To protect their privacy, we cannot share the names of our voice talents."
A review on the use of large language models as virtual tutors
Garcรญa-Mรฉndez, Silvia, de Arriba-Pรฉrez, Francisco, Somoza-Lรณpez, Marรญa del Carmen
Transformer architectures contribute to managing long-term dependencies for Natural Language Processing, representing one of the most recent changes in the field. These architectures are the basis of the innovative, cutting-edge Large Language Models (LLMs) that have produced a huge buzz in several fields and industrial sectors, among the ones education stands out. Accordingly, these generative Artificial Intelligence-based solutions have directed the change in techniques and the evolution in educational methods and contents, along with network infrastructure, towards high-quality learning. Given the popularity of LLMs, this review seeks to provide a comprehensive overview of those solutions designed specifically to generate and evaluate educational materials and which involve students and teachers in their design or experimental plan. To the best of our knowledge, this is the first review of educational applications (e.g., student assessment) of LLMs. As expected, the most common role of these systems is as virtual tutors for automatic question generation. Moreover, the most popular models are GTP-3 and BERT. However, due to the continuous launch of new generative models, new works are expected to be published shortly.
Generative AI in Higher Education: A Global Perspective of Institutional Adoption Policies and Guidelines
Jin, Yueqiao, Yan, Lixiang, Echeverria, Vanessa, Gaลกeviฤ, Dragan, Martinez-Maldonado, Roberto
Integrating generative AI (GAI) into higher education is crucial for preparing a future generation of GAI-literate students. Yet a thorough understanding of the global institutional adoption policy remains absent, with most of the prior studies focused on the Global North and the promises and challenges of GAI, lacking a theoretical lens. This study utilizes the Diffusion of Innovations Theory to examine GAI adoption strategies in higher education across 40 universities from six global regions. It explores the characteristics of GAI innovation, including compatibility, trialability, and observability, and analyses the communication channels and roles and responsibilities outlined in university policies and guidelines. The findings reveal a proactive approach by universities towards GAI integration, emphasizing academic integrity, teaching and learning enhancement, and equity. Despite a cautious yet optimistic stance, a comprehensive policy framework is needed to evaluate the impacts of GAI integration and establish effective communication strategies that foster broader stakeholder engagement. The study highlights the importance of clear roles and responsibilities among faculty, students, and administrators for successful GAI integration, supporting a collaborative model for navigating the complexities of GAI in education. This study contributes insights for policymakers in crafting detailed strategies for its integration.
Guided Multi-objective Generative AI to Enhance Structure-based Drug Design
Kadan, Amit, Ryczko, Kevin, Roitberg, Adrian, Yamazaki, Takeshi
These authors contributed equally to this work. Abstract Generative AI has the potential to revolutionize drug discovery. Yet, despite recent advances in machine learning, existing models cannot generate molecules that satisfy all desired physicochemical properties. Herein, we describe IDOLpro, a novel generative chemistry AI combining deep diffusion with multi-objective optimization for structure-based drug design. The latent variables of the diffusion model are guided by differentiable scoring functions to explore uncharted chemical space and generate novel ligands in silico, optimizing a plurality of target physicochemical properties. We demonstrate its effectiveness by generating ligands with optimized binding affinity and synthetic accessibility on two benchmark sets. IDOLpro produces ligands with binding affinities over 10% higher than the next best state-of-the-art on each test set. On a test set of experimental complexes, IDOLpro is the first to surpass the performance of experimentally observed ligands. IDOLpro can accommodate other scoring functions (e.g. ADME-Tox) to accelerate hit-finding, hit-to-lead, and lead optimization for drug discovery.
Out-of-Distribution Detection with a Single Unconditional Diffusion Model
Heng, Alvin, Thiery, Alexandre H., Soh, Harold
Out-of-distribution (OOD) detection is a critical task in machine learning that seeks to identify abnormal samples. Traditionally, unsupervised methods utilize a deep generative model for OOD detection. However, such approaches necessitate a different model when evaluating abnormality against a new distribution. With the emergence of foundational generative models, this paper explores whether a single generalist model can also perform OOD detection across diverse tasks. To that end, we introduce our method, Diffusion Paths, (DiffPath) in this work. DiffPath proposes to utilize a single diffusion model originally trained to perform unconditional generation for OOD detection. Specifically, we introduce a novel technique of measuring the rate-of-change and curvature of the diffusion paths connecting samples to the standard normal. Extensive experiments show that with a single model, DiffPath outperforms prior work on a variety of OOD tasks involving different distributions. Our code is publicly available at https://github.com/clear-nus/diffpath.
7 things Google just announced that are worth keeping a close eye on
ZeroEyes CEO Mike Lahiff joins'Fox & Friends' to explain how the technology works to help keep students safe in schools. Google's flagship developer conference called I/O just wrapped up with interesting leaps in how the Big Tech giant is planning to change the world. Here are the seven biggest things we learned from Google at I/O 2024. Google's I/O event was largely an opportunity for it to make its case to developers -- and, to a lesser extent, consumers -- as to why its artificial intelligence is ahead of rivals Microsoft and OpenAI. Here's a rundown of the seven highlights to keep an eye on.
Sam Altman is 'embarrassed' that OpenAI threatened to revoke equity if exiting employees wouldn't sign an NDA
OpenAI reportedly made exiting employees choose between keeping their vested equity and being able to speak out against the company. According to Vox, which viewed the document in question, employees could "lose all vested equity they earned during their time at the company, which is likely worth millions of dollars" if they didn't sign a nondisclosure and non-disparagement agreement, thanks to a provision in the off-boarding papers. OpenAI CEO Sam Altman confirmed in a tweet on Saturday evening that such a provision did exist, but said "we have never clawed back anyone's vested equity, nor will we do that if people do not sign a separation agreement (or don't agree to a non-disparagement agreement)." An OpenAI spokesperson echoed this in a statement to Vox, and Altman said the company "was already in the process of fixing the standard exit paperwork over the past month or so." But as Vox notes in its report, at least one former OpenAI employee has spoken publicly about sacrificing equity by declining to sign an NDA upon leaving.
Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applications
Maity, Subhankar, Deroy, Aniket, Sarkar, Sudeshna
In the era of generative artificial intelligence (AI), the fusion of large language models (LLMs) offers unprecedented opportunities for innovation in the field of modern education. We embark on an exploration of prompted LLMs within the context of educational and assessment applications to uncover their potential. Through a series of carefully crafted research questions, we investigate the effectiveness of prompt-based techniques in generating open-ended questions from school-level textbooks, assess their efficiency in generating open-ended questions from undergraduate-level technical textbooks, and explore the feasibility of employing a chain-of-thought inspired multi-stage prompting approach for language-agnostic multiple-choice question (MCQ) generation. Additionally, we evaluate the ability of prompted LLMs for language learning, exemplified through a case study in the low-resource Indian language Bengali, to explain Bengali grammatical errors. We also evaluate the potential of prompted LLMs to assess human resource (HR) spoken interview transcripts. By juxtaposing the capabilities of LLMs with those of human experts across various educational tasks and domains, our aim is to shed light on the potential and limitations of LLMs in reshaping educational practices.
OpenAI putting 'shiny products' above safety, says departing researcher
A former senior employee at OpenAI has said the company behind ChatGPT is prioritising "shiny products" over safety, revealing that he quit after a disagreement over key aims reached "breaking point". Jan Leike was a key safety researcher at OpenAI as its co-head of superalignment, ensuring that powerful artificial intelligence systems adhere to human values and aims. His intervention comes before a global artificial intelligence summit in Seoul next week, where politicians, experts and tech executives will discuss oversight of the technology. Leike resigned days after the San Francisco-based company launched its latest AI model, GPT-4o. His departure means two senior safety figures at OpenAI have left this week following the resignation of Ilya Sutskever, OpenAI's co-founder and fellow co-head of superalignment.