Have you ever wanted to know what two golden retrievers podcasting on top of a mountain might look like? Or perhaps watch a bicycle race on the ocean with different animals riding the bicycles? OpenAI's latest generative artificial intelligence offering, Sora, can generate breathtakingly realistic videos that are up to a minute long from text prompts. OpenAI CEO Sam Altman announced the model's creation on X on Thursday. Sora is not yet available to the public. For now, OpenAI is only granting access to red teamers--individuals employed to look for issues--who will assess potential risks associated with the model's release, as well as a limited number of "visual artists, designers, and filmmakers to gain feedback on how to advance the model to be most helpful for creative professionals," according to a blog post.

Tesla CEO Elon Musk stands in front of the damaged Cybertruck after it fails a demonstration of its durability.Ringo H.W. Chiu / AP At a live delivery event this November, where Elon Musk awkwardly opened the door for about a dozen new Cybertruck owners, he told the world: "The apocalypse can come along any moment, and here at Tesla, we have the best in apocalypse technology." Then he showed a video of the vehicle being pummeled by a machine gun, quipping, "If you're ever in an argument with another car, you will win." And then he sold a bunch of Cybertrucks. Two million have been preordered--and 500 delivered--for over 60,000 a pop. Some soon proved that they couldn't survive a test drive, let alone a ride with Mad Max.

A quarter of US adults regularly get their news from YouTube. Yet, despite the massive political content available on the platform, to date no classifier has been proposed to identify the political leaning of YouTube videos. To fill this gap, we propose a novel classifier based on Bert -- a language model from Google -- to classify YouTube videos merely based on their titles into six categories, namely: Far Left, Left, Center, Anti-Woke, Right, and Far Right. We used a public dataset of 10 million YouTube video titles (under various categories) to train and validate the proposed classifier. We compare the classifier against several alternatives that we trained on the same dataset, revealing that our classifier achieves the highest accuracy (75%) and the highest F1 score (77%). To further validate the classification performance, we collect videos from YouTube channels of numerous prominent news agencies, such as Fox News and New York Times, which have widely known political leanings, and apply our classifier to their video titles. For the vast majority of cases, the predicted political leaning matches that of the news agency.

Several parameter-efficient fine-tuning methods based on adapters have been proposed as a streamlined approach to incorporate not only a single specialized knowledge into existing Pre-Trained Language Models (PLMs) but also multiple of them at once. Recent works such as AdapterSoup propose to mix not all but only a selective sub-set of domain-specific adapters during inference via model weight averaging to optimize performance on novel, unseen domains with excellent computational efficiency. However, the essential generalizability of this emerging weight-space adapter mixing mechanism on unseen, in-domain examples remains unexplored. Thus, in this study, we conduct a comprehensive analysis to elucidate the generalizability of domain-specific adapter mixtures in in-domain evaluation. We also provide investigations into the inner workings of the mixture of domain-specific adapters by analyzing their weight signs, yielding critical analysis on the negative correlation between their fraction of weight sign difference and their mixtures' generalizability. All source code will be published.

The reasoning capabilities of LLMs are currently hotly debated. We examine the issue from the perspective of claim/rumour verification. We propose the first logical reasoning framework designed to break down any claim or rumor paired with evidence into the atomic reasoning steps necessary for verification. Based on our framework, we curate two annotated collections of such claim/evidence pairs: a synthetic dataset from Wikipedia and a real-world set stemming from rumours circulating on Twitter. We use them to evaluate the reasoning capabilities of GPT-3.5-Turbo and GPT-4 (hereinafter referred to as ChatGPT) within the context of our framework, providing a thorough analysis. Our results show that ChatGPT struggles in abductive reasoning, although this can be somewhat mitigated by using manual Chain of Thought (CoT) as opposed to Zero Shot (ZS) and ZS CoT approaches. Our study contributes to the growing body of research suggesting that ChatGPT's reasoning processes are unlikely to mirror human-like reasoning, and that LLMs need to be more rigorously evaluated in order to distinguish between hype and actual capabilities, especially in high stake real-world tasks such as claim verification.

Hallucinations pose a significant challenge for the practical implementation of large language models (LLMs). The utilization of parametric knowledge in generating factual content is constrained by the limited knowledge of LLMs, potentially resulting in internal hallucinations. While incorporating external information can help fill knowledge gaps, it also introduces the risk of irrelevant information, thereby increasing the likelihood of external hallucinations. A careful and balanced integration of the parametric knowledge within LLMs with external information is crucial to alleviate hallucinations. In this study, we present Rowen, a novel approach that enhances LLMs with a selective retrieval augmentation process tailored to address hallucinated outputs. This process is governed by a multilingual semantic-aware detection module, which evaluates the consistency of the perturbed responses across various languages for the same queries. Upon detecting inconsistencies indicative of hallucinations, Rowen activates the retrieval of external information to rectify the model outputs. Rowen adeptly harmonizes the intrinsic parameters in LLMs with external knowledge sources, effectively mitigating hallucinations by ensuring a balanced integration of internal reasoning and external evidence. Through a comprehensive empirical analysis, we demonstrate that Rowen surpasses the current state-of-the-art in both detecting and mitigating hallucinated content within the outputs of LLMs.

Chain-of-Thought (CoT) prompting has marked a significant advancement in enhancing the reasoning capabilities of large language models (LLMs). Previous studies have developed various extensions of CoT, which focus primarily on enhancing end-task performance. In addition, there has been research on assessing the quality of reasoning chains in CoT. This raises an intriguing question: Is it possible to predict the accuracy of LLM outputs by scrutinizing the reasoning chains they generate? To answer this research question, we introduce a benchmark, R2PE, designed specifically to explore the relationship between reasoning chains and performance in various reasoning tasks spanning five different domains. This benchmark aims to measure the falsehood of the final output of LLMs based on the reasoning steps. To make full use of information in multiple reasoning chains, we propose the process discernibility score (PDS) framework that beats the answer-checking baseline by a large margin. Concretely, this resulted in an average of 5.1% increase in the F1 score across all 45 subsets within R2PE. We further demonstrate our PDS's efficacy in advancing open-domain QA accuracy. Data and code are available at https://github.com/XinXU-USTC/R2PE.

Extensive efforts in automated approaches for content moderation have been focused on developing models to identify toxic, offensive, and hateful content with the aim of lightening the load for moderators. Yet, it remains uncertain whether improvements on those tasks have truly addressed moderators' needs in accomplishing their work. In this paper, we surface gaps between past research efforts that have aimed to provide automation for aspects of content moderation and the needs of volunteer content moderators, regarding identifying violations of various moderation rules. To do so, we conduct a model review on Hugging Face to reveal the availability of models to cover various moderation rules and guidelines from three exemplar forums. We further put state-of-the-art LLMs to the test, evaluating how well these models perform in flagging violations of platform rules from one particular forum. Finally, we conduct a user survey study with volunteer moderators to gain insight into their perspectives on useful moderation models. Overall, we observe a non-trivial gap, as missing developed models and LLMs exhibit moderate to low performance on a significant portion of the rules. Moderators' reports provide guides for future work on developing moderation assistant models.

A perfect day in Los Angeles starts with a stroll along the Venice Beach boardwalk. After that, Beverly Hills, then Hollywood to see the Walk of Fame, then Griffith Park for a hike, then Chinatown for dim sum, then downtown, perhaps to catch an evening show at the Walt Disney Concert Hall. Or at least, that's what a chatbot thinks a "perfect day" is. This agenda was custom-made for me by Microsoft Copilot after I told it I had one day in town to explore the sights and asked it to plan accordingly. Here's a jam-packed 24-hour itinerary," Copilot responded, before rattling off an eight-part answer. What I didn't tell Copilot is that I already live here--and know that such an itinerary is perfect only if your idea of bliss is spending most of the day traversing one of the country's most sprawling, traffic-clogged cities, frantically popping from landmark to landmark. I asked Copilot to make me a travel itinerary because Microsoft has trotted it out as an example of how people can use the ChatGPT-like assistant. It can supposedly help you pick a destination, compare flight prices, and settle on attractions that are "popular with tourists--or just a little more off the beaten path." Of all the things you might ask a chatbot, AI companies love to suggest you ask for help planning upcoming travel. Open up ChatGPT and you might see this hypothetical prompt: "Plan a trip to see the best of New York in 3 days." Google's Gemini chatbot offers similar ones. Meta's line of chatbot assistants on Instagram and Facebook includes "Lorena," your own personal travel expert. And Rabbit, the company behind a new AI gadget, pulled out the travel example for a keynote video last month. If one were to play AI-marketing bingo, "trip itinerary" would get crossed off basically every time. More than a year into the generative-AI revolution, companies so frequently suggest that people use their tools in this way that you'd think chatbots would excel at it. In theory, chatbots that can instantaneously create travel plans are a marketer's dream. The use case is easy to understand: Planning a vacation can be a real challenge for people. First, it involves toggling among flight listings, hotel availability, and ticketing websites for major attractions. Then, it requires more nuanced research, to figure out which local restaurants are actually good and which are overpriced tourist scams, or what time to set off for a big hike that won't leave you in the woods after sunset. Most of this travel information already lives on the internet or in books, meaning that it has likely already been incorporated into a chatbot's training data. "There are probably thousands of places on webpages that describe a trip to Boston," Kathleen Creel, a professor of philosophy and computer science at Northeastern University, told me. There's people on Reddit talking about living in Boston and what they like."

OpenAI revealed a tool on Thursday that can generate videos from text prompts. The new model, nicknamed Sora after the Japanese word for "sky", can produce realistic footage up to a minute long that adheres to a user's instructions on both subject matter and style. According to a company blogpost, the model is also able to create a video based on a still image or extend existing footage with new material. "We're teaching AI to understand and simulate the physical world in motion, with the goal of training models that help people solve problems that require real-world interaction," the blogpost reads. One video included among several initial examples from the company was based on the prompt: "A movie trailer featuring the adventures of the 30-year-old space man wearing a red wool knitted motorcycle helmet, blue sky, salt desert, cinematic style, shot on 35mm film, vivid colors."