Media
AI-Generated Video of the Mona Lisa Rapping Sparks Strong Reactions From Viewers
The internet has reacted strongly to an artificial intelligence-generated video of the famous subject of Leonardo Da Vinci's Mona Lisa painting singing along to a rap that actor Anne Hathaway wrote and performed. The polarizing clip, which has elicited reactions online ranging from humor to horror, is one of the tricks of Microsoft's new AI technology called VASA-1. The technology is able to generate lifelike talking faces of virtual characters using a single image and speech audio clip. The AI can make cartoon characters, photographs, and paintings sing or talk, as evidenced in footage Microsoft released as part of research published on April 16. In the most viral clip, the woman in the Mona Lisa painting sings, her mouth, eyes and face moving, to "Paparazzi," a rap Hathaway wrote and performed on Conan O'Brien's talk show in 2011.
Minds, Brains, AI
In the last year or so (and going back many decades) there has been extensive claims by major computational scientists, engineers, and others that AGI (artificial general intelligence) is 5 or 10 years away, but without a scintilla of scientific evidence, for a broad body of these claims: Computers will become conscious, have a "theory of mind," think and reason, will become more intelligent than humans, and so on. But the claims are science fiction, not science. This article reviews evidence for the following three (3) propositions using extensive body of scientific research and related sources from the cognitive and neurosciences; evolutionary evidence; linguistics; data science; comparative psychology; self-driving cars, and robotics; and the learning sciences.
General Item Representation Learning for Cold-start Content Recommendations
Kim, Jooeun, Kim, Jinri, Yeo, Kwangeun, Kim, Eungi, On, Kyoung-Woon, Mun, Jonghwan, Lee, Joonseok
Cold-start item recommendation is a long-standing challenge in recommendation systems. A common remedy is to use a content-based approach, but rich information from raw contents in various forms has not been fully utilized. In this paper, we propose a domain/data-agnostic item representation learning framework for cold-start recommendations, naturally equipped with multimodal alignment among various features by adopting a Transformer-based architecture. Our proposed model is end-to-end trainable completely free from classification labels, not just costly to collect but suboptimal for recommendation-purpose representation learning. From extensive experiments on real-world movie and news recommendation benchmarks, we verify that our approach better preserves fine-grained user taste than state-of-the-art baselines, universally applicable to multiple domains at large scale.
Multi-channel Emotion Analysis for Consensus Reaching in Group Movie Recommendation Systems
Yerkin, Adilet, Kadyrgali, Elnara, Torekhan, Yerdauit, Shamoi, Pakizar
Watching movies is one of the social activities typically done in groups. Emotion is the most vital factor that affects movie viewers' preferences. So, the emotional aspect of the movie needs to be determined and analyzed for further recommendations. It can be challenging to choose a movie that appeals to the emotions of a diverse group. Reaching an agreement for a group can be difficult due to the various genres and choices. This paper proposes a novel approach to group movie suggestions by examining emotions from three different channels: movie descriptions (text), soundtracks (audio), and posters (image). We employ the Jaccard similarity index to match each participant's emotional preferences to prospective movie choices, followed by a fuzzy inference technique to determine group consensus. We use a weighted integration process for the fusion of emotion scores from diverse data types. Then, group movie recommendation is based on prevailing emotions and viewers' best-loved movies. After determining the recommendations, the group's consensus level is calculated using a fuzzy inference system, taking participants' feedback as input. Participants (n=130) in the survey were provided with different emotion categories and asked to select the emotions best suited for particular movies (n=12). Comparison results between predicted and actual scores demonstrate the efficiency of using emotion detection for this problem (Jaccard similarity index = 0.76). We explored the relationship between induced emotions and movie popularity as an additional experiment, analyzing emotion distribution in 100 popular movies from the TMDB database. Such systems can potentially improve the accuracy of movie recommendation systems and achieve a high level of consensus among participants with diverse preferences.
Robust EEG-based Emotion Recognition Using an Inception and Two-sided Perturbation Model
Automated emotion recognition using electroencephalogram (EEG) signals has gained substantial attention. Although deep learning approaches exhibit strong performance, they often suffer from vulnerabilities to various perturbations, like environmental noise and adversarial attacks. In this paper, we propose an Inception feature generator and two-sided perturbation (INC-TSP) approach to enhance emotion recognition in brain-computer interfaces. INC-TSP integrates the Inception module for EEG data analysis and employs two-sided perturbation (TSP) as a defensive mechanism against input perturbations. TSP introduces worst-case perturbations to the model's weights and inputs, reinforcing the model's elasticity against adversarial attacks. The proposed approach addresses the challenge of maintaining accurate emotion recognition in the presence of input uncertainties. We validate INC-TSP in a subject-independent three-class emotion recognition scenario, demonstrating robust performance.
AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs
Paulus, Anselm, Zharmagambetov, Arman, Guo, Chuan, Amos, Brandon, Tian, Yuandong
While recently Large Language Models (LLMs) have achieved remarkable successes, they are vulnerable to certain jailbreaking attacks that lead to generation of inappropriate or harmful content. Manual red-teaming requires finding adversarial prompts that cause such jailbreaking, e.g. by appending a suffix to a given instruction, which is inefficient and time-consuming. On the other hand, automatic adversarial prompt generation often leads to semantically meaningless attacks that can easily be detected by perplexity-based filters, may require gradient information from the TargetLLM, or do not scale well due to time-consuming discrete optimization processes over the token space. In this paper, we present a novel method that uses another LLM, called the AdvPrompter, to generate human-readable adversarial prompts in seconds, $\sim800\times$ faster than existing optimization-based approaches. We train the AdvPrompter using a novel algorithm that does not require access to the gradients of the TargetLLM. This process alternates between two steps: (1) generating high-quality target adversarial suffixes by optimizing the AdvPrompter predictions, and (2) low-rank fine-tuning of the AdvPrompter with the generated adversarial suffixes. The trained AdvPrompter generates suffixes that veil the input instruction without changing its meaning, such that the TargetLLM is lured to give a harmful response. Experimental results on popular open source TargetLLMs show state-of-the-art results on the AdvBench dataset, that also transfer to closed-source black-box LLM APIs. Further, we demonstrate that by fine-tuning on a synthetic dataset generated by AdvPrompter, LLMs can be made more robust against jailbreaking attacks while maintaining performance, i.e. high MMLU scores.
Analyzing Decades-Long Environmental Changes in Namibia Using Archival Aerial Photography and Deep Learning
Tadesse, Girmaw Abebe, Robinson, Caleb, Hacheme, Gilles Quentin, Zaytar, Akram, Dodhia, Rahul, Shawa, Tsering Wangyal, Ferres, Juan M. Lavista, Kreike, Emmanuel H.
This study explores object detection in historical aerial photographs of Namibia to identify long-term environmental changes. Specifically, we aim to identify key objects -- Waterholes, Omuti homesteads, and Big trees -- around Oshikango in Namibia using sub-meter gray-scale aerial imagery from 1943 and 1972. In this work, we propose a workflow for analyzing historical aerial imagery using a deep semantic segmentation model on sparse hand-labels. To this end, we employ a number of strategies including class-weighting, pseudo-labeling and empirical p-value-based filtering to balance skewed and sparse representations of objects in the ground truth data. Results demonstrate the benefits of these different training strategies resulting in an average $F_1=0.661$ and $F_1=0.755$ over the three objects of interest for the 1943 and 1972 imagery, respectively. We also identified that the average size of Waterhole and Big trees increased while the average size of Omuti homesteads decreased between 1943 and 1972 reflecting some of the local effects of the massive post-Second World War economic, agricultural, demographic, and environmental changes. This work also highlights the untapped potential of historical aerial photographs in understanding long-term environmental changes beyond Namibia (and Africa). With the lack of adequate satellite technology in the past, archival aerial photography offers a great alternative to uncover decades-long environmental changes.
Five UFO abduction cases that could FINALLY be solved - as new study investigates 30-years' worth of evidence
Roughly 100 alien abduction cases spanning over the past 30 years are set to be investigated by scientists with hopes of unraveling the mysterious experiences. Researchers at Rice University in Texas plan to analyze a trove of archives consisting of thousands of documents in the form of books, journals, photographs, slides, reports, meeting notes and letters. The cases include the famous story of Betty and Barney Hill, a New Hampshire couple who say they were abducted in 1961 while driving up a mountain. Other cases include one that inspired a new Netflix show - the Pascagoula abduction. The'Archive of the Impossible' at Rice University plays host to material from Jacques Vallee (whose work inspired Steven Spielberg's'Close Encounters of the Third Kind') and author Whitley Streiber, who claimed to have been abducted by aliens in his 1987 book Communion among hundreds of other abduction stories.
Mel Brooks reveals which 'Spaceballs' star cost him 'a lot of money' on set
'The Sinner' star Bill Pullman reflects on his friendship with late'Spaceballs' co-star John Candy. Mel Brooks had his work cut out for him when he decided to spoof "Star Wars." The legendary comic is making his seventh appearance at the Turner Classic Movies (TCM) Film Festival to present his 1987 film "Spaceballs" on the festival's closing night at TCL Chinese Theatre. The 97-year-old will be joined by TCM host Ben Mankiewicz. Brooks told Fox News Digital that the making of the film quickly racked up the bill, all thanks to one star.
Where do we draw the line on using AI in TV and film?
Though last year's writers' and actors' strikes in Hollywood were about myriad factors, fair compensation and residual payments among them, one concern rose far above the others: the encroachment of generative AI – the type that can produce text, images and video – on people's livelihoods. The use of generative AI in the content we watch, from film to television to large swaths of internet garbage, was a foregone conclusion; Pandora's box has been opened. But the rallying cry, at the time, was that any protection secured against companies using AI to cut corners was a win, even if only for a three-year contract, as the development, deployment and adoption of this technology will be so swift. In the mere months since the writers' and actors' guilds made historic deals with the Alliance of Motion Picture and Television Producers (AMPTP), the average social media user has almost certainly encountered AI-generated material, whether they realized it or not. Efforts to curb pornographic AI deepfakes of celebrities have reached the notoriously recalcitrant and obtuse US Congress.