Media
Voice Actors Push Back Against Their Voices Being Used by AI
Towards the end of 2022, there was a big boom in AI-generated art on social media and artist-friendly sites such as ArtStation. Though human artists have been quite vocal about how art generators are copying art that already exists from real creators, AI art is gradually becoming a part of that community and other parts of various entertainment industries such as books or music. And now a similar problem is arising in the voice acting space. Earlier in the week, Motherboard reported a story on how video game voice actors are now being asked to sign their voice rights away to company-run AI voice generators when signing on for a new project. Some actors have been made to sign contracts with these clauses built in, others don't even know the clause exists until after they've signed.
Just nine out of 116 AI professionals in films are women, study finds
A relentless stream of movies, from Iron Man to Ex Machina, has helped entrench systemic gender inequality in the artificial intelligence industry by portraying AI researchers almost exclusively as men, a study has found. The overwhelming predominance of men as leading AI researchers in movies has shaped public perceptions of the industry, the authors say, and risks contributing to a dramatic lack of women in the tech workforce. Beyond the impact on gender balance, the study raises concerns about the knock-on effects of products that favour male users because they are developed by what the former Microsoft employee Margaret Mitchell called "a sea of dudes". "Given that male engineers have repeatedly been shown to engineer products that are most suitable for and adapted to male users, employing more women is essential for addressing the encoding of bias and pejorative stereotypes into AI technologies," the report's authors write. Researchers at the University of Cambridge reviewed more than 1,400 films released between 1920 and 2020 and whittled them down to the 142 most influential movies featuring artificial intelligence.
Mixed Multi-Model Semantic Interaction for Graph-based Narrative Visualizations
Norambuena, Brian Keith, Mitra, Tanushree, North, Chris
Narrative sensemaking is an essential part of understanding sequential data. Narrative maps are a visual representation model that can assist analysts to understand narratives. In this work, we present a semantic interaction (SI) framework for narrative maps that can support analysts through their sensemaking process. In contrast to traditional SI systems which rely on dimensionality reduction and work on a projection space, our approach has an additional abstraction layer -- the structure space -- that builds upon the projection space and encodes the narrative in a discrete structure. This extra layer introduces additional challenges that must be addressed when integrating SI with the narrative extraction pipeline. We address these challenges by presenting the general concept of Mixed Multi-Model Semantic Interaction (3MSI) -- an SI pipeline, where the highest-level model corresponds to an abstract discrete structure and the lower-level models are continuous. To evaluate the performance of our 3MSI models for narrative maps, we present a quantitative simulation-based evaluation and a qualitative evaluation with case studies and expert feedback. We find that our SI system can model the analysts' intent and support incremental formalism for narrative maps.
Paparazzi: A Deep Dive into the Capabilities of Language and Vision Models for Grounding Viewpoint Descriptions
Voigt, Henrik, Hombeck, Jan, Meuschke, Monique, Lawonn, Kai, Zarrieß, Sina
Existing language and vision models achieve impressive performance in image-text understanding. Yet, it is an open question to what extent they can be used for language understanding in 3D environments and whether they implicitly acquire 3D object knowledge, e.g. about different views of an object. In this paper, we investigate whether a state-of-the-art language and vision model, CLIP, is able to ground perspective descriptions of a 3D object and identify canonical views of common objects based on text queries. We present an evaluation framework that uses a circling camera around a 3D object to generate images from different viewpoints and evaluate them in terms of their similarity to natural language descriptions. We find that a pre-trained CLIP model performs poorly on most canonical views and that fine-tuning using hard negative sampling and random contrasting yields good results even under conditions with little available training data.
Netflix and Forget: Efficient and Exact Machine Unlearning from Bi-linear Recommendations
Xu, Mimee, Sun, Jiankai, Yang, Xin, Yao, Kevin, Wang, Chong
People break up, miscarry, and lose loved ones. Their online streaming and shopping recommendations, however, do not necessarily update, and may serve as unhappy reminders of their loss. When users want to renege on their past actions, they expect the recommender platforms to erase selective data at the model level. Ideally, given any specified user history, the recommender can unwind or "forget", as if the record was not part of training. To that end, this paper focuses on simple but widely deployed bi-linear models for recommendations based on matrix completion. Without incurring the cost of re-training, and without degrading the model unnecessarily, we develop Unlearn-ALS by making a few key modifications to the fine-tuning procedure under Alternating Least Squares optimisation, thus applicable to any bi-linear models regardless of the training procedure. We show that Unlearn-ALS is consistent with retraining without \emph{any} model degradation and exhibits rapid convergence, making it suitable for a large class of existing recommenders.
Raising the Cost of Malicious AI-Powered Image Editing
Salman, Hadi, Khaddaj, Alaa, Leclerc, Guillaume, Ilyas, Andrew, Madry, Aleksander
We present an approach to mitigating the risks of malicious image editing posed by large diffusion models. The key idea is to immunize images so as to make them resistant to manipulation by these models. This immunization relies on injection of imperceptible adversarial perturbations designed to disrupt the operation of the targeted diffusion models, forcing them to generate unrealistic images. We provide two methods for crafting such perturbations, and then demonstrate their efficacy. Finally, we discuss a policy component necessary to make our approach fully effective and practical -- one that involves the organizations developing diffusion models, rather than individual users, to implement (and support) the immunization process.
Biases in Scholarly Recommender Systems: Impact, Prevalence, and Mitigation
Färber, Michael, Coutinho, Melissa, Yuan, Shuzhou
With the remarkable increase in the number of scientific entities such as publications, researchers, and scientific topics, and the associated information overload in science, academic recommender systems have become increasingly important for millions of researchers and science enthusiasts. However, it is often overlooked that these systems are subject to various biases. In this article, we first break down the biases of academic recommender systems and characterize them according to their impact and prevalence. In doing so, we distinguish between biases originally caused by humans and biases induced by the recommender system. Second, we provide an overview of methods that have been used to mitigate these biases in the scholarly domain. Based on this, third, we present a framework that can be used by researchers and developers to mitigate biases in scholarly recommender systems and to evaluate recommender systems fairly. Finally, we discuss open challenges and possible research directions related to scholarly biases.
Evaluation of Fake News Detection with Knowledge-Enhanced Language Models
Whitehouse, Chenxi, Weyde, Tillman, Madhyastha, Pranava, Komninos, Nikos
Recent advances in fake news detection have exploited the success of large-scale pre-trained language models (PLMs). The predominant state-of-the-art approaches are based on fine-tuning PLMs on labelled fake news datasets. However, large-scale PLMs are generally not trained on structured factual data and hence may not possess priors that are grounded in factually accurate knowledge. The use of existing knowledge bases (KBs) with rich human-curated factual information has thus the potential to make fake news detection more effective and robust. In this paper, we investigate the impact of knowledge integration into PLMs for fake news detection. We study several state-of-the-art approaches for knowledge integration, mostly using Wikidata as KB, on two popular fake news datasets - LIAR, a politics-based dataset, and COVID-19, a dataset of messages posted on social media relating to the COVID-19 pandemic. Our experiments show that knowledge-enhanced models can significantly improve fake news detection on LIAR where the KB is relevant and up-to-date. The mixed results on COVID-19 highlight the reliance on stylistic features and the importance of domain-specific and current KBs.