Media
Disney's age-altering AI can make young actors look 80 or old actors 20 in REAL TIME
Disney researchers are out to transform Hollywood with a new artificial intelligence tool that could eliminate the need for special effects to alter the age of actors playing a character in a movie. Using the face re-aging network (FRAN), filmmakers can now make actors look as young as 20 or as old as 80 years old just by inputting the person's headshot into the system that then predicts parts of the face should be altered by age. It then adds effects like wrinkles or smoothed skin as a layer on the actor's face in the film or television show without requiring a skilled artist to alter frame-by-frame manually, which typically causes facial identity loss. Disney touts its AI tool as being the first solution of its kind that can automatically alter an actor's age on video despite expressions, lighting conditions and viewpoints. The system was trained on 2,000 synthetically generated images, allowing it to learn different facial expression in order to keep the altered age layer stable as the actor moves in the film.
UNB advancing artificial intelligence and data science with $2.5 million commitment
University of New Brunswick (UNB) alumnus Dick Carpenter (BA '72) and the McKenna Institute are pleased to announce a gift of $2.5 million to advance the development of artificial intelligence (AI) and data science at UNB. AI and data science have become essential elements in the creation of effective digital products and services. AI depends on large data sets for developing reliable predictive models and data science relies on AI algorithms to extract meaningful features from data sets. This interdependence has resulted in AI and data science becoming increasingly intertwined and dependent upon advances in math, computer science and software engineering. This gift will support the development of interdisciplinary AI and data science research across UNB's faculties and campuses. It was secured through the ambassadorship of UNB alumnus and former New Brunswick premier The Hon. "We tend to think of AI in terms of social media algorithms," said Dr. Paul J. Mazerolle, UNB's president and vice-chancellor.
Disney Made a Movie Quality AI Tool That Automatically Makes Actors Look Younger (or Older)
Further demonstrating the power of artificial intelligence when it comes to photorealistically altering footage, researchers from Disney have revealed a new aging/de-aging tool that can make an actor look convincingly older or younger, without the need for weeks of complex and expensive visual effects work. When watching a blockbuster movie like 2018's Ant-Man and the Wasp, most viewers can easily spot the work of the many visual effects studios that contribute to these films, what with their flashy moments when Ant-Man shrinks or grows to gigantic proportions. But it's sometimes the more subtle VFX work that can be the hardest to achieve photorealistic results with, like the shots featuring younger versions of actors Michelle Pfeiffer and Michael Douglas. To get results like those seen in the movie, talented artists either need to spend weeks erasing wrinkles and other telltale signs of age from an actor's face, or entirely replace it with a computer-generated double. Visual effects are a powerful filmmaking tool, but there are plenty of reasons to find ways to make them easier to create; from lightening the load on already over-worked and underpaid artists, to making the tools accessible to filmmakers not working with immense Hollywood-sized budgets.
Proceedings of the 1st International Workshop on Reading Music Systems
Calvo-Zaragoza, Jorge, Hajič, Jan jr., Pacha, Alexander
The International Workshop on Reading Music Systems (WoRMS) is a workshop that tries to connect researchers who develop systems for reading music, such as in the field of Optical Music Recognition, with other researchers and practitioners that could benefit from such systems, like librarians or musicologists. The relevant topics of interest for the workshop include, but are not limited to: Music reading systems; Optical music recognition; Datasets and performance evaluation; Image processing on music scores; Writer identification; Authoring, editing, storing and presentation systems for music scores; Multi-modal systems; Novel input-methods for music to produce written music; Web-based Music Information Retrieval services; Applications and projects; Use-cases related to written music. These are the proceedings of the 1st International Workshop on Reading Music Systems, held in Paris on the 20th of September 2018.
A Commonsense-Infused Language-Agnostic Learning Framework for Enhancing Prediction of Political Polarity in Multilingual News Headlines
Swati, Swati, Grobelnik, Adrian Mladenić, Mladenić, Dunja, Grobelnik, Marko
Predicting the political polarity of news headlines is a challenging task that becomes even more challenging in a multilingual setting with low-resource languages. To deal with this, we propose to utilise the Inferential Commonsense Knowledge via a Translate-Retrieve-Translate strategy to introduce a learning framework. To begin with, we use the method of translation and retrieval to acquire the inferential knowledge in the target language. We then employ an attention mechanism to emphasise important inferences. We finally integrate the attended inferences into a multilingual pre-trained language model for the task of bias prediction. To evaluate the effectiveness of our framework, we present a dataset of over 62.6K multilingual news headlines in five European languages annotated with their respective political polarities. We evaluate several state-of-the-art multilingual pre-trained language models since their performance tends to vary across languages (low/high resource). Evaluation results demonstrate that our proposed framework is effective regardless of the models employed. Overall, the best performing model trained with only headlines show 0.90 accuracy and F1, and 0.83 jaccard score. With attended knowledge in our framework, the same model show an increase in 2.2% accuracy and F1, and 3.6% jaccard score. Extending our experiments to individual languages reveals that the models we analyze for Slovenian perform significantly worse than other languages in our dataset. To investigate this, we assess the effect of translation quality on prediction performance. It indicates that the disparity in performance is most likely due to poor translation quality. We release our dataset and scripts at: https://github.com/Swati17293/KG-Multi-Bias for future research. Our framework has the potential to benefit journalists, social scientists, news producers, and consumers.
Anger Breeds Controversy: Analyzing Controversy and Emotions on Reddit
Chen, Kai, He, Zihao, Chang, Rong-Ching, May, Jonathan, Lerman, Kristina
Emotions play an important role in interpersonal interactions and social conflict, yet their function in the development of controversy and disagreement in online conversations has not been explored. To address this gap, we study controversy on Reddit, a popular network of online discussion forums. We collect discussions from a wide variety of topical forums and use emotion detection to recognize a range of emotions from text, including anger, fear, joy, admiration, etc. Our study has three main findings. First, controversial comments express more anger and less admiration, joy and optimism than non-controversial comments. Second, controversial comments affect emotions of downstream comments in a discussion, usually resulting in long-term increase in anger and a decrease in positive emotions, although the magnitude and direction of emotional change depends on the forum. Finally, we show that emotions help better predict which comments will become controversial. Understanding emotional dynamics of online discussions can help communities to better manage conversations.
Analyzing the State of Computer Science Research with the DBLP Discovery Dataset
The number of scientific publications continues to rise exponentially, especially in Computer Science (CS). However, current solutions to analyze those publications restrict access behind a paywall, offer no features for visual analysis, limit access to their data, only focus on niches or sub-fields, and/or are not flexible and modular enough to be transferred to other datasets. In this thesis, we conduct a scientometric analysis to uncover the implicit patterns hidden in CS metadata and to determine the state of CS research. Specifically, we investigate trends of the quantity, impact, and topics for authors, venues, document types (conferences vs. journals), and fields of study (compared to, e.g., medicine). To achieve this we introduce the CS-Insights system, an interactive web application to analyze CS publications with various dashboards, filters, and visualizations. The data underlying this system is the DBLP Discovery Dataset (D3), which contains metadata from 5 million CS publications. Both D3 and CS-Insights are open-access, and CS-Insights can be easily adapted to other datasets in the future. The most interesting findings of our scientometric analysis include that i) there has been a stark increase in publications, authors, and venues in the last two decades, ii) many authors only recently joined the field, iii) the most cited authors and venues focus on computer vision and pattern recognition, while the most productive prefer engineering-related topics, iv) the preference of researchers to publish in conferences over journals dwindles, v) on average, journal articles receive twice as many citations compared to conference papers, but the contrast is much smaller for the most cited conferences and journals, and vi) journals also get more citations in all other investigated fields of study, while only CS and engineering publish more in conferences than journals.
Proceedings of the 2nd International Workshop on Reading Music Systems
Calvo-Zaragoza, Jorge, Pacha, Alexander
The International Workshop on Reading Music Systems (WoRMS) is a workshop that tries to connect researchers who develop systems for reading music, such as in the field of Optical Music Recognition, with other researchers and practitioners that could benefit from such systems, like librarians or musicologists. The relevant topics of interest for the workshop include, but are not limited to: Music reading systems; Optical music recognition; Datasets and performance evaluation; Image processing on music scores; Writer identification; Authoring, editing, storing and presentation systems for music scores; Multi-modal systems; Novel input-methods for music to produce written music; Web-based Music Information Retrieval services; Applications and projects; Use-cases related to written music. These are the proceedings of the 2nd International Workshop on Reading Music Systems, held in Delft on the 2nd of November 2019.
Proceedings of the 3rd International Workshop on Reading Music Systems
Calvo-Zaragoza, Jorge, Pacha, Alexander
The International Workshop on Reading Music Systems (WoRMS) is a workshop that tries to connect researchers who develop systems for reading music, such as in the field of Optical Music Recognition, with other researchers and practitioners that could benefit from such systems, like librarians or musicologists. The relevant topics of interest for the workshop include, but are not limited to: Music reading systems; Optical music recognition; Datasets and performance evaluation; Image processing on music scores; Writer identification; Authoring, editing, storing and presentation systems for music scores; Multi-modal systems; Novel input-methods for music to produce written music; Web-based Music Information Retrieval services; Applications and projects; Use-cases related to written music. These are the proceedings of the 3rd International Workshop on Reading Music Systems, held in Alicante on the 23rd of July 2021.
ColBERT: Using BERT Sentence Embedding in Parallel Neural Networks for Computational Humor
Annamoradnejad, Issa, Zoghi, Gohar
Automation of humor detection and rating has interesting use cases in modern technologies, such as humanoid robots, chatbots, and virtual assistants. In this paper, we propose a novel approach for detecting and rating humor in short texts based on a popular linguistic theory of humor. The proposed technical method initiates by separating sentences of the given text and utilizing the BERT model to generate embeddings for each one. The embeddings are fed to separate lines of hidden layers in a neural network (one line for each sentence) to extract latent features. At last, the parallel lines are concatenated to determine the congruity and other relationships between the sentences and predict the target value. We accompany the paper with a novel dataset for humor detection consisting of 200,000 formal short texts. In addition to evaluating our work on the novel dataset, we participated in a live machine learning competition focused on rating humor in Spanish tweets. The proposed model obtained F1 scores of 0.982 and 0.869 in the humor detection experiments which outperform general and state-of-the-art models. The evaluation performed on two contrasting settings confirm the strength and robustness of the model and suggests two important factors in achieving high accuracy in the current task: 1) usage of sentence embeddings and 2) utilizing the linguistic structure of humor in designing the proposed model.