Media
How AI could help translate extreme weather alerts
In 2017, nearly all of the people in New York City to die from flash flooding from the remnants of Hurricane Ida were Asian and spoke limited English or Spanish, which the New York Times reported may have led to those residents not receiving warnings to evacuate. Seven members of a Guatemalan family in Oklahoma died from flash floods in 2013 after leaving their home to seek shelter in a storm drain upon hearing a tornado warning. NBC News reported "they hadn't heard or understood there had also been storm and flood warnings." And a 2020 study found that emergency warnings during California's 2017-18 Thomas Fire were initially only available in English. As a result, Latino residents living in the two most heavily impacted counties missed information about evacuation areas, road closures, unsafe air and boil water notices.
DallยทE Mini And The Future Of Artificial Intelligence Art
You likely see the power of artificial intelligence (AI) daily when you log in to social media or order something online. Many companies use AI to improve business operations and automate more stages of the customer experience. The goal is for AI to allow machines to replace people so that you don't need a human touch for basic and even some complex tasks. With many companies investing in artificial intelligence, it's no surprise that there are AI-powered graphic generators that can create original works of art. We're going to look at the DALLยทE 2, DALLยทE Mini, and what the future of AI painting looks like. Before we analyze the world of AI-generated artwork, we're going to look at the two most popular tools you may have heard of, including DALLยทE 2 and DALLยทE Mini.
Record Labels Say AI Music Generators Threaten Music Industry
There are online services that, purportedly using artificial intelligence (AI), extract, or rather, copy, the vocals, instrumentals, or some portion of the instrumentals (a music stem) from a sound recording, and/or generate, master or remix a recording to be very similar to or almost as good as reference tracks by selected, well known sound recording artists,
Visual SLAM: What are the Current Trends and What to Expect?
Tourani, Ali, Bavle, Hriday, Sanchez-Lopez, Jose Luis, Voos, Holger
Vision-based sensors have shown significant performance, accuracy, and efficiency gain in Simultaneous Localization and Mapping (SLAM) systems in recent years. In this regard, Visual Simultaneous Localization and Mapping (VSLAM) methods refer to the SLAM approaches that employ cameras for pose estimation and map generation. We can see many research works that demonstrated VSLAMs can outperform traditional methods, which rely only on a particular sensor, such as a Lidar, even with lower costs. VSLAM approaches utilize different camera types (e.g., monocular, stereo, and RGB-D), have been tested on various datasets (e.g., KITTI, TUM RGB-D, and EuRoC) and in dissimilar environments (e.g., indoors and outdoors), and employ multiple algorithms and methodologies to have a better understanding of the environment. The mentioned variations have made this topic popular for researchers and resulted in a wide range of VSLAMs methodologies. In this regard, the primary intent of this survey is to present the recent advances in VSLAM systems, along with discussing the existing challenges and trends. We have given an in-depth literature survey of forty-five impactful papers published in the domain of VSLAMs. We have classified these manuscripts by different characteristics, including the novelty domain, objectives, employed algorithms, and semantic level. We also discuss the current trends and future directions that may help researchers investigate them.
A BERT-based Deep Learning Approach for Reputation Analysis in Social Media
Rahman, Mohammad Wali Ur, Shao, Sicong, Satam, Pratik, Hariri, Salim, Padilla, Chris, Taylor, Zoe, Nevarez, Carlos
Social media has become an essential part of the modern lifestyle, with its usage being highly prevalent. This has resulted in unprecedented amounts of data generated from users in social media, such as users' attitudes, opinions, interests, purchases, and activities across various aspects of their lives. Therefore, in a world of social media, where its power has shifted to users, actions taken by companies and public figures are subject to constantly being under scrutiny by influential global audiences. As a result, reputation management in social media has become essential as companies and public figures need to maintain their reputation to preserve their reputation capital. However, domain experts still face the challenge of lacking appropriate solutions to automate reliable online reputation analysis. To tackle this challenge, we proposed a novel reputation analysis approach based on the popular language model BERT (Bidirectional Encoder Representations from Transformers). The proposed approach was evaluated on the reputational polarity task using RepLab 2013 dataset. Compared to previous works, we achieved 5.8% improvement in accuracy, 26.9% improvement in balanced accuracy, and 21.8% improvement in terms of F-score.
MovieCLIP: Visual Scene Recognition in Movies
Bose, Digbalay, Hebbar, Rajat, Somandepalli, Krishna, Zhang, Haoyang, Cui, Yin, Cole-McLaughlin, Kree, Wang, Huisheng, Narayanan, Shrikanth
Longform media such as movies have complex narrative structures, with events spanning a rich variety of ambient visual scenes. Domain specific challenges associated with visual scenes in movies include transitions, person coverage, and a wide array of real-life and fictional scenarios. Existing visual scene datasets in movies have limited taxonomies and don't consider the visual scene transition within movie clips. In this work, we address the problem of visual scene recognition in movies by first automatically curating a new and extensive movie-centric taxonomy of 179 scene labels derived from movie scripts and auxiliary web-based video datasets. Instead of manual annotations which can be expensive, we use CLIP to weakly label 1.12 million shots from 32K movie clips based on our proposed taxonomy. We provide baseline visual models trained on the weakly labeled dataset called MovieCLIP and evaluate them on an independent dataset verified by human raters. We show that leveraging features from models pretrained on MovieCLIP benefits downstream tasks such as multi-label scene and genre classification of web videos and movie trailers.
TranSHER: Translating Knowledge Graph Embedding with Hyper-Ellipsoidal Restriction
Li, Yizhi, Fan, Wei, Liu, Chao, Lin, Chenghua, Qian, Jiang
Knowledge graph embedding methods are important for the knowledge graph completion (or link prediction) task. One existing efficient method, PairRE, leverages two separate vectors to model complex relations (i.e., 1-to-N, N-to-1, and N-to-N) in knowledge graphs. However, such a method strictly restricts entities on the hyper-ellipsoid surfaces which limits the optimization of entity distribution, leading to suboptimal performance of knowledge graph completion. To address this issue, we propose a novel score function TranSHER, which leverages relation-specific translations between head and tail entities to relax the constraint of hyper-ellipsoid restrictions. By introducing an intuitive and simple relation-specific translation, TranSHER can provide more direct guidance on optimization and capture more semantic characteristics of entities with complex relations. Experimental results show that TranSHER achieves significant performance improvements on link prediction and generalizes well to datasets in different domains and scales. Our codes are public available at https://github.com/yizhilll/TranSHER.