Media
'Authentic' Is 2023's Word of the Year. You Read That Right
At first it looked unbelievable, but Henry Kissinger had died. At 100 years old, news outlets--and the world--had been preparing for the passing of President Nixon's secretary of state for a while. Still, when people were finding out via emoji-filled chain texts, it seemed unreal. Deepfakes, the metaverse, Elon Musk telling advertisers to fuck themselves at a time when X could probably use the money. Perhaps this is why there is a premium on genuineness these days.
Microsoft Paint, supercharged: How to use new AI and Photoshop-like features
Microsoft is significantly expanding the functions of Paint in Windows 11. The app is also getting a new version. The outdated program is to become a modern image editor that also contains AI functions. In the future, you will be able to use the OpenAI-LLM Dall-E directly in Windows 11 and in Paint. The new functions are also available after installing the Microsoft Paint app from the App Store.
AI-driven platform Play Anywhere launches game-changing partnership to reimagine interactive TV sports rights
Fox News Flash top sports headlines are here. Check out what's clicking on Foxnews.com. As artificial intelligence continues to completely change the way millions of fans interact with live sporting events, a platform is introducing an innovative approach to monetization. Technology company Play Anywhere has developed a proven track record of increasing fan engagement and creating new revenue streams for its partners. The technology can be seemingly integrated into mobile devices, connected televisions or various streaming devices.
Ridley Scott warns AI will be 'technical hydrogen bomb' in film industry
AI expert Marva Bailer explains how, even though there are currently laws in place, the average person has more access than ever to create deepfakes of celebrities. Ridley Scott, director of sci-fi classics like "Alien" and "Blade Runner," is terrified about AI technology running away with society. In an interview with Rolling Stone promoting his film "Napoleon," Scott was asked if artificial intelligence worried him, and the answer was an emphatic yes. "We have to lock down AI. And I don't know how you're gonna lock it down," he told the outlet.
A Generalized Bandsplit Neural Network for Cinematic Audio Source Separation
Watcharasupat, Karn N., Wu, Chih-Wei, Ding, Yiwei, Orife, Iroro, Hipple, Aaron J., Williams, Phillip A., Kramer, Scott, Lerch, Alexander, Wolcott, William
Cinematic audio source separation is a relatively new subtask of audio source separation, with the aim of extracting the dialogue, music, and effects stems from their mixture. In this work, we developed a model generalizing the Bandsplit RNN for any complete or overcomplete partitions of the frequency axis. Psychoacoustically motivated frequency scales were used to inform the band definitions which are now defined with redundancy for more reliable feature extraction. A loss function motivated by the signal-to-noise ratio and the sparsity-promoting property of the 1-norm was proposed. We additionally exploit the information-sharing property of a common-encoder setup to reduce computational complexity during both training and inference, improve separation performance for hard-to-generalize classes of sounds, and allow flexibility during inference time with detachable decoders. Our best model sets the state of the art on the Divide and Remaster dataset with performance above the ideal ratio mask for the dialogue stem.
Video Summarization: Towards Entity-Aware Captions
Ayyubi, Hammad A., Liu, Tianqi, Nagrani, Arsha, Lin, Xudong, Zhang, Mingda, Arnab, Anurag, Han, Feng, Zhu, Yukun, Liu, Jialu, Chang, Shih-Fu
Existing popular video captioning benchmarks and models deal with generic captions devoid of specific person, place or organization named entities. In contrast, news videos present a challenging setting where the caption requires such named entities for meaningful summarization. As such, we propose the task of summarizing news video directly to entity-aware captions. We also release a large-scale dataset, VIEWS (VIdeo NEWS), to support research on this task. Further, we propose a method that augments visual information from videos with context retrieved from external world knowledge to generate entity-aware captions. We demonstrate the effectiveness of our approach on three video captioning models. We also show that our approach generalizes to existing news image captions dataset. With all the extensive experiments and insights, we believe we establish a solid basis for future research on this challenging task.
Dual-Teacher De-biasing Distillation Framework for Multi-domain Fake News Detection
Li, Jiayang, Feng, Xuan, Gu, Tianlong, Chang, Liang
Multi-domain fake news detection aims to identify whether various news from different domains is real or fake and has become urgent and important. However, existing methods are dedicated to improving the overall performance of fake news detection, ignoring the fact that unbalanced data leads to disparate treatment for different domains, i.e., the domain bias problem. To solve this problem, we propose the Dual-Teacher De-biasing Distillation framework (DTDBD) to mitigate bias across different domains. Following the knowledge distillation methods, DTDBD adopts a teacher-student structure, where pre-trained large teachers instruct a student model. In particular, the DTDBD consists of an unbiased teacher and a clean teacher that jointly guide the student model in mitigating domain bias and maintaining performance. For the unbiased teacher, we introduce an adversarial de-biasing distillation loss to instruct the student model in learning unbiased domain knowledge. For the clean teacher, we design domain knowledge distillation loss, which effectively incentivizes the student model to focus on representing domain features while maintaining performance. Moreover, we present a momentum-based dynamic adjustment algorithm to trade off the effects of two teachers. Extensive experiments on Chinese and English datasets show that the proposed method substantially outperforms the state-of-the-art baseline methods in terms of bias metrics while guaranteeing competitive performance.
Less is More: Learning Reference Knowledge Using No-Reference Image Quality Assessment
Li, Xudong, Zheng, Jingyuan, Zheng, Xiawu, Hu, Runze, Zhang, Enwei, Gao, Yuting, Shen, Yunhang, Li, Ke, Liu, Yutao, Dai, Pingyang, Zhang, Yan, Ji, Rongrong
Image Quality Assessment (IQA) with reference images have achieved great success by imitating the human vision system, in which the image quality is effectively assessed by comparing the query image with its pristine reference image. However, for the images in the wild, it is quite difficult to access accurate reference images. We argue that it is possible to learn reference knowledge under the No-Reference Image Quality Assessment (NR-IQA) setting, which is effective and efficient empirically. Concretely, by innovatively introducing a novel feature distillation method in IQA, we propose a new framework to learn comparative knowledge from non-aligned reference images. And then, to achieve fast convergence and avoid overfitting, we further propose an inductive bias regularization. Such a framework not only solves the congenital defects of NR-IQA but also improves the feature extraction framework, enabling it to express more abundant quality information. Surprisingly, our method utilizes less input while obtaining a more significant improvement compared to the teacher models. Extensive experiments on eight standard NR-IQA datasets demonstrate the superior performance to the state-of-the-art NR-IQA methods, i.e., achieving the PLCC values of 0.917 (vs. 0.884 in LIVEC) and 0.686 (vs. 0.661 in LIVEFB).
Explanatory Argument Extraction of Correct Answers in Resident Medical Exams
Goenaga, Iakes, Atutxa, Aitziber, Gojenola, Koldo, Oronoz, Maite, Agerri, Rodrigo
Developing the required technology to assist medical experts in their everyday activities is currently a hot topic in the Artificial Intelligence research field. Thus, a number of large language models (LLMs) and automated benchmarks have recently been proposed with the aim of facilitating information extraction in Evidence-Based Medicine (EBM) using natural language as a tool for mediating in human-AI interaction. The most representative benchmarks are limited to either multiple-choice or long-form answers and are available only in English. In order to address these shortcomings, in this paper we present a new dataset which, unlike previous work: (i) includes not only explanatory arguments for the correct answer, but also arguments to reason why the incorrect answers are not correct; (ii) the explanations are written originally by medical doctors to answer questions from the Spanish Residency Medical Exams. Furthermore, this new benchmark allows us to setup a novel extractive task which consists of identifying the explanation of the correct answer written by medical doctors. An additional benefit of our setting is that we can leverage the extractive QA paradigm to automatically evaluate performance of LLMs without resorting to costly manual evaluation by medical experts. Comprehensive experimentation with language models for Spanish shows that sometimes multilingual models fare better than monolingual ones, even outperforming models which have been adapted to the medical domain. Furthermore, results across the monolingual models are mixed, with supposedly smaller and inferior models performing competitively. In any case, the obtained results show that our novel dataset and approach can be an effective technique to help medical practitioners in identifying relevant evidence-based explanations for medical questions.
Summarization-based Data Augmentation for Document Classification
Wang, Yueguan, Yoshinaga, Naoki
Despite the prevalence of pretrained language models in natural language understanding tasks, understanding lengthy text such as document is still challenging due to the data sparseness problem. Inspired by that humans develop their ability of understanding lengthy text from reading shorter text, we propose a simple yet effective summarization-based data augmentation, SUMMaug, for document classification. We first obtain easy-to-learn examples for the target document classification task by summarizing the input of the original training examples, while optionally merging the original labels to conform to the summarized input. We then use the generated pseudo examples to perform curriculum learning. Experimental results on two datasets confirmed the advantage of our method compared to existing baseline methods in terms of robustness and accuracy. We release our code and data at https://github.com/etsurin/summaug.