Media
Extract fundamental frequency based on CNN combined with PYIN
This paper refers to the extraction of multiple fundamental frequencies (multiple F0) based on PYIN, an algorithm for extracting the fundamental frequency (F0) of monophonic music, and a trained convolutional neural networks (CNN) model, where a pitch salience function of the input signal is produced to estimate the multiple F0. The implementation of these two algorithms and their corresponding advantages and disadvantages are discussed in this article. Analysing the different performance of these two methods, PYIN is applied to supplement the F0 extracted from the trained CNN model to combine the advantages of these two algorithms. For evaluation, four pieces played by two violins are used, and the performance of the models are evaluated accoring to the flatness of the F0 curve extracted. The result shows the combined model outperforms the original algorithms when extracting F0 from monophonic music and polyphonic music.
Towards Practical Single-shot Phase Retrieval with Physics-Driven Deep Neural Network
Ye, Qiuliang, Wang, Li-Wen, Lun, Daniel Pak-Kong
Phase retrieval (PR), a long-established challenge for recovering a complex-valued signal from its Fourier intensity-only measurements, has attracted considerable attention due to its widespread applications in digital imaging. Recently, deep learning-based approaches were developed that achieved some success in single-shot PR. These approaches require a single Fourier intensity measurement without the need to impose any additional constraints on the measured data. Nevertheless, vanilla deep neural networks (DNN) do not give good performance due to the substantial disparity between the input and output domains of the PR problems. Physics-informed approaches try to incorporate the Fourier intensity measurements into an iterative approach to increase the reconstruction accuracy. It, however, requires a lengthy computation process, and the accuracy still cannot be guaranteed. Besides, many of these approaches work on simulation data that ignore some common problems such as saturation and quantization errors in practical optical PR systems. In this paper, a novel physics-driven multi-scale DNN structure dubbed PPRNet is proposed. Similar to other deep learning-based PR methods, PPRNet requires only a single Fourier intensity measurement. It is physics-driven that the network is guided to follow the Fourier intensity measurement at different scales to enhance the reconstruction accuracy. PPRNet has a feedforward structure and can be end-to-end trained. Thus, it is much faster and more accurate than the traditional physics-driven PR approaches. Extensive simulations and experiments on a practical optical platform were conducted. The results demonstrate the superiority and practicality of the proposed PPRNet over the traditional learning-based PR methods.
AHEAD: A Triple Attention Based Heterogeneous Graph Anomaly Detection Approach
Yang, Shujie, Zhang, Binchi, Feng, Shangbin, Tan, Zhaoxuan, Zheng, Qinghua, Zhou, Jun, Luo, Minnan
Graph anomaly detection on attributed networks has become a prevalent research topic due to its broad applications in many influential domains. In real-world scenarios, nodes and edges in attributed networks usually display distinct heterogeneity, i.e. attributes of different types of nodes show great variety, different types of relations represent diverse meanings. Anomalies usually perform differently from the majority in various perspectives of heterogeneity in these networks. However, existing graph anomaly detection approaches do not leverage heterogeneity in attributed networks, which is highly related to anomaly detection. In light of this problem, we propose AHEAD: a heterogeneity-aware unsupervised graph anomaly detection approach based on the encoder-decoder framework. Specifically, for the encoder, we design three levels of attention, i.e. attribute level, node type level, and edge level attentions to capture the heterogeneity of network structure, node properties and information of a single node, respectively. In the decoder, we exploit structure, attribute, and node type reconstruction terms to obtain an anomaly score for each node. Extensive experiments show the superiority of AHEAD on several real-world heterogeneous information networks compared with the state-of-arts in the unsupervised setting. Further experiments verify the effectiveness and robustness of our triple attention, model backbone, and decoder in general.
The Moral Foundations Reddit Corpus
Trager, Jackson, Ziabari, Alireza S., Davani, Aida Mostafazadeh, Golazizian, Preni, Karimi-Malekabadi, Farzan, Omrani, Ali, Li, Zhihe, Kennedy, Brendan, Reimer, Nils Karl, Reyes, Melissa, Cheng, Kelsey, Wei, Mellow, Merrifield, Christina, Khosravi, Arta, Alvarez, Evans, Dehghani, Morteza
Moral framing and sentiment can affect a variety of online and offline behaviors, including donation, pro-environmental action, political engagement, and even participation in violent protests. Various computational methods in Natural Language Processing (NLP) have been used to detect moral sentiment from textual data, but in order to achieve better performances in such subjective tasks, large sets of hand-annotated training data are needed. Previous corpora annotated for moral sentiment have proven valuable, and have generated new insights both within NLP and across the social sciences, but have been limited to Twitter. To facilitate improving our understanding of the role of moral rhetoric, we present the Moral Foundations Reddit Corpus, a collection of 16,123 Reddit comments that have been curated from 12 distinct subreddits, hand-annotated by at least three trained annotators for 8 categories of moral sentiment (i.e., Care, Proportionality, Equality, Purity, Authority, Loyalty, Thin Morality, Implicit/Explicit Morality) based on the updated Moral Foundations Theory (MFT) framework. We use a range of methodologies to provide baseline moral-sentiment classification results for this new corpus, e.g., cross-domain classification and knowledge transfer.
How Snipd is using AI to 'unlock knowledge' in podcasts – TechCrunch
Podcasting has emerged as a major billion-dollar industry, with ad revenue in the U.S. alone expected to hit $2 billion this year -- a figure that's set to double by 2024. Against that backdrop, major players in the field are bolstering their podcasting armory, with Spotify recently doling out around $85 million for two companies specializing in podcast measurement and analytics, while Acast recently snapped up Podchaser -- an "IMDb for podcasts" that gives advertiser deeper data insights -- in a $27 million deal. But as the big platforms lock horns in the hunt for podcasting riches, smaller players continue to arrive on the scene with their own ideas on how they can advance the podcast medium for creators and consumers alike. One of these is Snipd, a Swiss startup building a podcast app that uses AI to transcribe content and synchronize with note-taking apps; automatically generate book-style "chapters"; and, as of this week, deliver podcast highlights in a TikTok-style personalized feed. Similar to other so-called "podcatcher" apps, Snipd works by users searching and subscribing to podcasts that are of interest to them -- this could be anything from true crime to history and sport.