Goto

Collaborating Authors

 man woman


@Radiology_AI

#artificialintelligence

"Just Accepted" papers have undergone full peer review and have been accepted for publication in Radiology: Artificial Intelligence. This article will undergo copyediting, layout, and proof review before it is published in its final version. Please note that during production of the final copyedited article, errors may be discovered which could affect the content. To develop a model to estimate lung cancer risk using lung cancer screening CT and clinical data elements (CDE) without manual reading efforts. Two screening cohorts were retrospectively studied: the National Lung Screening Trial (NLST; 2002–2004) and an in-house Lung Screening Program (iLSP, 2015–2018).


Visual Scene Graphs for Audio Source Separation

arXiv.org Artificial Intelligence

State-of-the-art approaches for visually-guided audio source separation typically assume sources that have characteristic sounds, such as musical instruments. These approaches often ignore the visual context of these sound sources or avoid modeling object interactions that may be useful to better characterize the sources, especially when the same object class may produce varied sounds from distinct interactions. To address this challenging problem, we propose Audio Visual Scene Graph Segmenter (AVSGS), a novel deep learning model that embeds the visual structure of the scene as a graph and segments this graph into subgraphs, each subgraph being associated with a unique sound obtained by co-segmenting the audio spectrogram. At its core, AVSGS uses a recursive neural network that emits mutually-orthogonal sub-graph embeddings of the visual graph using multi-head attention. These embeddings are used for conditioning an audio encoder-decoder towards source separation. Our pipeline is trained end-to-end via a self-supervised task consisting of separating audio sources using the visual graph from artificially mixed sounds. In this paper, we also introduce an "in the wild'' video dataset for sound source separation that contains multiple non-musical sources, which we call Audio Separation in the Wild (ASIW). This dataset is adapted from the AudioCaps dataset, and provides a challenging, natural, and daily-life setting for source separation. Thorough experiments on the proposed ASIW and the standard MUSIC datasets demonstrate state-of-the-art sound separation performance of our method against recent prior approaches.



The Amazing Power of Word Vectors

#artificialintelligence

For today's post, I've drawn material not just from one paper, but from five! The subject matter is'word2vec' – the work of Mikolov et al. at Google on efficient vector representations of words (and what you can do with them). From the first of these papers ('Efficient estimation…') we get a description of theContinuous Bag-of-Words and Continuous Skip-gram models for learning word vectors (we'll talk about what a word vector is in a moment…). From the second paper we get more illustrations of the power of word vectors, some additional information on optimisations for the skip-gram model (hierarchical softmax and negative sampling), and a discussion of applying word vectors to phrases. The third paper ('Linguistic Regularities…') describes vector-oriented reasoning based on word vectors and introduces the famous "King – Man Woman Queen" example.