Overview
From Artificial Neural Networks to Deep Learning for Music Generation -- History, Concepts and Trends
The current tsunami of deep learning (the hyper-vitamined return of artificial neural networks) applies not only to traditional statistical machine learning tasks: prediction and classification (e.g., for weather prediction and pattern recognition), but has already conquered other areas, such as translation. A growing area of application is the generation of creative content: in particular the case of music, the topic of this paper. The motivation is in using the capacity of modern deep learning techniques to automatically learn musical styles from arbitrary musical corpora and then to generate musical samples from the estimated distribution, with some degree of control over the generation. This article provides a survey of music generation based on deep learning techniques. After a short introduction to the topic illustrated by a recent exemple, the article analyses some early works from the late 1980s using artificial neural networks for music generation and how their pioneering contributions foreshadowed current techniques. Then, we introduce some conceptual framework to analyze the various concepts and dimensions involved. Various examples of recent systems are introduced and analyzed to illustrate the variety of concerns and of techniques.
Natural language processing for word sense disambiguation and information extraction
This research work deals with Natural Language Processing (NLP) and extraction of essential information in an explicit form. The most common among the information management strategies is Document Retrieval (DR) and Information Filtering. DR systems may work as combine harvesters, which bring back useful material from the vast fields of raw material. With large amount of potentially useful information in hand, an Information Extraction (IE) system can then transform the raw material by refining and reducing it to a germ of original text. A Document Retrieval system collects the relevant documents carrying the required information, from the repository of texts. An IE system then transforms them into information that is more readily digested and analyzed. It isolates relevant text fragments, extracts relevant information from the fragments, and then arranges together the targeted information in a coherent framework. The thesis presents a new approach for Word Sense Disambiguation using thesaurus. The illustrative examples supports the effectiveness of this approach for speedy and effective disambiguation. A Document Retrieval method, based on Fuzzy Logic has been described and its application is illustrated. A question-answering system describes the operation of information extraction from the retrieved text documents. The process of information extraction for answering a query is considerably simplified by using a Structured Description Language (SDL) which is based on cardinals of queries in the form of who, what, when, where and why. The thesis concludes with the presentation of a novel strategy based on Dempster-Shafer theory of evidential reasoning, for document retrieval and information extraction. This strategy permits relaxation of many limitations, which are inherent in Bayesian probabilistic approach.
Deep Learning Based Text Classification: A Comprehensive Review
Minaee, Shervin, Kalchbrenner, Nal, Cambria, Erik, Nikzad, Narjes, Chenaghlu, Meysam, Gao, Jianfeng
Deep learning based models have surpassed classical machine learning based approaches in various text classification tasks, including sentiment analysis, news categorization, question answering, and natural language inference. In this work, we provide a detailed review of more than 150 deep learning based models for text classification developed in recent years, and discuss their technical contributions, similarities, and strengths. We also provide a summary of more than 40 popular datasets widely used for text classification. Finally, we provide a quantitative analysis of the performance of different deep learning models on popular benchmarks, and discuss future research directions.
Attribute2vec: Deep Network Embedding Through Multi-Filtering GCN
Wanyan, Tingyi, Zhang, Chenwei, Azad, Ariful, Liang, Xiaomin, Li, Daifeng, Ding, Ying
We present a multi-filtering Graph Convolution Neural Network (GCN) framework for network embedding task. It uses multiple local GCN filters to do feature extraction in every propagation layer. We show this approach could capture different important aspects of node features against the existing attribute embedding based method. We also show that with multi-filtering GCN approach, we can achieve significant improvement against baseline methods when training data is limited. We also perform many empirical experiments and demonstrate the benefit of using multiple filters against single filter as well as most current existing network embedding methods for both the link prediction and node classification tasks.
Automotive DevOps: Rules of the Road Ahead
The Indian automotive industry is on the edge of disruption due to increasing automation, new business models and digitization. This disruption is also through innovation and transformational change as industry players are adapting to shifting preferences on car ownership and new technological developments such as Autonomous Vehicles (AVs), IoT, cloud and proliferation electric and connected vehicles. Apart from electric and connected vehicles, the auto industry is also adopting technologies like cloud and IoT to improve the driving experience. From design and operation to servicing, cloud technology will be increasingly used at every stage to reduce costs and eliminate any scope for wastage. Cloud computing enables better vehicle engineering and thanks to advanced analytic capabilities, design teams can deliver exactly what customers want.
AI Stats News: 34% Of Employees Expect Their Jobs To Be Automated In 3 Years
Recent surveys, studies, forecasts and other quantitative assessments of the progress and impact of AI highlight the precarious nature of the future of work (long after the coronavirus pandemic ends), the continuing mixed attitudes of consumers about data privacy, and the possible resilience of this year's investments in AI. The IT department's need for AI talent has tripled between 2015 and 2019, but the number of AI jobs posted by IT is still less than half of that stemming from other business units; departments recruiting AI talent in high volumes include marketing, sales, customer service, finance, and research and development. By 2025, at least two of the top 10 global retailers will establish robot resource organizations to manage nonhuman workers; 77% of retailers plan to deploy AI by 2021, with the deployment of robotics for warehouse picking as the No. 1 use case [Gartner] By 2024, AI, virtual personal assistants, and chatbots will replace almost 69% of the manager's workload [Gartner] "Supervised machine learning doesn't live up to the hype. It isn't actual artificial intelligence akin to C-3PO, it's a sophisticated pattern-matching tool… Rather than seeing exponential improvements in the quality of AI performance (a la Moore's Law), we're instead seeing exponential increases in the cost to improve AI systems"--Stefan Seltz-Axmacher, founder, Starsky Robotics "…why are we holding our hands behind our back trying to build AI without mechanisms that infants have?"--Gary "We haven't really gone to great depth with deep learning yet. We've had a limited amount of training data so far. We've had limited structures with limited compute power. But the key point is that deep learning learns the concept, it learns the features. "…such capabilities [as "deepfake" transformation of the human face] were called image processing 15 years ago, but are routinely termed AI today.
RSNA COVID-19 Imaging Data Sharing Survey
The Radiological Society of North America (RSNA) has received numerous inquiries seeking access to COVID-19 related imaging data, both from radiology sites interested in sharing such data for use in research and education and from researchers. RSNA is committed to accelerating open source collaborative research on the uses of medical imaging in addressing the COVID-19 pandemic, including the use of new tools like artificial intelligence (AI). This form will enable institutions with COVID-19 data to express interest in participating in a planned open data repository for international COVID-19 imaging research and education efforts. Please complete this form if your institution has COVID-19 data that you may be willing and able to share for research purposes. Completing this brief survey does not represent a final commitment to collaborate with us or to share your data.
Statistical Queries and Statistical Algorithms: Foundations and Applications
Over 20 years ago, Kearns [1998] introduced statistical queries as a framework for designing machine learning algorithms that are tolerant to noise. The statistical query model restricts a learning algorithm to ask certain types of queries to an oracle that responds with approximately correct answers. This framework has has proven useful, not only for designing noise-tolerant algorithms, but also for its connections to other noise models, for its ability to capture many of our current techniques, and for its explanatory power about the hardness of many important problems. Researchers have also found many connections between statistical queries and a variety of modern topics, including to evolvability, differential privacy, and adaptive data analysis. Statistical queries are now both an important tool and remain a foundational topic with many important questions. The aim of this survey is to illustrate these connections and bring researchers to the forefront of our understanding of this important area.
Integrating Physics-Based Modeling with Machine Learning: A Survey
Willard, Jared, Jia, Xiaowei, Xu, Shaoming, Steinbach, Michael, Kumar, Vipin
In this manuscript, we provide a structured and comprehensive overview of techniques to integrate machine learning with physics-based modeling. First, we provide a summary of application areas for which these approaches have been applied. Then, we describe classes of methodologies used to construct physics-guided machine learning models and hybrid physics-machine learning frameworks from a machine learning standpoint. With this foundation, we then provide a systematic organization of these existing techniques and discuss ideas for future research.
Bias in Machine Learning What is it Good (and Bad) for?
Hellström, Thomas, Dignum, Virginia, Bensch, Suna
In public media as well as in scientific publications, the term \emph{bias} is used in conjunction with machine learning in many different contexts, and with many different meanings. This paper proposes a taxonomy of these different meanings, terminology, and definitions by surveying the, primarily scientific, literature on machine learning. In some cases, we suggest extensions and modifications to promote a clear terminology and completeness. The survey is followed by an analysis and discussion on how different types of biases are connected and depend on each other. We conclude that there is a complex relation between bias occurring in the machine learning pipeline that leads to a model, and the eventual bias of the model (which is typically related to social discrimination). The former bias may or may not influence the latter, in a sometimes bad, and sometime good way.