Goto

Collaborating Authors

 Deep Learning


There Is No AI Without Data

Communications of the ACM

Artificial intelligence (AI) has evolved from hype to reality over the past few years. Algorithmic advances in machine learning and deep learning, significant increases in computing power and storage, and huge amounts of data generated by digital transformation efforts make AI a game-changer across all industries.8 AI has the potential to radically improve business processes with, for instance, real-time quality prediction in manufacturing, and to enable new business models, such as connected car services and self-optimizing machines. Traditional industries, such as manufacturing, machine building, and automotive, are facing a fundamental change: from the production of physical goods to the delivery of AI-enhanced processes and services as part of Industry 4.0.25 This paper focuses on AI for industrial enterprises with a special emphasis on machine learning and data mining. Despite the great potential of AI and the large investments in AI technologies undertaken by industrial enterprises, AI has not yet delivered on the promises in industry practice. The core business of industrial enterprises is not yet AI-enhanced. AI solutions instead constitute islands for isolated cases--such as the optimization of selected machines in the factory--with varying success. According to current industry surveys, data issues constitute the main reasons for the insufficient adoption of AI in industrial enterprises.27,35 In general, it is nothing new that data preparation and data quality are key for AI and data analytics, as there is no AI without data. This has been an issue since the early days of business intelligence (BI) and data warehousing.3 However, the manifold data challenges of AI in industrial enterprises go far beyond detecting and repairing dirty data. This article profoundly investigates these challenges and rests on our practical real-world experiences with the AI enablement of a large industrial enterprise--a globally active manufacturer.


The Practice of Speech and Language Processing in China

Communications of the ACM

Although great progress has been made in automatic speech recognition (ASR), significant performance degradation still exists in very noisy environments. Over the past few years, Chinese startup AISpeech has been developing very deep convolutional neural networks (VDCNN),21 a new architecture the company recently began applying to ASR use cases. Different than traditional deep CNN models for computer vision, VDCNN features novel filter designs, pooling operations, input feature map selection, and padding strategies, all of which lead to more accurate and robust ASR performance. Moreover, VDCNN is further extended with adaptation, which can significantly alleviate the mismatch between training and testing. Factor-aware training and cluster-adaptive training are explored to fully utilize the environmental variety and quickly adapt model parameters.


Knowledgeable Machine Learning for Natural Language Processing

Communications of the ACM

In the past decades, one line has run through the entire research spectrum of natural language processing (NLP)--knowledge. With various kinds of knowledge, such as linguistic knowledge, world knowledge, and commonsense knowledge, machines can understand complex semantics at different levels. In this article, we introduce a framework named "knowledgeable machine learning" to revisit existing efforts to incorporate knowledge in NLP, especially the recent breakthroughs in the Chinese NLP community. Since knowledge is closely related to human languages, the ability to capture and utilize knowledge is crucial to make machines understand languages. As shown in the accompanying figure, the symbolic knowledge formalized by human beings was widely used by NLP researchers before 1990, such as applying grammar rules for linguistic theories3 and building knowledge bases for expert systems.1


(*EPUB/PDF)->Download The Deep Learning AI Playbook: Strategy for Disruptive Artificial Intelligence BY Carlos E Perez Full Book

#artificialintelligence

Deep Learning Artificial Intelligence involves the interplay of Computer Science, Physics, Biology, Linguistics and Psychology. In addition to that, it is technology that can be extremely disruptive. The ramifications to society and even our own humanity will be profound. There are few subjects that are as captivating and as consequential as this. Surprisingly, there is very little that is written about this new technology in a more comprehensive and cohesive way.


AI Weekly: The intractable challenge of bias in AI

#artificialintelligence

Last week, Twitter shared research showing that the platform's algorithms amplify tweets from right-of-center politicians and news outlets at the expense of left-leaning sources. Rumman Chowdhury, the head of Twitter's machine learning, ethics, transparency, and accountability team, said in an interview with Protocol that while some of the behavior could be user-driven, the reason for the bias isn't entirely clear. "We can see that it is happening. We are not entirely sure why it is happening," Chowdhury said. "When algorithms get put out into the world, what happens when people interact with it -- we can't model for that. We can't model for how individuals or groups of people will use Twitter, what will happen in the world in a way that will impact how people use Twitter."


The Coming Convergence of NFTs and Artificial Intelligence

#artificialintelligence

In the near future, we should see the value of AI-generated NFTs to expand beyond generative art into more generic NFT utility categories providing a natural vehicle for leveraging the latest deep learning techniques. An example of this value proposition can be seen in digital artists like Refik Anadol who are already experimenting with cutting edge deep learning methods for the creation of NFTs. Anadol's studio have been a pioneer in using techniques such as GANs, and even dabbling into quantum computing, trained models in hundreds of millions images and audio clips to create astonishing visuals. NFTs have been one of the recent delivery mechanisms explored by Anadol.


The State of AI in 2021: Language models, healthcare, ethics, and AI agnosticism

#artificialintelligence

AI is expanding in two key areas of human activity and market investment -- health and language. Picking up the conversation from where we left off last week, we discussed AI applications and research in those areas with AI investors and authors of the State of AI 2021 report, Nathan Benaich and Ian Hogarth. After releasing what probably was the most comprehensive report on the State of AI in 2020, Air Street Capital and RAAIS founder Nathan Benaich and AI angel investor and UCL IIPP visiting professor Ian Hogarth are back for more. Last week, we discussed AI's underpinning: Machine learning in production, MLOps, and data-centric AI. This week we elaborate on specific areas of applications, investment, and growth.



CloudFindr: A Deep Learning Cloud Artifact Masker for Satellite DEM Data

arXiv.org Artificial Intelligence

Artifact removal is an integral component of cinematic scientific visualization, and is especially challenging with big datasets in which artifacts are difficult to define. In this paper, we describe a method for creating cloud artifact masks which can be used to remove artifacts from satellite imagery using a combination of traditional image processing together with deep learning based on U-Net. Compared to previous methods, our approach does not require multi-channel spectral imagery but performs successfully on single-channel Digital Elevation Models (DEMs). DEMs are a representation of the topography of the Earth and have a variety applications including planetary science, geology, flood modeling, and city planning.


Estimating Redundancy in Clinical Text

arXiv.org Artificial Intelligence

The current mode of use of Electronic Health Record (EHR) elicits text redundancy. Clinicians often populate new documents by duplicating existing notes, then updating accordingly. Data duplication can lead to a propagation of errors, inconsistencies and misreporting of care. Therefore, quantifying information redundancy can play an essential role in evaluating innovations that operate on clinical narratives. This work is a quantitative examination of information redundancy in EHR notes. We present and evaluate two strategies to measure redundancy: an information-theoretic approach and a lexicosyntactic and semantic model. We evaluate the measures by training large Transformer-based language models using clinical text from a large openly available US-based ICU dataset and a large multi-site UK based Trust. By comparing the information-theoretic content of the trained models with open-domain language models, the language models trained using clinical text have shown ~1.5x to ~3x less efficient than open-domain corpora. Manual evaluation shows a high correlation with lexicosyntactic and semantic redundancy, with averages ~43 to ~65%.