Deep Learning
AI, machine learning and deep learning: What's the difference? - IBM IT Infrastructure Blog
It's not unusual today to see people talking about artificial intelligence (AI). When I was a kid in the 1980s, AI was depicted in Hollywood movies, but its real-world use was unimaginable given the state of technology at that time. While we don't have robots or androids that can think like a person or are likely to take over the world, AI is a reality now, and to understand what we mean when we talk about AI today we have to go through a -- quick, I promise -- introduction on some important terms. Simply put, AI is anything capable of mimicking human behavior. From the simplest application -- say, a talking doll or an automated telemarketing call -- to more robust algorithms like the deep neural networks in IBM Watson, they're all trying to mimic human behavior.
Fish Detection Using Deep Learning
Recently, human being's curiosity has been expanded from the land to the sky and the sea. Besides sending people to explore the ocean and outer space, robots are designed for some tasks dangerous for living creatures. Take the ocean exploration for an example. There are many projects or competitions on the design of Autonomous Underwater Vehicle (AUV) which attracted many interests. Authors of this article have learned the necessity of platform upgrade from a previous AUV design project, and would like to share the experience of one task extension in the area of fish detection. Because most of the embedded systems have been improved by fast growing computing and sensing technologies, which makes them possible to incorporate more and more complicated algorithms. In an AUV, after acquiring surrounding information from sensors, how to perceive and analyse corresponding information for better judgement is one of the challenges. The processing procedure can mimic human being's learning routines. An advanced system with more computing power can facilitate deep learning feature, which exploit many neural network algorithms to simulate human brains. In this paper, a convolutional neural network (CNN) based fish detection method was proposed.
Machine Learning Improves Satellite Rainfall Estimates - Eos
Spaceborne precipitation observing systems can provide global coverage but estimates typically suffer from uncertainties and biases. Conversely, ground based systems such as rain gauges and precipitation radar have higher accuracy but only limited spatial coverage. Chen et al. [2019] have developed a novel deep learning algorithm designed to construct a hybrid rainfall estimation system, where the ground radar is used to bridge the scale gaps between (accurate) rain gauge measurements and (less accurate) satellite observations. Such a non-parametric deep learning technique shows the potential for regional and global rainfall mapping and can also be expanded as a data fusion platform through incorporation of additional precipitation estimates such as outputs of numerical weather prediction models.
Machine Learning Improves Satellite Rainfall Estimates - Eos
Spaceborne precipitation observing systems can provide global coverage but estimates typically suffer from uncertainties and biases. Conversely, ground based systems such as rain gauges and precipitation radar have higher accuracy but only limited spatial coverage. Chen et al. [2019] have developed a novel deep learning algorithm designed to construct a hybrid rainfall estimation system, where the ground radar is used to bridge the scale gaps between (accurate) rain gauge measurements and (less accurate) satellite observations. Such a non-parametric deep learning technique shows the potential for regional and global rainfall mapping and can also be expanded as a data fusion platform through incorporation of additional precipitation estimates such as outputs of numerical weather prediction models.
The Force Awakens: Artificial Intelligence for Consumer Law
Lippi, Marco (University of Modena and Reggio Emilia) | Contissa, Giuseppe | Jablonowska, Agnieszka | Lagioia, Francesca | Micklitz, Hans-Wolfgang | Palka, Przemyslaw | Sartor, Giovanni | Torroni, Paolo
Recent years have been tainted by market practices that continuously expose us, as consumers, to new risks and threats. We have become accustomed, and sometimes even resigned, to businesses monitoring our activities, examining our data, and even meddling with our choices. Artificial Intelligence (AI) is often depicted as a weapon in the hands of businesses and blamed for allowing this to happen. In this paper, we envision a paradigm shift, where AI technologies are brought to the side of consumers and their organizations, with the aim of building an efficient and effective counter-power. AI-powered tools can support a massive-scale automated analysis of textual and audiovisual data, as well as code, for the benefit of consumers and their organizations. This in turn can lead to a better oversight of business activities, help consumers exercise their rights, and enable the civil society to mitigate information overload. We discuss the societal, political, and technological challenges that stand before that vision. This article is part of the special track on AI and Society.
PEL-BERT: A Joint Model for Protocol Entity Linking
Li, Shoubin, Cui, Wenzao, Liu, Yujiang, Ming, Xuran, Hu, Jun, YuanzheHu, null, Wang, Qing
Pre-trained models such as BERT are widely used in NLP tasks and are fine-tuned to improve the performance of various NLP tasks consistently. Nevertheless, the fine-tuned BERT model trained on our protocol corpus still has a weak performance on the Entity Linking (EL) task. In this paper, we propose a model that joints a fine-tuned language model with an RFC Domain Model. Firstly, we design a Protocol Knowledge Base as the guideline for protocol EL. Secondly, we propose a novel model, PEL-BERT, to link named entities in protocols to categories in Protocol Knowledge Base. Finally, we conduct a comprehensive study on the performance of pre-trained language models on descriptive texts and abstract concepts. Experimental results demonstrate that our model achieves state-of-the-art performance in EL on our annotated dataset, outperforming all the baselines.
A Kernel of Truth: Determining Rumor Veracity on Twitter by Diffusion Pattern Alone
Szanto, Aron, Rosenfeld, Nir, Parkes, David C.
Recent work in the domain of misinformation detection has leveraged rich signals in the text and user identities associated with content on social media. But text can be strategically manipulated and accounts reopened under different aliases, suggesting that these approaches are inherently brittle. In this work, we investigate an alternative modality that is naturally robust: the pattern in which information propagates. Can the veracity of an unverified rumor spreading online be discerned solely on the basis of its pattern of diffusion through the social network? Using graph kernels to extract complex topological information from Twitter cascade structures, we train accurate predictive models that are blind to language, user identities, and time, demonstrating for the first time that such "sanitized" diffusion patterns are highly informative of veracity. Our results indicate that, with proper aggregation, the collective sharing pattern of the crowd may reveal powerful signals of rumor truth or falsehood, even in the early stages of propagation.
Structural-Aware Sentence Similarity with Recursive Optimal Transport
Wang, Zihao, Zhang, Yong, Wu, Hao
Measuring sentence similarity is a classic topic in natural language processing. Light-weighted similarities are still of particular practical significance even when deep learning models have succeeded in many other tasks. Some light-weighted similarities with more theoretical insights have been demonstrated to be even stronger than supervised deep learning approaches. However, the successful light-weighted models such as Word Mover's Distance [Kusner et al., 2015] or Smooth Inverse Frequency [Arora et al., 2017] failed to detect the difference from the structure of sentences, i.e. order of words. To address this issue, we present Recursive Optimal Transport (ROT) framework to incorporate the structural information with the classic OT. Moreover, we further develop Recursive Optimal Similarity (ROTS) for sentences with the valuable semantic insights from the connections between cosine similarity of weighted average of word vectors and optimal transport. ROTS is structural-aware and with low time complexity compared to optimal transport. Our experiments over 20 sentence textural similarity (STS) datasets show the clear advantage of ROTS over all weakly supervised approaches. Detailed ablation study demonstrate the effectiveness of ROT and the semantic insights.
The Indian Chefs Process
Dallaire, Patrick, Ambrogioni, Luca, Trottier, Ludovic, Güçlü, Umut, Hinne, Max, Giguère, Philippe, Chaib-Draa, Brahim, van Gerven, Marcel, Laviolette, Francois
This paper introduces the Indian Chefs Process (ICP), a Bayesian nonparametric prior on the joint space of infinite directed acyclic graphs (DAGs) and orders that generalizes Indian Buffet Processes. As our construction shows, the proposed distribution relies on a latent Beta Process controlling both the orders and outgoing connection probabilities of the nodes, and yields a probability distribution on sparse infinite graphs. The main advantage of the ICP over previously proposed Bayesian nonparametric priors for DAG structures is its greater flexibility. To the best of our knowledge, the ICP is the first Bayesian nonparametric model supporting every possible DAG. We demonstrate the usefulness of the ICP on learning the structure of deep generative sigmoid networks as well as convolutional neural networks.