Africa
Can graph neural networks count substructures?
Chen, Zhengdao, Chen, Lei, Villar, Soledad, Bruna, Joan
The ability to detect and count certain substructures in graphs is important for solving many tasks on graph-structured data, especially in the contexts of computational chemistry and biology as well as social network analysis. Inspired by this, we propose to study the expressive power of graph neural networks (GNNs) via their ability to count attributed graph substructures, extending recent works that examine their power in graph isomorphism testing and function approximation. We distinguish between two types of substructure counting: matching-count and containment-count, and establish both positive and negative answers for popular GNN architectures. Specifically, we prove that Message Passing Neural Networks (MPNNs), 2-Weisfeiler-Lehman (2-WL) and 2-Invariant Graph Networks (2-IGNs) cannot perform matching-count of substructures consisting of 3 or more nodes, while they can perform containment-count of star-shaped substructures. We also prove positive results for k-WL and k-IGNs as well as negative results for k-WL with limited number of iterations. We then conduct experiments that support the theoretical results for MPNNs and 2-IGNs, and demonstrate that local relational pooling strategies inspired by Murphy et al. (2019) are more effective for substructure counting. In addition, as an intermediary step, we prove that 2-WL and 2-IGNs are equivalent in distinguishing non-isomorphic graphs, partly answering an open problem raised in Maron et al. (2019).
CAAI -- A Cognitive Architecture to Introduce Artificial Intelligence in Cyber-Physical Production Systems
Fischbach, Andreas, Strohschein, Jan, Bunte, Andreas, Stork, Jörg, Faeskorn-Woyke, Heide, Moriz, Natalia, Bartz-Beielstein, Thomas
This paper introduces CAAI, a novel cognitive architecture for artificial intelligence in cyber-physical production systems. The goal of the architecture is to reduce the implementation effort for the usage of artificial intelligence algorithms. The core of the CAAI is a cognitive module that processes declarative goals of the user, selects suitable models and algorithms, and creates a configuration for the execution of a processing pipeline on a big data platform. Constant observation and evaluation against performance criteria assess the performance of pipelines for many and varying use cases. Based on these evaluations, the pipelines are automatically adapted if necessary. The modular design with well-defined interfaces enables the reusability and extensibility of pipeline components. A big data platform implements this modular design supported by technologies such as Docker, Kubernetes, and Kafka for virtualization and orchestration of the individual components and their communication. The implementation of the architecture is evaluated using a real-world use case.
Societies in the automation era – Idees
Artificial Intelligence is a technology used to plan for the future. Planification implies intelligibility, calculability, and systematization. The future as a concept has been, in occidental cultures, closely tied to monotheism and the development of a linear narrative about societies, with a predicted end of the world, where individuals end up either in paradise or hell. This was a radical change from the narratives of classic cultures, where there was no notion of the past or prehistory, but rather a narrative of a cultural, god-given origin similar to the present. It did not anticipate change in the manner of future narratives. Future narratives see the time to come as a time when evolution happens, when neither clothes nor context nor social habits remain the same. With the development of Protestantism and capitalism, the future became more than a point in time when the story would end. It became an unwritten point of opportunity to be shaped by human beings.
Artificial Intelligence Algorithm Used to Predict Agriculture Yield
It is predicted that the precision agriculture market will reach $12.9 billion by 2027. With this increase, there is a need for sophisticated data-analysis solutions that are capable of guiding management decisions in real-time. A new methodology has been developed by an interdisciplinary group at the University of Illinois, and it aims to efficiently and accurately process precision agricultural data. Nicolas Martin is an assistant professor in the Department of Crop Sciences at Illinois and co-author of the study. "We're trying to change how people run agronomic research. Instead of establishing a small field plot, running statistics, and publishing the means, what we're trying to do involves the farmer far more directly. We are running experiments with farmers' machinery in their own fields. We can detect site-specific responses to different inputs. And we can see whether there's a response in different parts of the field," he says.
The Curious Case of Data Annotation and AI - RTInsights
And for in-house teams, labeling data can be the proverbial bottleneck, limiting a company's ability to quickly train and validate machine learning models. By its very definition, artificial intelligence refers to computer systems that can learn, reason, and act for themselves, but where does this intelligence come from? For decades, the collaborative intelligence of humans and machines has produced some of the world's leading technologies. And while there's nothing glamorous about the data being used to train today's AI applications, the role of data annotation in AI is nonetheless fascinating. Imagine reviewing hours of video footage – sorting through thousands of driving scenes, to label all of the vehicles that come into frame, and you've got data annotation.
Block Hankel Tensor ARIMA for Multiple Short Time Series Forecasting
Shi, Qiquan, Yin, Jiaming, Cai, Jiajun, Cichocki, Andrzej, Yokota, Tatsuya, Chen, Lei, Yuan, Mingxuan, Zeng, Jia
This work proposes a novel approach for multiple time series forecasting. At first, multi-way delay embedding transform (MDT) is employed to represent time series as low-rank block Hankel tensors (BHT). Then, the higher-order tensors are projected to compressed core tensors by applying Tucker decomposition. At the same time, the generalized tensor Autoregressive Integrated Moving Average (ARIMA) is explicitly used on consecutive core tensors to predict future samples. In this manner, the proposed approach tactically incorporates the unique advantages of MDT tensorization (to exploit mutual correlations) and tensor ARIMA coupled with low-rank Tucker decomposition into a unified framework. This framework exploits the low-rank structure of block Hankel tensors in the embedded space and captures the intrinsic correlations among multiple TS, which thus can improve the forecasting results, especially for multiple short time series. Experiments conducted on three public datasets and two industrial datasets verify that the proposed BHT-ARIMA effectively improves forecasting accuracy and reduces computational cost compared with the state-of-the-art methods.
An Optimal Statistical and Computational Framework for Generalized Tensor Estimation
Han, Rungang, Willett, Rebecca, Zhang, Anru
This paper describes a flexible framework for generalized low-rank tensor estimation problems that includes many important instances arising from applications in computational imaging, genomics, and network analysis. The proposed estimator consists of finding a low-rank tensor fit to the data under generalized parametric models. To overcome the difficulty of non-convexity in these problems, we introduce a unified approach of projected gradient descent that adapts to the underlying low-rank structure. Under mild conditions on the loss function, we establish both an upper bound on statistical error and the linear rate of computational convergence through a general deterministic analysis. Then we further consider a suite of generalized tensor estimation problems, including sub-Gaussian tensor denoising, tensor regression, and Poisson and binomial tensor PCA. We prove that the proposed algorithm achieves the minimax optimal rate of convergence in estimation error. Finally, we demonstrate the superiority of the proposed framework via extensive experiments on both simulated and real data.
Deep Learning and Statistical Models for Time-Critical Pedestrian Behaviour Prediction
Dabrowski, Joel Janek, de Villiers, Johan Pieter, Rahman, Ashfaqur, Beyers, Conrad
The time it takes for a classifier to make an accurate prediction can be crucial in many behaviour recognition problems. For example, an autonomous vehicle should detect hazardous pedestrian behaviour early enough for it to take appropriate measures. In this context, we compare the switching linear dynamical system (SLDS) and a three-layered bi-directional long short-term memory (LSTM) neural network, which are applied to infer pedestrian behaviour from motion tracks. We show that, though the neural network model achieves an accuracy of 80%, it requires long sequences to achieve this (100 samples or more). The SLDS, has a lower accuracy of 74%, but it achieves this result with short sequences (10 samples). To our knowledge, such a comparison on sequence length has not been considered in the literature before. The results provide a key intuition of the suitability of the models in time-critical problems.
African AI Experts Get Excluded From a Conference--Again
At the G7 meeting in Montreal last year, Justin Trudeau told WIRED he would look into why more than 100 African artificial intelligence researchers had been barred from visiting that city to attend their field's most important annual event, the Neural Information Processing Systems conference, or NeurIPS. Now the same thing has happened again. More than a dozen AI researchers from African countries have been refused visas to attend this year's NeurIPS, to be held next month in Vancouver. This means an event that shapes the course of a technology with huge economic and social importance will have little input from a major portion of the world. The conference brings together thousands of researchers from top academic institutions and companies, for hundreds of talks, workshops, and side meetings at which new ideas and theories are hashed out. Tejumade Afonja, a master's student from Nigeria who is studying at Saarland University in Germany, posted her rejection letter to Twitter.
The Matrix Conspiracy updates (The Matrix Dictionary)
With my concept of The Matrix Conspiracy I put myself in the risk of being accused of being a paranoid conspiracy theorist. This is not the case. I m just making aware of that there exists a conspiracy theory which is called The Matrix Conspiracy, and that this conspiracy in fact is a global spreading ideology. My critique is in that way ideology critique, or cultural critique. The concept of the Matrix comes from mathematics, but is more popular known from the movie the Matrix, which asks the question whether we might live in a computer simulation. In The Matrix though, there is also an evil demon, or evil demons, namely the machines which keep the humans in tanks linked to black cable wires that stimulates the virtual reality of the Matrix. Doing this the machines can use the human bodies as batteries that supply the machines with energy. It is the fascination of the virtual reality that deceives the humans. The philosophy behind the movie comes from especially two philosophers: Rene Descartes and George Berkeley. Descartes was very dubious concerning how much we can trust our senses. Therefore he took up the question Is life a dream? However, his intention with this was in his Meditations to develop a confident cognition-argument. In his Meditations Descartes presents the problem approximately like this: I frequently dream during the night, and while I dream, I am convinced, that what I dream is real. But then it always happens, that I wake up and realize, that everything I dreamt was not real, but only an illusion. And then is it I think: is it possible, that what I now, while I am awake, believe is real, also is something, which only is being dreamt by me right now? If it is not the case, how shall I then determinate it? Precisely because Descartes not even in dreams can doubt, that 2 plus 3 is 5, he leaves the dream-argument in his Meditations and goes in tackle with the question, whether he could be cheated by an evil demon concerning all cognition, also the mathematics. This radical skepticism leads him forward to the cogito-argument: Cogito ergo Sum (I think, therefore I exist). But he didn t deny the existence of the external world. The external world he described in a way that resembles what would later be known as modern natural sciences. In the view of nature in natural science, nature is reduced to atomic particles, empty space, fields, electromagnetic waves and particles etc., etc. I have called this the instrumental view of nature. Berkeley is famous for the sentence Esse est percipi, which means that being, or reality, consists in being percepted (to be is to be experienced). The absurdity in Berkeley s assertion is swiftly seen: If a thing, or a human being for that matter, is not being perceived by the senses, then it does not exist. In accordance with Berkeley there therefore does not exist any sense-independent world. He ends in solipsism, the consequence that only I, and my perceptions, can be said to exist.