Goto

Collaborating Authors

 Overview


Seizure Detection and Prediction by Parallel Memristive Convolutional Neural Networks

arXiv.org Artificial Intelligence

During the past two decades, epileptic seizure detection and prediction algorithms have evolved rapidly. However, despite significant performance improvements, their hardware implementation using conventional technologies, such as Complementary Metal-Oxide-Semiconductor (CMOS), in power and area-constrained settings remains a challenging task; especially when many recording channels are used. In this paper, we propose a novel low-latency parallel Convolutional Neural Network (CNN) architecture that has between 2-2,800x fewer network parameters compared to SOTA CNN architectures and achieves 5-fold cross validation accuracy of 99.84% for epileptic seizure detection, and 99.01% and 97.54% for epileptic seizure prediction, when evaluated using the University of Bonn Electroencephalogram (EEG), CHB-MIT and SWEC-ETHZ seizure datasets, respectively. We subsequently implement our network onto analog crossbar arrays comprising Resistive Random-Access Memory (RRAM) devices, and provide a comprehensive benchmark by simulating, laying out, and determining hardware requirements of the CNN component of our system. To the best of our knowledge, we are the first to parallelize the execution of convolution layer kernels on separate analog crossbars to enable 2 orders of magnitude reduction in latency compared to SOTA hybrid Memristive-CMOS DL accelerators. Furthermore, we investigate the effects of non-idealities on our system and investigate Quantization Aware Training (QAT) to mitigate the performance degradation due to low ADC/DAC resolution. Finally, we propose a stuck weight offsetting methodology to mitigate performance degradation due to stuck RON/ROFF memristor weights, recovering up to 32% accuracy, without requiring retraining. The CNN component of our platform is estimated to consume approximately 2.791W of power while occupying an area of 31.255mm$^2$ in a 22nm FDSOI CMOS process.


Seminar: Statistical and Machine Learning Approaches to Solar Flare Forecasting

#artificialintelligence

Abstract: Solar flare prediction is an important task, which impacts national power grid robustness, satellite signal stability, and safety of astronauts' exploration of space. In recent years, the solar flare prediction problem has caught more attention among the machine learning and statistics community. In this talk, I will give an introduction on our efforts on solar flare forecasting with existing and innovative machine learning and statistical models. We obtain highly competitive results for flare forecasting with highly interpretable models, which contributes both to operational use and the science itself.


AI Hiring index Report 2022 - Free-Thesis

#artificialintelligence

The Global AI Index Report 2022 is a joint effort between Stanford University's Human-Centered AI Institute and the Center for International Governance Innovation (CIGI). It is the third edition of the report and aims to provide a comprehensive overview of AI development and adoption across the world. The report is based on data from over 130 experts and organizations across 50 countries. It covers a range of topics, including AI research, development, and deployment; AI applications; and the social and economic impact of AI. The report finds that AI is becoming more widespread and is having a profound impact on societies and economies.


Parliamentary Responses to Artificial Intelligence

#artificialintelligence

While Artificial intelligence (AI) has been developing for decades, recent years have seen increasing attention to its various societal impacts. These impacts range from positive and helpful to harmful and even life-threatening in some cases. Parliaments have responded to such developments by undertaking various programmes of work. What have they done, and what can Scotland learn from these approaches? This short review provides a snapshot of the work that various Parliaments around the world have undertaken on AI. It outlines the various approaches adopted by Parliaments and highlights common themes. In noting the key points for Scotland, it is designed to inform and guide the Scottish Parliament and others, as Scotland considers its own approach to the many opportunities and challenges AI presents. The report was written by Robbie Scarff on an internship supported by the Scottish Graduate School of Social Science. From this work, here are some key areas and questions for the Scottish Parliament to consider.


A Survey of Sound Source Localization with Deep Learning Methods

arXiv.org Artificial Intelligence

This article is a survey on deep learning methods for single and multiple sound source localization. We are particularly interested in sound source localization in indoor/domestic environment, where reverberation and diffuse noise are present. We provide an exhaustive topography of the neural-based localization literature in this context, organized according to several aspects: the neural network architecture, the type of input features, the output strategy (classification or regression), the types of data used for model training and evaluation, and the model training strategy. This way, an interested reader can easily comprehend the vast panorama of the deep learning-based sound source localization methods. Tables summarizing the literature survey are provided at the end of the paper for a quick search of methods with a given set of target characteristics.


Multimodal Learning with Transformers: A Survey

#artificialintelligence

Transformer is a promising neural network learner, and has achieved great success in various machine learning tasks. Thanks to the recent prevalence of multimodal applications and big data, Transformer-based multimodal learning has become a hot topic in AI research. This paper presents a comprehensive survey of Transformer techniques oriented at multimodal data. The main contents of this survey include: (1) a background of multimodal learning, Transformer ecosystem, and the multimodal big data era, (2) a theoretical review of Vanilla Transformer, Vision Transformer, and multimodal Transformers, from a geometrically topological perspective, (3) a review of multimodal Transformer applications, via two important paradigms, i.e., for multimodal pretraining and for specific multimodal tasks, (4) a summary of the common challenges and designs shared by the multimodal Transformer models and applications, and (5) a discussion of open problems and potential research directions for the community.


Deep Learning for Time Series Forecasting: Tutorial and Literature Survey

arXiv.org Machine Learning

Deep learning based forecasting methods have become the methods of choice in many applications of time series prediction or forecasting often outperforming other approaches. Consequently, over the last years, these methods are now ubiquitous in large-scale industrial forecasting applications and have consistently ranked among the best entries in forecasting competitions (e.g., M4 and M5). This practical success has further increased the academic interest to understand and improve deep forecasting methods. In this article we provide an introduction and overview of the field: We present important building blocks for deep forecasting in some depth; using these building blocks, we then survey the breadth of the recent deep forecasting literature.


Inductive Logic Programming At 30: A New Introduction

Journal of Artificial Intelligence Research

Inductive logic programming (ILP) is a form of machine learning. The goal of ILP is to induce a hypothesis (a set of logical rules) that generalises training examples. As ILP turns 30, we provide a new introduction to the field. We introduce the necessary logical notation and the main learning settings; describe the building blocks of an ILP system; compare several systems on several dimensions; describe four systems (Aleph, TILDE, ASPAL, and Metagol); highlight key application areas; and, finally, summarise current limitations and directions for future research.


Robophobia: Great New Law Review Article – Part 3

#artificialintelligence

That is part of the iterative process of active machine learning (steps four, five and six in my hybrid process).


What is Artificial Intelligence and Machine Learning

#artificialintelligence

One of the disruptive technologies that has gained increasingly more attention after the turn of the century is Machine Learning. Machine Leaning – closely related and usually considered as a subfield of Artificial Intelligence (AI) – is the process of automatic detection of usable patterns within data. The detection of these patterns is performed with the help of machine learning algorithms which are specifically tailored to deal with complex and large data sets. Such powerful algorithms have the potential of drastically revolutionizing the way of doing business and how businesses operate. With this article I will provide an overview of opportunities that machine learning algorithms and Artificial Intelligence (AI) pose to the business environment.