Goto

Collaborating Authors

 Instructional Material


Explainable, Domain-Adaptive, and Federated Artificial Intelligence in Medicine

arXiv.org Artificial Intelligence

Artificial intelligence (AI) continues to transform data analysis in many domains. Progress in each domain is driven by a growing body of annotated data, increased computational resources, and technological innovations. In medicine, the sensitivity of the data, the complexity of the tasks, the potentially high stakes, and a requirement of accountability give rise to a particular set of challenges. In this review, we focus on three key methodological approaches that address some of the particular challenges in AI-driven medical decision making. (1) Explainable AI aims to produce a human-interpretable justification for each output. Such models increase confidence if the results appear plausible and match the clinicians expectations. However, the absence of a plausible explanation does not imply an inaccurate model. Especially in highly non-linear, complex models that are tuned to maximize accuracy, such interpretable representations only reflect a small portion of the justification. (2) Domain adaptation and transfer learning enable AI models to be trained and applied across multiple domains. For example, a classification task based on images acquired on different acquisition hardware. (3) Federated learning enables learning large-scale models without exposing sensitive personal health information. Unlike centralized AI learning, where the centralized learning machine has access to the entire training data, the federated learning process iteratively updates models across multiple sites by exchanging only parameter updates, not personal health data. This narrative review covers the basic concepts, highlights relevant corner-stone and state-of-the-art research in the field, and discusses perspectives.


CL2R: Compatible Lifelong Learning Representations

arXiv.org Artificial Intelligence

In this paper, we propose a method to partially mimic natural intelligence for the problem of lifelong learning representations that are compatible. We take the perspective of a learning agent that is interested in recognizing object instances in an open dynamic universe in a way in which any update to its internal feature representation does not render the features in the gallery unusable for visual search. We refer to this learning problem as Compatible Lifelong Learning Representations (CL2R) as it considers compatible representation learning within the lifelong learning paradigm. We identify stationarity as the property that the feature representation is required to hold to achieve compatibility and propose a novel training procedure that encourages local and global stationarity on the learned representation. Due to stationarity, the statistical properties of the learned features do not change over time, making them interoperable with previously learned features. Extensive experiments on standard benchmark datasets show that our CL2R training procedure outperforms alternative baselines and state-of-the-art methods. We also provide novel metrics to specifically evaluate compatible representation learning under catastrophic forgetting in various sequential learning tasks. Code at https://github.com/NiccoBiondi/CompatibleLifelongRepresentation.


Graph Filters for Signal Processing and Machine Learning on Graphs

arXiv.org Artificial Intelligence

Filters are fundamental in extracting information from data. For time series and image data that reside on Euclidean domains, filters are the crux of many signal processing and machine learning techniques, including convolutional neural networks. Increasingly, modern data also reside on networks and other irregular domains whose structure is better captured by a graph. To process and learn from such data, graph filters account for the structure of the underlying data domain. In this article, we provide a comprehensive overview of graph filters, including the different filtering categories, design strategies for each type, and trade-offs between different types of graph filters. We discuss how to extend graph filters into filter banks and graph neural networks to enhance the representational power; that is, to model a broader variety of signal classes, data patterns, and relationships. We also showcase the fundamental role of graph filters in signal processing and machine learning applications. Our aim is that this article serves the dual purpose of providing a unifying framework for both beginner and experienced researchers, as well as a common understanding that promotes collaborations between signal processing, machine learning, and application domains.


Data for Machine Learning

#artificialintelligence

This course is all about data and how it is critical to the success of your applied machine learning model. Understand the critical elements of data in the learning, training and operation phases Understand biases and sources of data Implement techniques to improve the generality of your model Explain the consequences of overfitting and identify mitigation measures Implement appropriate test and validation measures. Demonstrate how the accuracy of your model can be improved with thoughtful feature engineering. Explore the impact of the algorithm parameters on model strength To be successful in this course, you should have at least beginner-level background in Python programming (e.g., be able to read and code trace existing code, be comfortable with conditionals, loops, variables, lists, dictionaries and arrays). You should have a basic understanding of linear algebra (vector notation) and statistics (probability distributions and mean/median/mode).


Time Series Analysis in Python - Data Analysis & Forecasting

#artificialintelligence

Welcome to the Python for Time Series - Data Analysis & Forecasting course. This course is built for students who wants to learn python applications for time series data sets. This course covers the usage of Python libraries on time series data. There will be both short lectures of statistics and Python fundamentals at the starting of the course in order to remembering the basics. Then the libraries of Python which is used for time series data will be covered.


5 Best Self-Driving Car Courses in 2023

#artificialintelligence

Are you looking for the Best Self-Driving Car Courses?โ€ฆ If yes, you should check these listed 5 Best Self-Driving Car Courses. A self-driving car is a vehicle that uses a combination of sensors, cameras, radar, and artificial intelligence (AI) to travel between destinations without a human operator. Now, without further ado, let's get started and find the Best Self-Driving Car Courses. This Udacity Self Driving Car Nanodegree Program is a good mixture of practical exercises & content to gain skills across a wide array of critical topics, including computer vision, sensor fusion, localization, motion control, and more.


Towards Multi-spatiotemporal-scale Generalized PDE Modeling

arXiv.org Artificial Intelligence

Partial differential equations (PDEs) are central to describing complex physical system simulations. Their expensive solution techniques have led to an increased interest in deep neural network based surrogates. However, the practical utility of training such surrogates is contingent on their ability to model complex multi-scale spatio-temporal phenomena. Various neural network architectures have been proposed to target such phenomena, most notably Fourier Neural Operators (FNOs), which give a natural handle over local & global spatial information via parameterization of different Fourier modes, and U-Nets which treat local and global information via downsampling and upsampling paths. However, generalizing across different equation parameters or time-scales still remains a challenge. In this work, we make a comprehensive comparison between various FNO, ResNet, and U-Net like approaches to fluid mechanics problems in both vorticity-stream and velocity function form. For U-Nets, we transfer recent architectural improvements from computer vision, most notably from object segmentation and generative modeling. We further analyze the design considerations for using FNO layers to improve performance of U-Net architectures without major degradation of computational cost. Finally, we show promising results on generalization to different PDE parameters and time-scales with a single surrogate model. Source code for our PyTorch benchmark framework is available at https://github.com/microsoft/pdearena.


Region Embedding with Intra and Inter-View Contrastive Learning

arXiv.org Artificial Intelligence

Unsupervised region representation learning aims to extract dense and effective features from unlabeled urban data. While some efforts have been made for solving this problem based on multiple views, existing methods are still insufficient in extracting representations in a view and/or incorporating representations from different views. Motivated by the success of contrastive learning for representation learning, we propose to leverage it for multi-view region representation learning and design a model called ReMVC (Region Embedding with Multi-View Contrastive Learning) by following two guidelines: i) comparing a region with others within each view for effective representation extraction and ii) comparing a region with itself across different views for cross-view information sharing. We design the intra-view contrastive learning module which helps to learn distinguished region embeddings and the inter-view contrastive learning module which serves as a soft co-regularizer to constrain the embedding parameters and transfer knowledge across multi-views. We exploit the learned region embeddings in two downstream tasks named land usage clustering and region popularity prediction. Extensive experiments demonstrate that our model achieves impressive improvements compared with seven state-of-the-art baseline methods, and the margins are over 30% in the land usage clustering task.


GitHub - dair-ai/ML-Course-Notes: ๐ŸŽ“ Sharing machine learning course / lecture notes.

#artificialintelligence

A place to collaborate and share lecture notes on all topics related to machine learning, NLP, and AI. If you encounter any problems with the notes? If you have any questions, open an issue or reach out to me on Twitter.


Coursera Deep Learning Specialization Review in 2022

#artificialintelligence

Coursera Deep Learning Specialization provides an introduction to DL methods for computer vision applications for practitioners who are familiar with the basics of DL. You will discover a breakdown and review of the convolutional neural networks course taught by Andrew Ng on deep learning specialization. It does not focus too much on math and does not include any code. After finishing the specialization you will know how to build models for photo classification, object detection, face recognition, and more. Instructors patiently explain the requisite math and programming concepts in a carefully planned order for learners who could be rusty in math/coding.