Goto

Collaborating Authors

 Education


Machine-learning code sorts through telescope data

#artificialintelligence

A new telescope will take a sequence of hi-res snapshots with the world's largest digital camera, covering the entire visible night sky every few days - and repeating the process for an entire decade. That presents a big data challenge: What's the best way to rapidly and automatically identify and categorize all of the stars, galaxies, and other objects captured in these images? To help solve this problem, the scientific collaboration that is working on this Large Synoptic Survey Telescope project launched a competition among data scientists to train computers on how to best perform this task. The Photometric LSST Astronomical Time-Series Classification Challenge (PLAsTiCC), hosted on the Kaggle.com Kyle Boone, a UC Berkeley graduate student who has been working on computer algorithms in support of the Nearby Supernova Factory experiment and Supernova Cosmology Project efforts at the Department of Energy's Lawrence Berkeley National Laboratory (Berkeley Lab), devoted some of his spare time to the international machine-learning challenge in late 2018 while also working toward his Ph.D. "As I worked on job applications I started playing around with this competition to teach myself more about machine learning."


Hiring For The AI (Artificial Intelligence) Revolution -- Part II

#artificialintelligence

No doubt, they are quite extensive -- and in high demand. "We've seen a tremendous rise in interest and enrollment in AI and machine learning, not just year over year but month over month as well. From 2017 to 2018, we saw over 30% growth in demand for courses on AI and machine learning. In 2018, we saw an even more significant rise with a 70% increase in demand for AI and machine learning courses. We anticipate interest to continue to grow month over month in 2019."


Active learning for binary classification with variable selection

arXiv.org Machine Learning

Modern computing and communication technologies can make data collection procedures very efficient. However, our ability to analyze large data sets and/or to extract information out from them is hard-pressed to keep up with our capacities for data collection. Among these huge data sets, some of them are not collected for any particular research purpose. For a classification problem, this means that the essential label information may not be readily obtainable, in the data set in hands, and an extra labeling procedure is required such that we can have enough label information to be used for constructing a classification model. When the size of a data set is huge, to label each subject in it will cost a lot in both capital and time. Thus, it is an important issue to decide which subjects should be labeled first in order to efficiently reduce the training cost/time. Active learning method is a promising outlet for this situation, because with the active learning ideas, we can select the unlabeled subjects sequentially without knowing their label information. In addition, there will be no confirmed information about the essential variables for constructing an efficient classification rule. Thus, how to merge a variable selection scheme with an active learning procedure is of interest. In this paper, we propose a procedure for building binary classification models when the complete label information is not available in the beginning of the training stage. We study an model-based active learning procedure with sequential variable selection schemes, and discuss the results of the proposed procedure from both theoretical and numerical aspects.


Inferring Heterogeneous Causal Effects in Presence of Spatial Confounding

arXiv.org Machine Learning

We address the problem of inferring the causal effect of an exposure on an outcome across space, using observational data. The data is possibly subject to unmeasured confounding variables which, in a standard approach, must be adjusted for by estimating a nuisance function. Here we develop a method that eliminates the nuisance function, while mitigating the resulting errors-in-variables. The result is a robust and accurate inference method for spatially varying heterogeneous causal effects. The properties of the method are demonstrated on synthetic as well as real data from Germany and the US.


DTN: A Learning Rate Scheme with Convergence Rate of $\mathcal{O}(1/t)$ for SGD

arXiv.org Machine Learning

We propose a novel diminishing learning rate scheme, coined Decreasing-Trend-Nature (DTN), which allows us to prove fast convergence of the Stochastic Gradient Descent (SGD) algorithm to a first-order stationary point for smooth general convex and some class of nonconvex including neural network applications for classification problems. We are the first to prove that SGD with diminishing learning rate achieves a convergence rate of $\mathcal{O}(1/t)$ for these problems. Our theory applies to neural network applications for classification problems in a straightforward way.


Create a Python Powered Chatbot in Under 60 Minutes

#artificialintelligence

Get your team access to Udemy's top 3,000 courses anytime, anywhere. This course is designed to be accessible to brand new Python programmers but also worthwhile for more experienced Pythonistas who want to get started with AI and Natural Language processing. You do not any previous experience with Python or programming to be successful in this course. You can use a Windows or Mac computer to complete the course (or Linux for that matter).


Taking a hard look in the mirror to examine bias โ€“ humanity vs. artificial intelligence (AI)

#artificialintelligence

I'm amazed at how rapidly the process of hiring employees and looking for work is changing. For generations, a big part of that process has been a person's connections. Who you know has been as important as what you know. Services such as LinkedIn were created in part to help us manage our connections and find out who might be able to help us get a foot in the door to pursue a desired position. However, this network effect has always held inherent bias.


Artificial Intelligence and the Future of Search Engines

#artificialintelligence

It was not long ago thatArtificial Intelligence (AI) was only in the realm of science fiction. Today, it has become a reality and is only growing more prominent in many different industries every day. This includes the internet as AI in search engine technology has been around for a few years. The algorithms used to rank pages have been affected considerably by AI already and that trend will continue into the foreseeable future. How Popular Search Engines Will Evolve in the AI Process Currently, Google's RankBrain, an AI process used help set search engine rankings, is having a major impact which is only expected to expand.


Reading List: Nine Smart Books on Artificial Intelligence Getting Smart

#artificialintelligence

The Deep Learning Revolution by Terry Sejnowski who directs the Computational Neurobiology Laboratory at The Salk Institute for Biological Studies. Sejnowski played an important role in the development of deep learning. His new book prepares us for a deep learning future.


Introducing Manifold โ€“ Towards Data Science

#artificialintelligence

Machine learning programs defer from traditional software applications in the sense that their structure is constantly changing and evolving as the model builds more knowledge. As a result, debugging and interpreting machine learning models is one of the most challenging aspects of real world artificial intelligence(AI) solutions. Debugging, interpretation and diagnosis are active areas of focus of organizations building machine learning solutions at scale. Recently, Uber unveiled Manifold, a framework that utilizes visual analysis techniques to support interpretation, debugging, and comparison of machine learning models. Manifold brings together some very advanced innovations in the areas of machine learning interpretability to address some of the fundamental challenges of visually debugging machine learning models.