Goto

Collaborating Authors

 Education


How did I learn Data Science?

#artificialintelligence

I am a Mechanical engineer by education. And I started my career with a core job in the steel industry. But I didn't like it and so I left that. I made it my goal to move into the analytics and data science space somewhere around in 2013. From then on, it has taken me a lot of failures and a lot of efforts to shift.


Deep Learning, Fast.AI course lesson 8 of 14

#artificialintelligence

There are many options to do the course work, e.g., AWS, PaperSpace, etc., but I found Google Colaboratory is the best and easiest option. Here is the instruction for the Fast.ai Unlike other option, Colab guarantees to work because Google starts with a clean, new virtual machine (VM) every time, and in the first few steps in the notebooks, it loads the required correct version of Pytorch and Fast.ai.


How To Join The Applied AI Revolution

#artificialintelligence

Have you ever wondered whom to thank for some of the modern conveniences you might have started taking for granted, like Siri, Cortana or Alexa (assuming you agree these are conveniences)? The people at the Association for Computing Machinery (ACM) decided to thank Geoffrey Hinton, Yoshua Bengio and Yann LeCun in April of this year by honoring them with the Turing Award for their contributions to deep learning and neural networks. These contributions are put to use every time you log into your smartphone using fingerprint or facial recognition or when you use Google Photos or a voice assistant, and likely every time you use Amazon, Netflix, Facebook or Instagram. The advances in automatic language translation and autonomous cars in recent years arguably wouldn't have progressed as rapidly had it not been for the contributions of these three researchers. All of that is still an understatement of their contributions to artificial intelligence (AI).


Quickly learn a new language with AI-powered Lingvist ZDNet

#artificialintelligence

Census data that shows that 231 million Americans speak only English at home and do not know another language well enough to communicate in it. But how can you learn a new language without going back to school? Machine learning could be a solution to this problem, by cutting down on the 200 hours it takes to learn a language using traditional methods. Language company Lingvist intends to decrease this time by using machine learning software to adapt to your learning style. The algorithm certainly seems to work well -- and the way certain words are reinforced makes sure that they stick in your mind.


Google brings AI to studying with Socratic ZDNet

#artificialintelligence

Google this week started rolling out a revamped version of a mobile learning app, called Socratic, that the tech giant acquired last year. The updated app, with new machine learning-powered features, coincides with the start of the school year, as well as other Google for Education initiatives. Socratic aims to help both high school and university students in their studies outside of the classroom. If students need help answering a study question, they can now use the Socratic app to ask a question with their voice, or to take a picture of a question in their study materials. The app will then find relevant material from across the web.


Learning Fair Classifiers in Online Stochastic Settings

arXiv.org Machine Learning

In many real life situations, including job and loan applications, gatekeepers must make justified, real-time decisions about a person's fitness for a particular opportunity. People on both sides of such decisions have understandable concerns about their fairness, especially when they occur online or algorithmically. In this paper we consider the setting where we try to satisfy approximate fairness in an online decision making process where examples are sampled i.i.d from an underlying distribution. The fairness metric we consider is "equalized odds", which requires that approximately equalized false positive rates and false negative rates across groups. Our work follows from the classical learning from experts scheme and extends the multiplicative weights algorithm by maintaining an estimation for label distribution and keeping separate weights for label classes as well as groups. Our theoretical results show that approximate equalized odds can be achieved without sacrificing much regret from some distributions. We also demonstrate the algorithm on real data sets commonly used by the fairness community.


Robust and Efficient Fuzzy C-Means Clustering Constrained on Flexible Sparsity

arXiv.org Machine Learning

--Clustering is an effective technique in data mining to group a set of objects in terms of some attributes. Theoretical analyses and extensive experiments on several public datasets demonstrate the effectiveness and rationality of our proposed REFCMFS method. S a fundamental problem in machine learning, clustering is widely used for many fields, such as the network data (including Protein-Protein Interaction Networks [1], Road Networks [2], Geo-Social Network [3]), medical diagnosis [4], biological data analysis [5], environmental chemistry [6] and so on. K-Means clustering is one of the most popular techniques because of its simplicity and effectiveness, which randomly initializes the cluster centroids, assigns each sample to its nearest cluster and then updates cluster centroid itera-tively to cluster a dataset into some subsets. Over the past years, many modified versions of K-Means algorithms have been proposed, such as K-Means based Consensus clustering [7], Optimized Cartesian K-Means [8], Group K-Means [9] and so on. Jinglin Xu and Junwei Han were with the School of Automation, Northwestern Polytechnical University, Xi'an 710072, Shaanxi, China. Feiping Nie is with School of Computer Science and Center for OPTical IMagery Analysis and Learning (OPTIMAL), Northwestern Polytechnical University, Xi'an 710072, Shaanxi, China. Xuelong Li is with School of Computer Science and Center for OPTical IMagery Analysis and Learning (OPTIMAL), Northwestern Polytechnical University, Xi'an 710072, Shaanxi, China.


Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge Amalgamation

arXiv.org Artificial Intelligence

A massive number of well-trained deep networks have been released by developers online. These networks may focus on different tasks and in many cases are optimized for different datasets. In this paper, we study how to exploit such heterogeneous pre-trained networks, known as teachers, so as to train a customized student network that tackles a set of selective tasks defined by the user . W e assume no human annotations are available, and each teacher may be either single-or multi-task. T o this end, we introduce a dual-step strategy that first extracts the task-specific knowledge from the heterogeneous teachers sharing the same sub-task, and then amalgamates the extracted knowledge to build the student network. T o facilitate the training, we employ a selective learning scheme where, for each unlabelled sample, the student learns adaptively from only the teacher with the least prediction ambiguity. W e evaluate the proposed approach on several datasets and experimental results demonstrate that the student, learned by such adaptive knowledge amalgamation, achieves performances even better than those of the teachers.


Learning from failures in robot-assisted feeding: Using online learning to develop manipulation strategies for bite acquisition

arXiv.org Artificial Intelligence

Successful robot-assisted feeding requires bite acquisition of a wide variety of food items. Different food items may require different manipulation actions for successful bite acquisition. Therefore, a key challenge is to handle previously-unseen food items with very different action distributions. By leveraging contexts from previous bite acquisition attempts, a robot should be able to learn online how to acquire those previously-unseen food items. In this ongoing work, we construct a contextual bandit framework for this problem setting. We then propose variants of the $\epsilon$-greedy and LinUCB contextual bandit algorithms to minimize cumulative regret within that setting. In future, we expect empirical estimates of cumulative regret for each algorithm on robot bite acquisition trials as well as updated theoretical regret bounds that leverage the more structured context of this problem setting.


A survey on intrinsic motivation in reinforcement learning

arXiv.org Artificial Intelligence

Despite numerous research work in reinforcement learning (RL) and the recent successes obtained by combining it with deep learning, deep reinforcement learning (DRL) is still facing many challenges. Some of them, like the ability to abstract actions or the difficulty to explore the environment with sparse rewards, can be addressed by the use of intrinsic motivation. In this article, we provide a survey on the role of intrinsic motivation in DRL. We categorize the different kinds of intrinsic motivations and detail their interests and limitations. Our investigation shows that the combination of DRL and intrinsic motivation enables to learn more complicated and more generalisable behaviours than standard DRL. We provide an in-depth analysis describing learning modules through an unifying scheme composed of information theory, compression theory and reinforcement learning. We then explain how these modules could serve as building blocks over a complete developmental architecture, highlighting the numerous outlooks of the domain.