Education
ROD: Reception-aware Online Distillation for Sparse Graphs
Zhang, Wentao, Jiang, Yuezihan, Li, Yang, Sheng, Zeang, Shen, Yu, Miao, Xupeng, Wang, Liang, Yang, Zhi, Cui, Bin
Graph neural networks (GNNs) have been widely used in many graph-based tasks such as node classification, link prediction, and node clustering. However, GNNs gain their performance benefits mainly from performing the feature propagation and smoothing across the edges of the graph, thus requiring sufficient connectivity and label information for effective propagation. Unfortunately, many real-world networks are sparse in terms of both edges and labels, leading to sub-optimal performance of GNNs. Recent interest in this sparse problem has focused on the self-training approach, which expands supervised signals with pseudo labels. Nevertheless, the self-training approach inherently cannot realize the full potential of refining the learning performance on sparse graphs due to the unsatisfactory quality and quantity of pseudo labels. In this paper, we propose ROD, a novel reception-aware online knowledge distillation approach for sparse graph learning. We design three supervision signals for ROD: multi-scale reception-aware graph knowledge, task-based supervision, and rich distilled knowledge, allowing online knowledge transfer in a peer-teaching manner. To extract knowledge concealed in the multi-scale reception fields, ROD explicitly requires individual student models to preserve different levels of locality information. For a given task, each student would predict based on its reception-scale knowledge, while simultaneously a strong teacher is established on-the-fly by combining multi-scale knowledge. Our approach has been extensively evaluated on 9 datasets and a variety of graph-based tasks, including node classification, link prediction, and node clustering. The result demonstrates that ROD achieves state-of-art performance and is more robust for the graph sparsity.
The Hitchhiker's Guide to Responsible Machine Learning
Yesterday Olga Tokarczuk (2018 Nobel Prize in Literature) said in an interview that when she thinks about literature, she no longer thinks about books!!! So, how should we effectively tell the most important story in predictive modelling i.e. We (MI2DataLab) are currently working on an exciting and interdisciplinary experiment combining a classic textbook with a comic book, combining a description of methods and software with a description of process, combining a description of a specific use-case about COVID-19 data analysis with universal best practices. These 52 page long teaching materials describe how to build a predictive model, compare the developed models, and use XAI to analyze them, plus a bonus -- how to deploy model with explanations in a similar form to https://crs19.pl/. The material is prepared as a starter for predictive modelling. The included code examples can be executed and experimented with on your own (the first version has examples in R, but there will be albo translation for Python).
10 Points to Make it Big in the Data Industry
Suppose you are someone who just got awed by the flashy terms of artificial intelligence, machine learning and data science and have decided to either get a degree in one of these fields or pivot your career and enter into the data industry. You get in on the hype, jump on the bandwagon, enroll in Andrew Ng's courses on Coursera, some more courses on Udacity, buy some detailed books and scour through them, start Kaggling, implement some projects and publish research papers. You start feeling good for what you have accomplished. But when you go and apply for a job or an internship, you don't get it and you wonder why. Well, the thing is all of what you did above is good for getting to know the basics and being exposed to what the industry has to offer.
AI Revolution in 2021: 5 Industries That Are Thriving With Artificial Intelligence
AI or Artificial Intelligence is a buzzword across the world these days. Several industries are prospering with AI implementation, and many others are gearing up to adopt this latest technology to start a journey of steady progress. Accurate executions and quick operations with automated labor-intensive procedures are helping the companies to get their work done at low cost and in less time. Companies are using Artificial Intelligence to better understand their consumers and gauge their behavior and preferences by analyzing the available data. This allows them to optimize their offerings and prices accordingly.
Natural Language Processing: NLP In Python with Projects
We have covered each and every topic in detail and also learned to apply them to real-world problems. There are lots and lots of exercises for you to practice and also 2 bonus NLP Projects "Sentiment analyzer" and "Drugs Prescription using Reviews". In this Sentiment analyzer project, you will learn how to Extract and Scrap Data from Social Media Websites and Extract out Beneficial Information from these Data for Driving Huge Business Insights. In this Drugs Prescription using Reviews project, you will learn how to Deal with Data having Textual Features, you will also learn NLP Techniques to transform and Process the Data to find out Important Insights. You will make use of all the topics read in this course. You will also have access to all the resources used in this course. Enroll now and become a master in machine learning.
Combining Online Learning and Offline Learning for Contextual Bandits with Deficient Support
Tran-The, Hung, Gupta, Sunil, Nguyen-Tang, Thanh, Rana, Santu, Venkatesh, Svetha
We address policy learning with logged data in contextual bandits. Current offline-policy learning algorithms are mostly based on inverse propensity score (IPS) weighting requiring the logging policy to have \emph{full support} i.e. a non-zero probability for any context/action of the evaluation policy. However, many real-world systems do not guarantee such logging policies, especially when the action space is large and many actions have poor or missing rewards. With such \emph{support deficiency}, the offline learning fails to find optimal policies. We propose a novel approach that uses a hybrid of offline learning with online exploration. The online exploration is used to explore unsupported actions in the logged data whilst offline learning is used to exploit supported actions from the logged data avoiding unnecessary explorations. Our approach determines an optimal policy with theoretical guarantees using the minimal number of online explorations. We demonstrate our algorithms' effectiveness empirically on a diverse collection of datasets.
Node embeddings for Beginners
The first time in University I heard about networks was in a course about Ecological Networks. This course made things crystal clear for me. I want to know more about them and I dream of a job in which I would work with networks. But I knew nothing about any possible machine learning on graphs. I decided to take responsibility and search the internet for free online courses and true treasures.
Decision Trees, Random Forests, AdaBoost & XGBoost in Python
In this section we will learn - What does Machine Learning mean. What are the meanings or different terms associated with machine learning? You will see some examples so that you understand what machine learning actually is. It also contains steps involved in building a machine learning model, not just linear models, any machine learning model.