Education
Algorithmic Fairness in Education
Kizilcec, René F., Lee, Hansol
Data-driven predictive models are increasingly used in education to support students, instructors, and administrators. However, there are concerns about the fairness of the predictions and uses of these algorithmic systems. In this introduction to algorithmic fairness in education, we draw parallels to prior literature on educational access, bias, and discrimination, and we examine core components of algorithmic systems (measurement, model learning, and action) to identify sources of bias and discrimination in the process of developing and deploying these systems. Statistical, similarity-based, and causal notions of fairness are reviewed and contrasted in the way they apply in educational contexts. Recommendations for policy makers and developers of educational technology offer guidance for how to promote algorithmic fairness in education.
Online Semi-Supervised Learning in Contextual Bandits with Episodic Reward
We considered a novel practical problem of online learning with episodically revealed rewards, motivated by several real-world applications, where the contexts are nonstationary over different episodes and the reward feedbacks are not always available to the decision making agents. For this online semi-supervised learning setting, we introduced Background Episodic Reward LinUCB (BerlinUCB), a solution that easily incorporates clustering as a self-supervision module to provide useful side information when rewards are not observed. Our experiments on a variety of datasets, both in stationary and nonstationary environments of six different scenarios, demonstrated clear advantages of the proposed approach over the standard contextual bandit. Lastly, we introduced a relevant real-life example where this problem setting is especially useful.
Hybrid Stochastic-Deterministic Minibatch Proximal Gradient: Less-Than-Single-Pass Optimization with Nearly Optimal Generalization
Stochastic variance-reduced gradient (SVRG) algorithms have been shown to work favorably in solving large-scale learning problems. Despite the remarkable success, the stochastic gradient complexity of SVRG-type algorithms usually scales linearly with data size and thus could still be expensive for huge data. To address this deficiency, we propose a hybrid stochastic-deterministic minibatch proximal gradient (HSDMPG) algorithm for strongly-convex problems that enjoys provably improved data-size-independent complexity guarantees. More precisely, for quadratic loss $F(\theta)$ of $n$ components, we prove that HSDMPG can attain an $\epsilon$-optimization-error $\mathbb{E}[F(\theta)-F(\theta^*)]\leq\epsilon$ within $\mathcal{O}\Big(\frac{\kappa^{1.5}\epsilon^{0.75}\log^{1.5}(\frac{1}{\epsilon})+1}{\epsilon}\wedge\Big(\kappa \sqrt{n}\log^{1.5}\big(\frac{1}{\epsilon}\big)+n\log\big(\frac{1}{\epsilon}\big)\Big)\Big)$ stochastic gradient evaluations, where $\kappa$ is condition number. For generic strongly convex loss functions, we prove a nearly identical complexity bound though at the cost of slightly increased logarithmic factors. For large-scale learning problems, our complexity bounds are superior to those of the prior state-of-the-art SVRG algorithms with or without dependence on data size. Particularly, in the case of $\epsilon=\mathcal{O}\big(1/\sqrt{n}\big)$ which is at the order of intrinsic excess error bound of a learning model and thus sufficient for generalization, the stochastic gradient complexity bounds of HSDMPG for quadratic and generic loss functions are respectively $\mathcal{O} (n^{0.875}\log^{1.5}(n))$ and $\mathcal{O} (n^{0.875}\log^{2.25}(n))$, which to our best knowledge, for the first time achieve optimal generalization in less than a single pass over data. Extensive numerical results demonstrate the computational advantages of our algorithm over the prior ones.
Dimension Reduction in Contextual Online Learning via Nonparametric Variable Selection
Li, Wenhao, Chen, Ningyuan, Hong, L. Jeff
We consider a contextual online learning (multi-armed bandit) problem with high-dimensional covariate $\mathbf{x}$ and decision $\mathbf{y}$. The reward function to learn, $f(\mathbf{x},\mathbf{y})$, does not have a particular parametric form. The literature has shown that the optimal regret is $\tilde{O}(T^{(d_x+d_y+1)/(d_x+d_y+2)})$, where $d_x$ and $d_y$ are the dimensions of $\mathbf x$ and $\mathbf y$, and thus it suffers from the curse of dimensionality. In many applications, only a small subset of variables in the covariate affect the value of $f$, which is referred to as \textit{sparsity} in statistics. To take advantage of the sparsity structure of the covariate, we propose a variable selection algorithm called \textit{BV-LASSO}, which incorporates novel ideas such as binning and voting to apply LASSO to nonparametric settings. Our algorithm achieves the regret $\tilde{O}(T^{(d_x^*+d_y+1)/(d_x^*+d_y+2)})$, where $d_x^*$ is the effective covariate dimension. The regret matches the optimal regret when the covariate is $d^*_x$-dimensional and thus cannot be improved. Our algorithm may serve as a general recipe to achieve dimension reduction via variable selection in nonparametric settings.
Batch Value-function Approximation with Only Realizability
We make progress in a long-standing problem of batch reinforcement learning (RL): learning $Q^\star$ from an exploratory and polynomial-sized dataset, using a realizable and otherwise arbitrary function class. In fact, all existing algorithms demand function-approximation assumptions stronger than realizability, and the mounting negative evidence has led to a conjecture that sample-efficient learning is impossible in this setting (Chen and Jiang, 2019). Our algorithm, BVFT, breaks the hardness conjecture (albeit under a stronger notion of exploratory data) via a tournament procedure that reduces the learning problem to pairwise comparison, and solves the latter with the help of a state-action partition constructed from the compared functions. We also discuss how BVFT can be applied to model selection among other extensions and open problems.
Multi-source Data Mining for e-Learning
Daher, Julie Bu, Brun, Armelle, Boyer, Anne
Data mining is the task of discovering interesting, unexpected or valuable structures in large datasets and transforming them into an understandable structure for further use . Different approaches in the domain of data mining have been proposed, among which pattern mining is the most important one. Pattern mining mining involves extracting interesting frequent patterns from data. Pattern mining has grown to be a topic of high interest where it is used for different purposes, for example, recommendations. Some of the most common challenges in this domain include reducing the complexity of the process and avoiding the redundancy within the patterns. So far, pattern mining has mainly focused on the mining of a single data source. However, with the increase in the amount of data, in terms of volume, diversity of sources and nature of data, mining multi-source and heterogeneous data has become an emerging challenge in this domain. This challenge is the main focus of our work where we propose to mine multi-source data in order to extract interesting frequent patterns.
Testing and Monitoring Machine Learning Model Deployments
Learn how to test & monitor production machine learning models. You've taken your model from a Jupyter notebook and rewritten it in your production system. Are you sure there weren't any mistakes when you moved from the research environment to the production system? How can you control the risk before your deployment? ML-specific unit, integration and differential tests can help you to minimize the risk.
AI4ALL: Diversifying the Future of Artificial Intelligence
When Stanford undergrad Ananya Karthik was a high school freshman, she was curious about technology, but didn't know much about AI before she attended the 2016 Stanford AI4ALL summer program. Six months later, along with two AI4ALL classmates, she co-founded CreAIte, a neural art program targeting students from groups underrepresented in tech fields. Since then, CreAIte has introduced more than 500 girls around the country to coding basics, interdisciplinary technology, and peers who share their interests. Harvard computer science undergrad Catherine Yeo attended Stanford AI4ALL's inaugural program in 2015 as a high school sophomore. She went on to co-found PixelHacks, a hackathon that each year introduces hundreds of girls to tech and AI.
"It Feels Like There's No Winning": One Teacher on the Struggles of This School Year
Christopher Pinto is a high school math teacher at the Lamar Consolidated Independent School District outside of Houston. His school only decided to take on a hybrid model--both online and classroom education--less than a week before the fall semester started, even though it had gone fully remote in the spring. Thus, families got to choose between in-person learning and virtual, but teachers were expected to show up unless they had health issues. Pinto is immunocompromised--he has Type 1 diabetes--and applied to get a medical waiver so he could teach remotely, but he was denied. He still had some hope that the school's hybrid approach would suit him better, since remote learning was so isolating, but it's not normal at all.
Artificial Intelligence Challenge
The importance of digital transformation has accelerated manifold in the last few months as Covid-19 has brought to the fore the importance of digital technologies including artificial intelligence in addressing the healthcare crisis, restarting supply chains, enabling online education and almost every aspect of the economy. MeitY is organizing RAISE 2020 – Responsible AI for Social Empowerment 2020, a Global Summit on Artificial Intelligence to be held virtually from 5th Oct to 9th Oct 2020. Experts from Industry, Academia and Government from all across the world will be participating in this Global summit, which will bring together all stakeholders on Artificial Intelligence on one platform. AI has the power to solve many societal challenges and be an enabler for inclusion, there is a need to promote and identify such innovative solutions. In order to promote and showcase such innovative AI solutions developed by Indian startups, an AI Solution Challenge is being organized for Indian startups in the field of Artificial Intelligence.