Goto

Collaborating Authors

 Education


A Primal-dual Learning Algorithm for Personalized Dynamic Pricing with an Inventory Constraint

arXiv.org Machine Learning

A firm is selling a product to different types (based on the features such as education backgrounds, ages, etc.) of customers over a finite season with non-replenishable initial inventory. The type label of an arriving customer can be observed but the demand function associated with each type is initially unknown. The firm sets personalized prices dynamically for each type and attempts to maximize the revenue over the season. We provide a learning algorithm that is near-optimal when the demand and capacity scale in proportion. The algorithm utilizes the primal-dual formulation of the problem and learns the dual optimal solution explicitly. It allows the algorithm to overcome the curse of dimensionality (the rate of regret is independent of the number of types) and sheds light on novel algorithmic designs for learning problems with resource constraints.


Robust Estimation of Causal Effects via High-Dimensional Covariate Balancing Propensity Score

arXiv.org Machine Learning

In this paper, we propose a robust method to estimate the average treatment effects in observational studies when the number of potential confounders is possibly much greater than the sample size. We first use a class of penalized M-estimators for the propensity score and outcome models. We then calibrate the initial estimate of the propensity score by balancing a carefully selected subset of covariates that are predictive of the outcome. Finally, the estimated propensity score is used to construct the inverse probability weighting estimator. We prove that the proposed estimator, which has the sample boundedness property, is root-n consistent, asymptotically normal, and semiparametrically efficient when the propensity score model is correctly specified and the outcome model is linear in covariates. More importantly, we show that our estimator remains root-n consistent and asymptotically normal so long as either the propensity score model or the outcome model is correctly specified. We provide valid confidence intervals in both cases and further extend these results to the case where the outcome model is a generalized linear model. In simulation studies, we find that the proposed methodology often estimates the average treatment effect more accurately than the existing methods. We also present an empirical application, in which we estimate the average causal effect of college attendance on adulthood political participation. Open-source software is available for implementing the proposed methodology.


Kappa Learning: A New Method for Measuring Similarity Between Educational Items Using Performance Data

arXiv.org Artificial Intelligence

Sequencing items in adaptive learning systems typically relies on a large pool of interactive assessment items (questions) that are analyzed into a hierarchy of skills or Knowledge Components (KCs). Educational data mining techniques can be used to analyze students performance data in order to optimize the mapping of items to KCs. Standard methods that map items into KCs using item-similarity measures make the implicit assumption that students performance on items that depend on the same skill should be similar. This assumption holds if the latent trait (mastery of the underlying skill) is relatively fixed during students activity, as in the context of testing, which is the primary context in which these measures were developed and applied. However, in adaptive learning systems that aim for learning, and address subject matters such as K6 Math that consist of multiple sub-skills, this assumption does not hold. In this paper we propose a new item-similarity measure, termed Kappa Learning (KL), which aims to address this gap. KL identifies similarity between items under the assumption of learning, namely, that learners mastery of the underlying skills changes as they progress through the items. We evaluate Kappa Learning on data from a computerized tutor that teaches Fractions for 4th grade, with experts tagging as ground truth, and on simulated data. Our results show that clustering that is based on Kappa Learning outperforms clustering that is based on commonly used similarity measures (Cohen Kappa, Yule, and Pearson).


Intelligent Systems for Geosciences

Communications of the ACM

Many aspects of geosciences pose novel problems for intelligent systems research. Geoscience data is challenging because it tends to be uncertain, intermittent, sparse, multiresolution, and multi-scale. Geosciences processes and objects often have amorphous spatiotemporal boundaries. The lack of ground truth makes model evaluation, testing, and comparison difficult. Overcoming these challenges requires breakthroughs that would significantly transform intelligent systems, while greatly benefitting the geosciences in turn.


UCF's 30-Year REU Site in Computer Vision

Communications of the ACM

The U.S. Government's National Science Foundation (NSF) started the Research Experiences for Undergraduates (REU) program in the mid-1980s to attract undergraduates in STEM fields into research careers and to consider going to graduate school. The REU program offers grants to universities to plan and oversee research experiences that enrich undergraduate students' educational experiences. It is believed these experiences encourage the participants to pursue leadership careers in the fields of science, technology, engineering, or mathematics. The University of Central Florida's (UCF) Computer Vision group was in the selected first group of sites: only three REU sites in NSF's Division of Computer and Information Science and Engineering (CISE) were awarded funding in 1987. The grant duration was one year, so continued funding would require a new application for renewal the following year.


Wait for Gender Equality Gets Longer as Women's Share of Workforce, Politics Drops

#artificialintelligence

Stagnation in the proportion of women in the workplace and women's declining representation in politics, coupled with greater inequality in access to health and education, offset improvements in wage equality and the number of women in professional positions, leaving the global gender gap only slightly reduced in 2018. This is according to the Forum's Global Gender Gap Report 2018, published today. According to the report, the world has closed 68% of its gender gap, as measured across four key pillars: economic opportunity; political empowerment; educational attainment; and health and survival. While only a marginal improvement on 2017, the move is nonetheless welcome as 2017 was the first year since the report was first published in 2006 that the gap between men and women widened. At the current rate of change, the data suggest that it will take 108 years to close the overall gender gap and 202 years to bring about parity in the workplace.


Scalable Recollections for Continual Lifelong Learning

arXiv.org Artificial Intelligence

Given the recent success of Deep Learning applied to a variety of single tasks, it is natural to consider more human-realistic settings. Perhaps the most difficult of these settings is that of continual lifelong learning, where the model must learn online over a continuous stream of non-stationary data. A successful continual lifelong learning system must have three key capabilities: it must learn and adapt over time, it must not forget what it has learned, and it must be efficient in both training time and memory. Recent techniques have focused their efforts primarily on the first two capabilities while questions of efficiency remain largely unexplored. In this paper, we consider the problem of efficient and effective storage of experiences over very large time-frames. In particular we consider the case where typical experiences are O(n) bits and memories are limited to O(k) bits for k << n. We present a novel scalable architecture and training algorithm in this challenging domain and provide an extensive evaluation of its performance. Our results show that we can achieve considerable gains on top of state-of-the-art methods such as GEM.


Automatic Classifiers as Scientific Instruments: One Step Further Away from Ground-Truth

arXiv.org Machine Learning

Automatic detectors of facial expression, gesture, affect, etc., can serve as scientific instruments to measure many behavioral and social phenomena (e.g., emotion, empathy, stress, engagement, etc.), and this has great potential to advance basic science. However, when a detector $d$ is trained to approximate an existing measurement tool (e.g., observation protocol, questionnaire), then care must be taken when interpreting measurements collected using $d$ since they are one step further removed from the underlying construct. We examine how the accuracy of $d$, as quantified by the correlation $q$ of $d$'s outputs with the ground-truth construct $U$, impacts the estimated correlation between $U$ (e.g., stress) and some other phenomenon $V$ (e.g., academic performance). In particular: (1) We show that if the true correlation between $U$ and $V$ is $r$, then the expected sample correlation, over all vectors $\mathcal{T}^n$ whose correlation with $U$ is $q$, is $qr$. (2) We derive a formula to compute the probability that the sample correlation (over $n$ subjects) using $d$ is positive, given that the true correlation between $U$ and $V$ is negative (and vice-versa). We show that this probability is non-negligible (around $10-15\%$) for values of $n$ and $q$ that have been used in recent affective computing studies. (3) With the goal to reduce the variance of correlations estimated by an automatic detector, we show empirically that training multiple neural networks $d^{(1)},\ldots,d^{(m)}$ using different training configurations (e.g., architectures, hyperparameters) for the same detection task provides only limited `coverage' of $\mathcal{T}^n$.


Adam Induces Implicit Weight Sparsity in Rectifier Neural Networks

arXiv.org Machine Learning

In recent years, deep neural networks (DNNs) have been applied to various machine leaning tasks, including image recognition, speech recognition, and machine translation. However, large DNN models are needed to achieve state-of-the-art performance, exceeding the capabilities of edge devices. Model reduction is thus needed for practical use. In this paper, we point out that deep learning automatically induces group sparsity of weights, in which all weights connected to an output channel (node) are zero, when training DNNs under the following three conditions: (1) rectified-linear-unit (ReLU) activations, (2) an $L_2$-regularized objective function, and (3) the Adam optimizer. Next, we analyze this behavior both theoretically and experimentally, and propose a simple model reduction method: eliminate the zero weights after training the DNN. In experiments on MNIST and CIFAR-10 datasets, we demonstrate the sparsity with various training setups. Finally, we show that our method can efficiently reduce the model size and performs well relative to methods that use a sparsity-inducing regularizer.


British employers value social skills over academic qualifications

Daily Mail - Science & tech

Social skills and turning up to work on time are more important than your academic prowess, if a new study is to be believed. Experts looked at more than 21 million UK job adverts and found that less than one in five gave specific qualifications as a requirement for getting the position. Employers were more likely to give details of social qualifications, specific skills and cognitive abilities including organisational skills and time management. While the average student loan debt sits at nearly £35,000 ($28,000), the study revealed formal academic credentials play a relatively minor role in the job market. Social skills and turning up to work on time are more important than your academic prowess, if a new study is to be believed.