Goto

Collaborating Authors

 parametric constraint


Review for NeurIPS paper: A Class of Algorithms for General Instrumental Variable Models

Neural Information Processing Systems

The work provides a method based on modern machine learning for bounding causal effects under the instrumental variable graph and when both treatment and outcome variables are continuous. Overall, reviewers were positive about the paper, and I share the general assessment, this is a very nice and strong piece of work. Having said that, I will list some serious issues I found when reading the paper (the not so good part), which I expect the authors will take into account and reflect in the camera-ready version of the paper First, the paper's contribution is overstated, which is not needed due to the high quality of the work (!). For instance, the author says (line 35-36): "In this work, we develop algorithms to compute these bounds on causal effects over all IV models compatible with the data in a general continuous setting. "This is misleading since the work doesn't consider the most general setting.


Parametric Constraints for Bayesian Knowledge Tracing from First Principles

arXiv.org Artificial Intelligence

Bayesian Knowledge Tracing (BKT) is a probabilistic model of a learner's state of mastery corresponding to a knowledge component. It considers the learner's state of mastery as a "hidden" or latent binary variable and updates this state based on the observed correctness of the learner's response using parameters that represent transition probabilities between states. BKT is often represented as a Hidden Markov Model and the Expectation-Maximization (EM) algorithm is used to infer these parameters. However, this algorithm can suffer from several issues including producing multiple viable sets of parameters, settling into a local minima, producing degenerate parameter values, and a high computational cost during fitting. This paper takes a "from first principles" approach to deriving constraints that can be imposed on the BKT parameter space. Starting from the basic mathematical truths of probability and building up to the behaviors expected of the BKT parameters in real systems, this paper presents a mathematical derivation that results in succinct constraints that can be imposed on the BKT parameter space. Since these constraints are necessary conditions, they can be applied prior to fitting in order to reduce computational cost and the likelihood of issues that can emerge from the EM procedure. In order to see that promise through, the paper further introduces a novel algorithm for estimating BKT parameters subject to the newly defined constraints. While the issue of degenerate parameter values has been reported previously, this paper is the first, to our best knowledge, to derive the constrains from first principles while also presenting an algorithm that respects those constraints.