Education


How AI Is Changing Your Job Hunt

#artificialintelligence

Utah-based HireVue uses video interviews to examine candidates' word choice, voice inflection, and micro gestures for subtle clues, such as whether their facial expressions contradict their words. Yale School of Management professor Jason Dana, who has studied hiring for years, recently made waves with a high-profile article in the New York Times that excoriated job interviews as useless. But when Google examined its internal evidence, it found that grades, test scores, and a school's pedigree weren't a good predictor of job success. Google created a program called qDroid, which drafts questions for interviewers based on how qDroid parses the data the applicant provided on the qualities Google emphasizes.


Model evaluation, model selection, and algorithm selection in machine learning

#artificialintelligence

In contrast to k-nearest neighbors, a simple example of a parametric method would be logistic regression, a generalized linear model with a fixed number of model parameters: a weight coefficient for each feature variable in the dataset plus a bias (or intercept) unit. While the learning algorithm optimizes an objective function on the training set (with exception to lazy learners), hyperparameter optimization is yet another task on top of it; here, we typically want to optimize a performance metric such as classification accuracy or the area under a Receiver Operating Characteristic curve. Thinking back of our discussion about learning curves and pessimistic biases in Part II, we noted that a machine learning algorithm often benefits from more labeled data; the smaller the dataset, the higher the pessimistic bias and the variance -- the sensitivity of our model towards the way we partition the data. We start by splitting our dataset into three parts, a training set for model fitting, a validation set for model selection, and a test set for the final evaluation of the selected model.


My Computer Is an Honor Student -- but How Intelligent Is It? Standardized Tests as a Measure of AI

AI Magazine

Given the well-known limitations of the Turing Test, there is a need for objective tests to both focus attention on, and measure progress towards, the goals of AI. In this paper we argue that machine performance on standardized tests should be a key component of any new measure of AI, because attaining a high level of performance requires solving significant AI problems involving language understanding and world modeling - critical skills for any machine that lays claim to intelligence. In addition, standardized tests have all the basic requirements of a practical test: they are accessible, easily comprehensible, clearly measurable, and offer a graduated progression from simple tasks to those requiring deep understanding of the world.


Plan Recognition for Exploratory Learning Environments Using Interleaved Temporal Search

AI Magazine

This article presents techniques for recognizing students activities in ELEs and visualizing these activities to students. It describes a new plan recognition algorithm that takes into account repetition and interleaving of activities. It was able to outperform the state-of-the-art plan recognition algorithms when compared to a gold-standard that was obtained by a domain-expert. We also show that visualizing students' plans improves their performance on new problems when compared to an alternative visualization that consists of a step-by-step list of actions.


Report 83-09.pdf

Classics (Collection 2)

Dec 1983 card 1 of 1 Hcuristic Programming Project December 1983 HP P.83-9 Revised Feb 1984 Derek H. Sleeman Heuristic Programming Project Department of Computer Science Stanford University lih To be published in International Journal of Man-Machine Studies BASIC ALGEBRA REVISITED: A STUDY WITH 14-YEAR-OLDS D. Sleeman The University, Leeds 2, U.K.* ABSTRACT This paper reports the results obtained with a group of 24 14-year-old pupils when presented with sets of algebra tasks by the Leeds Modelling System. A comparison between these;ets of results is presented. The results obtained on the paper-and -pencil test and the interviews were consistent, and Show that the pupils had some profound misunderstandings of algebraic notation. Further, from the interviews it is possible to determine classes of strategies some pupi.,s Moreover, this work further demonstrates the importance of interviews to interpret curious protocols.