Technology
Parallelizing Plan Recognition
Geib, Christopher W. (Drexel University) | Swetenham, Christopher E. (University of Hong Kong)
Modern multicore computers provide an opportunity to parallelize plan recognition algorithms to decrease runtime. Viewing plan recognition as parsing based on a complete breadth first search, makes ELEXIR (engine for lexicalized intent recognition) (Geib 2009; Geib and Goldman 2011) particularly suited for parallelization. This article documents the extension of ELEXIR to utilize such modern computing platforms. We will discuss multiple possible algorithms for distributing work between parallel threads and the associated performance wins. We will show, that the best of these algorithms provides close to linear speedup (up to a maximum number of processors), and that features of the problem domain have an impact on the achieved speedup.
The Angry Birds AI Competition
Renz, Jochen (The Australian National University) | Ge, Xiaoyu (The Australian National University) | Gould, Stephen (The Australian National University) | Zhang, Peng (The Australian National University)
The aim of the Angry Birds AI competition (AIBIRDS) is to build intelligent agents that can play new Angry Birds levels better than the best human players. This is surprisingly difficult for AI as it requires similar capabilities to what intelligent systems need for successfully interacting with the physical world, one of the grand challenges of AI. As such the competition offers a simplified and controlled environment for developing and testing the necessary AI technologies, a seamless integration of computer vision, machine learning, knowledge representation and reasoning, reasoning under uncertainty, planning, and heuristic search, among others. Over the past three years there have been significant improvements, but we are still a long way from reaching the ultimate aim and, thus, there are great opportunities for participants in this competition.
Platys: From Position to Place-Oriented Mobile Computing
Zavala, Laura (Medgar Evers College, City University of New York) | Murukannaiah, Pradeep K. (North Carolina State University) | Poosamani, Nithyananthan (North Carolina State University.) | Finin, Tim (University of Maryland, Baltimore County) | Joshi, Anupam (University of Maryland, Baltimore County) | Rhee, Injong (North Carolina State University, Raleigh) | Singh, Munindar P. (North Carolina State University)
However, what often matters for experience is the user's place A semantic model of user-centered places, the Platys ontology enables the mapping Research in context-aware computing (Schilit, Adams, of positions to places. In the model, places and and Want 1994) aims to enable computing systems that activities can be represented at different levels of acquire and maintain context data and use it to adapt granularity using subsumption hierarchies. It originated with Weiser's vision of to determine a user's place at any given time. Place ubiquitous computing (Weiser 1999) where human recognition has been addressed with standard activities are enhanced with devices that are all around machine-learning classifiers as well as a semisupervised but unnoticeable to the user and that provide services expectation-maximization algorithm. The that adapt to the circumstances in which they are used. Location is an 1994; Schilit et al. 1993) are early works in contextaware essential part of place and therefore place recognition computing and dealt with tracking a user's location relies on location sensing. Since frequent location and using it to provide better services or sharing it sensing by a mobile device depletes power, we have with others.
Report on the Twenty-Second International Conference on Case-Based Reasoning
Bridge, Derek (University College Cork) | Lamontagne, Luc (Universitรฉ Laval) | Plaza, Enric (IIIA, Artificial Intelligence Research Institute CSIC, Spanish National Research Council)
ICCBR is the annual meeting of the CBR community and the leading conference on this topic. Started in 1993 as the European Conference on CBR and 1995 as ICCBR, the two conferences alternated biennially until their merger in 2010. The main conference track featured 19 research paper presentations, 16 posters, and two invited speakers. The papers and posters reflected the state of the art of case-based reasoning, dealing both with open problems at the core of casebased reasoning (especially in similarity assessment, case adaptation, and case-based maintenance), as well as trending applications of CBR. Minor, Goethe University, Germany, and Emmanuel The first invited speaker, Tony Veale from University Nauer, LORIA, France.
AAAI Conferences Calendar
This page includes forthcoming AAAI sponsored conferences, conferences presented by AAAI Affiliates, and conferences held in cooperation with AAAI. AI Magazine also maintains a calendar listing that includes nonaffiliated conferences at www.aaai.org/Magazine/calendar.php. LPNMR 2015 will be held 27-30 September, 2015, in Third AAAI Conference on Human International Joint Conference on Lexington, Kentucky USA Computation and Crowdsourcing. HCOMP 2015 will be held November be held July 25-August 1, 2015 in 8-11 in San Diego, California. The AAAI Fall Twenty-Ninth International Florida be held 21-23 February, 2016, in Symposium Series will be held November AI Research Society Conference.
On the Convergence of Stochastic Variational Inference in Bayesian Networks
We highlight a pitfall when applying stochastic variational inference to general Bayesian networks. For global random variables approximated by an exponential family distribution, natural gradient steps, commonly starting from a unit length step size, are averaged to convergence. This useful insight into the scaling of initial step sizes is lost when the approximation factorizes across a general Bayesian network, and care must be taken to ensure practical convergence. We experimentally investigate how much of the baby (well-scaled steps) is thrown out with the bath water (exact gradients).
Preference Completion: Large-scale Collaborative Ranking from Pairwise Comparisons
Park, Dohyung, Neeman, Joe, Zhang, Jin, Sanghavi, Sujay, Dhillon, Inderjit S.
In this paper we consider the collaborative ranking setting: a pool of users each provides a small number of pairwise preferences between $d$ possible items; from these we need to predict preferences of the users for items they have not yet seen. We do so by fitting a rank $r$ score matrix to the pairwise data, and provide two main contributions: (a) we show that an algorithm based on convex optimization provides good generalization guarantees once each user provides as few as $O(r\log^2 d)$ pairwise comparisons -- essentially matching the sample complexity required in the related matrix completion setting (which uses actual numerical as opposed to pairwise information), and (b) we develop a large-scale non-convex implementation, which we call AltSVM, that trains a factored form of the matrix via alternating minimization (which we show reduces to alternating SVM problems), and scales and parallelizes very well to large problem settings. It also outperforms common baselines on many moderately large popular collaborative filtering datasets in both NDCG and in other measures of ranking performance.
Scalable Gaussian Process Classification via Expectation Propagation
Hernรกndez-Lobato, Daniel, Hernรกndez-Lobato, Josรฉ Miguel
Variational methods have been recently considered for scaling the training process of Gaussian process classifiers to large datasets. As an alternative, we describe here how to train these classifiers efficiently using expectation propagation. The proposed method allows for handling datasets with millions of data instances. More precisely, it can be used for (i) training in a distributed fashion where the data instances are sent to different nodes in which the required computations are carried out, and for (ii) maximizing an estimate of the marginal likelihood using a stochastic approximation of the gradient. Several experiments indicate that the method described is competitive with the variational approach.
Iterative Subsampling in Solution Path Clustering of Noisy Big Data
We develop an iterative subsampling approach to improve the computational efficiency of our previous work on solution path clustering (SPC). The SPC method achieves clustering by concave regularization on the pairwise distances between cluster centers. This clustering method has the important capability to recognize noise and to provide a short path of clustering solutions; however, it is not sufficiently fast for big datasets. Thus, we propose a method that iterates between clustering a small subsample of the full data and sequentially assigning the other data points to attain orders of magnitude of computational savings. The new method preserves the ability to isolate noise, includes a solution selection mechanism that ultimately provides one clustering solution with an estimated number of clusters, and is shown to be able to extract small tight clusters from noisy data. The method's relatively minor losses in accuracy are demonstrated through simulation studies, and its ability to handle large datasets is illustrated through applications to gene expression datasets. An R package, SPClustering, for the SPC method with iterative subsampling is available at http://www.stat.ucla.edu/~zhou/Software.html.
How to Center Binary Deep Boltzmann Machines
Melchior, Jan, Fischer, Asja, Wiskott, Laurenz
This work analyzes centered binary Restricted Boltzmann Machines (RBMs) and binary Deep Boltzmann Machines (DBMs), where centering is done by subtracting offset values from visible and hidden variables. We show analytically that (i) centering results in a different but equivalent parameterization for artificial neural networks in general, (ii) the expected performance of centered binary RBMs/DBMs is invariant under simultaneous flip of data and offsets, for any offset value in the range of zero to one, (iii) centering can be reformulated as a different update rule for normal binary RBMs/DBMs, and (iv) using the enhanced gradient is equivalent to setting the offset values to the average over model and data mean. Furthermore, numerical simulations suggest that (i) optimal generative performance is achieved by subtracting mean values from visible as well as hidden variables, (ii) centered RBMs/DBMs reach significantly higher log-likelihood values than normal binary RBMs/DBMs, (iii) centering variants whose offsets depend on the model mean, like the enhanced gradient, suffer from severe divergence problems, (iv) learning is stabilized if an exponentially moving average over the batch means is used for the offset values instead of the current batch mean, which also prevents the enhanced gradient from diverging, (v) centered RBMs/DBMs reach higher LL values than normal RBMs/DBMs while having a smaller norm of the weight matrix, (vi) centering leads to an update direction that is closer to the natural gradient and that the natural gradient is extremly efficient for training RBMs, (vii) centering dispense the need for greedy layer-wise pre-training of DBMs, (viii) furthermore we show that pre-training often even worsen the results independently whether centering is used or not, and (ix) centering is also beneficial for auto encoders.