Technology
Exact Reconstruction Conditions for Regularized Modified Basis Pursuit
In this correspondence, we obtain exact recovery conditions for regularized modified basis pursuit (reg-mod-BP) and discuss when the obtained conditions are weaker than those for modified-CS or for basis pursuit (BP). The discussion is also supported by simulation comparisons. Reg-mod-BP provides a solution to the sparse recovery problem when both an erroneous estimate of the signal's support, denoted by $T$, and an erroneous estimate of the signal values on $T$ are available.
Generalized Biwords for Bitext Compression and Translation Spotting
Sánchez-Martínez, F., Carrasco, R. C., Martínez-Prieto, M. A., Adiego, J.
Large bilingual parallel texts (also known as bitexts) are usually stored in a compressed form, and previous work has shown that they can be more efficiently compressed if the fact that the two texts are mutual translations is exploited. For example, a bitext can be seen as a sequence of biwords ---pairs of parallel words with a high probability of co-occurrence--- that can be used as an intermediate representation in the compression process. However, the simple biword approach described in the literature can only exploit one-to-one word alignments and cannot tackle the reordering of words. We therefore introduce a generalization of biwords which can describe multi-word expressions and reorderings. We also describe some methods for the binary compression of generalized biword sequences, and compare their performance when different schemes are applied to the extraction of the biword sequence. In addition, we show that this generalization of biwords allows for the implementation of an efficient algorithm to look on the compressed bitext for words or text segments in one of the texts and retrieve their counterpart translations in the other text ---an application usually referred to as translation spotting--- with only some minor modifications in the compression algorithm.
Spectral dimensionality reduction for HMMs
Foster, Dean P., Rodu, Jordan, Ungar, Lyle H.
Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a new spectral method which significantly reduces the number of model parameters that need to be estimated, and generates a sample complexity that does not depend on the size of the observation vocabulary. We present an elementary proof giving bounds on the relative accuracy of probability estimates from our model. (Correlaries show our bounds can be weakened to provide either L1 bounds or KL bounds which provide easier direct comparisons to previous work.) Our theorem uses conditions that are checkable from the data, instead of putting conditions on the unobservable Markov transition matrix.
Bayesian Network Enhanced with Structural Reliability Methods: Methodology
Straub, Daniel, Der Kiureghian, Armen
We combine Bayesian networks (BNs) and structural reliability methods (SRMs) to create a new computational framework, termed enhanced Bayesian network (eBN), for reliability and risk analysis of engineering structures and infrastructure. BNs are efficient in representing and evaluating complex probabilistic dependence structures, as present in infrastructure and structural systems, and they facilitate Bayesian updating of the model when new information becomes available. On the other hand, SRMs enable accurate assessment of probabilities of rare events represented by computationally demanding, physically-based models. By combining the two methods, the eBN framework provides a unified and powerful tool for efficiently computing probabilities of rare events in complex structural and infrastructure systems in which information evolves in time. Strategies for modeling and efficiently analyzing the eBN are described by way of several conceptual examples. The companion paper applies the eBN methodology to example structural and infrastructure systems.
Analysis of a Random Forests Model
In a series of papers and technical reports, Breiman [9, 10, 11, 12] demonstrated that substantial gains in classification and regression accuracy can be achieved by using ensembles of trees, where each tree in the ensemble is grown in accordance with a random parameter. Final predictions are obtained by aggregating over the ensemble. As the base constituents of the ensemble are tree-structured predictors, and since each of these trees is constructed using an injection of randomness, these procedures are called "random forests". Breiman's ideas were decisively influenced by the early work of Amit and Geman [3] on geometric feature selection, the random subspace method of Ho [27] and the random split selection approach of Dietterich [21]. As highlighted by various empirical studies (see [11, 36, 20, 24, 25] for instance), random forests have emerged as serious competitors to state-of-the-art methods such as boosting (Freund [22]) and support vector machines (Shawe-Taylor and Cristianini [35]).
Random Feature Maps for Dot Product Kernels
Kar, Purushottam, Karnick, Harish
Approximating non-linear kernels using feature maps has gained a lot of interest in recent years due to applications in reducing training and testing times of SVM classifiers and other kernel based learning algorithms. We extend this line of work and present low distortion embeddings for dot product kernels into linear Euclidean spaces. We base our results on a classical result in harmonic analysis characterizing all dot product kernels and use it to define randomized feature maps into explicit low dimensional Euclidean spaces in which the native dot product provides an approximation to the dot product kernel with high confidence.
Towards Enabling a Robot to Effectively Assist People in Human-Occupied Environments
Hemachandra, Sachithra (Massachusetts Institute of Technology) | Finman, Ross (Massachusetts Institute of Technology) | Pillai, Sudeep (Massachusetts Institute of Technology) | Teller, Seth (Massachusetts Institute of Technology) | Walter, Matthew R. (Massachusetts Institute of Technology)
Over the last decade, we have seen an increasing demand for robotscapable of coexisting with people. Enabling robots to operatesafely and effectively alongside human partners withinunstructured environments poses interesting research challengesthat broadly span the field of artificial intelligence. This paperpreviews some of the challenges that we faced in developing arobot "envoy" that operates for extended periods of timethroughout an office-like environment, assisting human occupantswith everyday activities that include greeting and escortingguests as well as retrieving and delivering objects. We see threeskill areas as critical for the robot to effectively perform thesetasks. The first is shared situational awareness-the robot mustinterpret its environment through a world model that is sharedwith its human partners. Secondly, the robot should act in a safe,predictable manner and be capable of intuitive interaction withpeople, through such means as natural language speech. Thirdly,the robot, which we initially treat as a rookie, shouldefficiently utilize information provided by human partners,requesting assistance when necessary and learning from suchassistance to become more competent with time.
Crowdsourcing Tasks in Open Query Answering
Simperl, Elena (Karslruhe Institute of Technology) | Norton, Barry (Ontotext AD) | Vrandecic, Denny (Karlsruhe Institute of Technology)
Open query answering is the idea of answering queries that are not given using the vocabulary of the queried knowledge base but instead the vocabulary of the inquirer. Many aspects of open query answering can be tackled through the combination of human effort with algorithmic techniques. In this paper we explore its applicability to crowdsourcing, using a framework in which human and computational intelligence can co-exist by augmenting existing Linked Data and Linked Service technology with crowdsourcing functionality. We analyze how the task can be decomposed and translated into Mechanical Turk projects in order to achieve this vision.
Harnessing the Crowds for Automating the Identification of Web APIs
Pedrinaci, Carlos (The Open University) | Liu, Dong (The Open University) | Lin, Chenghua (The Open University) | Domingue, John (The Open University)
Supporting the efficient discovery and use of Web APIs is increasingly important as their use and popularity grows. Yet, a simple task like finding potentially interesting APIs and their related documentation turns out to be hard and time consuming even when using the best resources currently available on the Web. In this paper we describe our research towards an automated Web API documentation crawler and search engine. This paper presents two main contributions. First, we have devised and exploited crowdsourcing techniques to generate a curated dataset of Web APIs documentation. Second, thanks to this dataset, we have devised an engine able to automatically detect documentation pages. Our preliminary experiments have shown that we obtain an accuracy of 80% and a precision increase of 15 points over a keyword-based heuristic we have used as baseline.