Uncertainty
Join Tree Propagation Utilizing Both Arc Reversal and Variable Elimination
Butz, Cory James (University of Regina) | Konkel, Ken (University of Regina) | Lingras, Pawan (Saint Mary's University)
In this paper, we put forth the first join tree propagation algorithm that selectively applies either arc reversal (AR) or variable elimination (VE) to build the propagated messages. Our approach utilizes a recent method for identifying the propagated join tree messages \`{a} priori. When it is determined that precisely one message is to be constructed at a join tree node, VE is utilized to build this distribution; otherwise, AR is applied as it is better suited to construct multiple distributions passed between neighboring join tree nodes. Experimental results, involving evidence processing in seven real-world and one benchmark Bayesian network, empirically demonstrate that selectively applying VE and AR is faster than applying one of these methods exclusively on the entire network.
Special Track on Uncertain Reasoning
Grant, Kevin (University of Lethbridge) | Sucar, Luis Enrique (Instituto Nacional de Astrofisica, Optica, y Electronica)
The Special Track on Uncertain Reasoning (UR) is the oldest FLAIRS special track, running annually since 1996. The UR'09 Special Track at the 2009 FLAIRS Conference is the 14th in the series. UR'09 seeks to bring together researchers working on broad issues related to reasoning under uncertainty. Topics pertaining to the special track included, but were not limited to, uncertain reasoning formalisms, calculi and methodologies; reasoning with probability, possibility, fuzzy logic, belief function, vagueness, granularity, argumentation, rough sets, and probability logics; modeling and reasoning using imprecise and indeterminate information, such as Choquet capacities, comparative orderings, convex sets of measures, and interval-valued probabilities; exact, approximate, and qualitative uncertain reasoning; graphical models of uncertainty; multi-agent uncertain reasoning and decision making; decision-theoretic planning and Markov decision process; temporal reasoning and uncertainty; epistemic logics; nonmonotonic and conditional logics; similarity-based reasoning; construction of models from elicitation, data mining, and knowledge discovery; uncertain reasoning in information retrieval, filtering, fusion, diagnosis, prediction, and situation assessment; and practical applications of uncertain reasoning. Through rigorous reviews by the program committee, UR'09 accepted 9 full papers and 4 posters from 18 submissions, which are included in this proceedings.
Constraint-based Approach to Discovery of Inter Module Dependencies in Modular Bayesian Networks
Oude, Patrick de (University of Amsterdam) | Pavlin, Gregor (Thales Research &)
This paper introduces an information theoretic approach to verification of modular causal probabilistic models. We assume systems which are gradually extended by adding new functional modules, each having a limited domain knowledge captured by a local Bayesian network. Different modules originate from independent design processes. We assume that the local models are correct, which, however does not guarantee globally coherent inference in composed systems. The introduced method supports discovery of significant inter module dependencies which are ignored in the assembled Bayesian network.
On the Use of Guaranteed Possibility Measures in Possibilistic Networks
Ajroud, Amen (Universite de Sousse) | Benferhat, Salem (CRIL) | Omri, Mohamed Nazih (Universite de Sousse) | Youssef, Habib (Universite de Sousse)
Possibilistic networks are useful tools for reasoning under uncertainty. Uncertain pieces of information can be described by different measures: possibility measures, necessity measures and more recently, guaranteed possibility measures, denoted by Delta. This paper first proposes the use of guaranteed possibility measures to define a so-called Delta-based possibilistic network. This graphical representation tries to express and to deal with the minimal (lower-bound) possibility degree guaranteed for each variable. We then establish relationships between graphical and logical-based representations of uncertain information encoded by guaranteed possibility measures. We show that possibilistic networks based on guaranteed possibility measures can be easily transformed, in a polynomial time, in Delta-based knowledge bases. Then we analyze propagation algorithms in Delta-based possibilistic networks. In fact, standard possibilistic propagation algorithms can be re-used since we show that a simple rewriting of the chain rule allows the transformation of the initial Delta-based possibilistic networks into standard min-based possibilistic networks.
Probabilistic Reasoning at Optimum Entropy with the MEcore System
Finthammer, Marc (FernUniversität in Hagen) | Beierle, Christoph (FernUniversität in Hagen) | Berger, Benjamin (FernUniversität in Hagen) | Kern-Isberner, Gabriele (TU Dortmund)
Augmenting probabilities to conditional logic yields an expressive mechanism for representing uncertainty. The principle of optimum entropy allows one to reason in probabilistic logic in an information-theoretic optimal way by completing the given information as unbiasedly as possible. In this paper, we introduce the MEcore system that realises the core functionalities for an intelligent agent reasoning at optimum entropy and that provides powerful mechanisms for belief management operations like revision, update, diagnosis, or hypothetical what-if-analysis.
Gaussian Belief with dynamic data and in dynamic network
In this paper we analyse Belief Propagation over a Gaussian model in a dynamic environment. Recently, this has been proposed as a method to average local measurement values by a distributed protocol ("Consensus Propagation", Moallemi & Van Roy, 2006), where the average is available for read-out at every single node. In the case that the underlying network is constant but the values to be averaged fluctuate ("dynamic data"), convergence and accuracy are determined by the spectral properties of an associated Ruelle-Perron-Frobenius operator. For Gaussian models on Erdos-Renyi graphs, numerical computation points to a spectral gap remaining in the large-size limit, implying exceptionally good scalability. In a model where the underlying network also fluctuates ("dynamic network"), averaging is more effective than in the dynamic data case. Altogether, this implies very good performance of these methods in very large systems, and opens a new field of statistical physics of large (and dynamic) information systems.
Conservative Inference Rule for Uncertain Reasoning under Incompleteness
In this paper we formulate the problem of inference under incomplete information in very general terms. This includes modelling the process responsible for the incompleteness, which we call the incompleteness process. We allow the process' behaviour to be partly unknown. Then we use Walley's theory of coherent lower previsions, a generalisation of the Bayesian theory to imprecision, to derive the rule to update beliefs under incompleteness that logically follows from our assumptions, and that we call conservative inference rule. This rule has some remarkable properties: it is an abstract rule to update beliefs that can be applied in any situation or domain; it gives us the opportunity to be neither too optimistic nor too pessimistic about the incompleteness process, which is a necessary condition to draw reliable while strong enough conclusions; and it is a coherent rule, in the sense that it cannot lead to inconsistencies. We give examples to show how the new rule can be applied in expert systems, in parametric statistical inference, and in pattern classification, and discuss more generally the view of incompleteness processes defended here as well as some of its consequences.
Learning Document-Level Semantic Properties from Free-Text Annotations
Branavan, S. R. K., Chen, H., Eisenstein, J., Barzilay, R.
This paper presents a new method for inferring the semantic properties of documents by leveraging free-text keyphrase annotations. Such annotations are becoming increasingly abundant due to the recent dramatic growth in semi-structured, user-generated online content. One especially relevant domain is product reviews, which are often annotated by their authors with pros/cons keyphrases such as ``a real bargain'' or ``good value.'' These annotations are representative of the underlying semantic properties; however, unlike expert annotations, they are noisy: lay authors may use different labels to denote the same property, and some labels may be missing. To learn using such noisy annotations, we find a hidden paraphrase structure which clusters the keyphrases. The paraphrase structure is linked with a latent topic model of the review texts, enabling the system to predict the properties of unannotated documents and to effectively aggregate the semantic properties of multiple reviews. Our approach is implemented as a hierarchical Bayesian model with joint inference. We find that joint inference increases the robustness of the keyphrase clustering and encourages the latent topics to correlate with semantically meaningful properties. Multiple evaluations demonstrate that our model substantially outperforms alternative approaches for summarizing single and multiple documents into a set of semantically salient keyphrases.