Rule-Based Reasoning
Correlation-Based Refinement of Rules with Numerical Attributes
Melo, Andre (University of Mannheim) | Theobald, Martin (University of Antwerp) | Völker, Johanna (University of Mannheim)
Learning rules is a common way of extracting usefulinformation from knowledge or data bases. Many ofsuch data sets contain numerical attributes. However,approaches like ILP or association rule mining are optimizedfor data with categorical values, and consideringnumerical attributes is expensive. In this paper,we present an extension to the top-down ILP algorithm,which enables an efficient discovery of datalogrules from data with both numerical and categorical attributes.Our approach comprises a preprocessing phasefor computing the correlations between numerical andcategorical attributes, as well as an extension to the ILPrefinement step, which enables us to detect interestingcandidate rules and to suggest refinements with relevantattribute combinations. We report on experiments withU.S. Census data, Freebase and DBpedia, and show thatour approach helps to efficiently discover rules with numericalintervals.
Sentiment Analysis Using Dependency Trees and Named-Entities
Yasavur, Ugan (Florida International University) | Travieso, Jorge (Florida International University) | Lisetti, Christine (Florida International University) | Rishe, Naphtali David (Florida International University)
There is an increasing interest for valence and emotion sensing using a variety of signals. Text, as a communication channel, gathers a substantial amount of interest for recognizing its underlying sentiment (valence or polarity), affect or emotion (e.g. happy, sadness). We consider recognizing the valence of a sentence as a prior task to emotion sensing. In this article, we discuss our approach to classify sentences in terms of emotional valence. Our supervised system performs syntactic and semantic analysis for feature extraction. It processes the interactions between words in sentences by using dependency parse trees, and it can decide the current polarity of named-entities based on on-the-fly topic modeling. We compared 3 rule-based approaches and two supervised approaches (i.e. Naive Bayes and Maximum Entropy). We trained and tested our system using the SemEval-2007 affective text dataset, which contains news headlines extracted from news websites. Our results show that our systems outperform the systems demonstrated in SemEval-2007.
An Antimicrobial Prescription Surveillance System that Learns from Experience
Beaudoin, Mathieu (Université de Sherbrooke) | Kabanza, Froduald (Université de Sherbrooke) | Nault, Vincent (Université de Sherbrooke) | Valiquette, Louis (Université de Sherbrooke)
Inappropriate prescribing of antimicrobials is a major clinical concern that affects as many as 50 percent of prescriptions. One of the difficulties of antimicrobial prescribing lies in the necessity to sequentially adjust the treatment of a patient as new clinical data become available. The lack of specialized healthcare resources and the overwhelming amount of information to process make manual surveillance unsustainable. To solve this problem, we have developed and deployed an automated antimicrobial prescription surveillance system that assists hospital pharmacists in identifying and reporting inappropriate prescriptions. Since its deployment, the system has improved antimicrobial prescribing and decreased antimicrobial use. However, the highly sensitive knowledge base used by the system leads to many false alerts. As a remedy, we are developing a machine learning algorithm that combines instance-based learning and rule induction techniques to discover new rules for detecting inappropriate prescriptions from previous false alerts. In this article, we describe the system, point to results and lessons learned so far and provide insight into the machine learning capability.
Systematic Ensemble Learning for Regression
Aldave, Roberto, Dussault, Jean-Pierre
The motivation of this work is to improve the performance of standard stacking approaches or ensembles, which are composed of simple, heterogeneous base models, through the integration of the generation and selection stages for regression problems. We propose two extensions to the standard stacking approach. In the first extension we combine a set of standard stacking approaches into an ensemble of ensembles using a two-step ensemble learning in the regression setting. The second extension consists of two parts. In the initial part a diversity mechanism is injected into the original training data set, systematically generating different training subsets or partitions, and corresponding ensembles of ensembles. In the final part after measuring the quality of the different partitions or ensembles, a max-min rule-based selection algorithm is used to select the most appropriate ensemble/partition on which to make the final prediction. We show, based on experiments over a broad range of data sets, that the second extension performs better than the best of the standard stacking approaches, and is as good as the oracle of databases, which has the best base model selected by cross-validation for each data set. In addition to that, the second extension performs better than two state-of-the-art ensemble methods for regression, and it is as good as a third state-of-the-art ensemble method.
VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text
Hutto, C. J. (Georgia Institute of Technology) | Gilbert, Eric (Georgia Institute of Technology)
The inherent nature of social media content poses serious challenges to practical applications of sentiment analysis. We present VADER, a simple rule-based model for general sentiment analysis, and compare its effectiveness to eleven typical state-of-practice benchmarks including LIWC, ANEW, the General Inquirer, SentiWordNet, and machine learning oriented techniques relying on Naive Bayes, Maximum Entropy, and Support Vector Machine (SVM) algorithms. Using a combination of qualitative and quantitative methods, we first construct and empirically validate a gold-standard list of lexical features (along with their associated sentiment intensity measures) which are specifically attuned to sentiment in microblog-like contexts. We then combine these lexical features with consideration for five general rules that embody grammatical and syntactical conventions for expressing and emphasizing sentiment intensity. Interestingly, using our parsimonious rule-based model to assess the sentiment of tweets, we find that VADER outperforms individual human raters (F1 Classification Accuracy = 0.96 and 0.84, respectively), and generalizes more favorably across contexts than any of our benchmarks.
Systems Theoretic Techniques for Modeling, Control, and Decision Support in Complex Dynamic Systems
We discuss the problems of modeling, control, and decision support in complex dynamic systems from a general system theoretic point of view. The main characteristics of complex systems and of system approach to complex system study are considered. We provide an overview and analysis of known existing paradigms and methods of mathematical modeling and simulation of complex systems, which support the processes of control and decision making. Then we continue with the general dynamic modeling and simulation technique for complex hierarchical systems functioning in control loop. Architectural and structural models of computer information system intended for simulation and decision support in complex systems are presented.
AI Methods in Algorithmic Composition: A Comprehensive Survey
Algorithmic composition is the partial or total automation of the process of music composition by using computers. Since the 1950s, different computational techniques related to Artificial Intelligence have been used for algorithmic composition, including grammatical representations, probabilistic methods, neural networks, symbolic rule-based systems, constraint programming and evolutionary algorithms. This survey aims to be a comprehensive account of research on algorithmic composition, presenting a thorough view of the field for researchers in Artificial Intelligence.
Integrating Systems and Theories in the SAL Hybrid Architecture
Szabados, Andrew Michael (eCortex, inc.) | Herd, Seth (University of Colorado Boulder) | Vinokurov, Yury (Carnegie Mellon University) | Lebiere, Christian (Carnegie Mellon University) | O' (University of Colorado Boulder) | Reilly, Randall C.
The Synthesis of ACT-R and Leabra (SAL) hybrid cognitive architecture is the integration of two theories of cognitive functioning, each itself a highly integrative theory of cognition, ACT-R being predominantly a symbolic production-rule based architecture and Leabra a neural modeling architecture. The combination of the two architectures allows for richer dynamics that take advantage of neural and symbolic aspects and provides mutual constraints that promote convergence towards models that are both neurophysiologically and psychologically valid. We present a hybrid model that makes use of multi-level and multi-system integration to allow an instructed assembly task to be carried out in way that is noise and error robust. Specifically, the model shows how higher-level error recovery routines can interface with lower-level sensory, motor, and error detection processes and result in a robustness to noise and noise-induced errors. Multiple systems and processes operating at multiple levels are recruited to provide a way around the limitations of simpler systems composed of isolated modules that do not allow information to be propagated as easily. The benefits of this approach provide motivation for the adoption of a generally integrated approach to cognitive systems.
Horn Clause Contraction Functions
Delgrande, J. P., Wassermann, R.
In classical, AGM-style belief change, it is assumed that the underlying logic contains classical propositional logic. This is clearly a limiting assumption, particularly in Artificial Intelligence. Consequently there has been recent interest in studying belief change in approaches where the full expressivity of classical propositional logic is not obtained. In this paper we investigate belief contraction in Horn knowledge bases. We point out that the obvious extension to the Horn case, involving Horn remainder sets as a starting point, is problematic. Not only do Horn remainder sets have undesirable properties, but also some desirable Horn contraction functions are not captured by this approach. For Horn belief set contraction, we develop an account in terms of a model-theoretic characterisation involving weak remainder sets. Maxichoice and partial meet Horn contraction is specified, and we show that the problems arising with earlier work are resolved by these approaches. As well, constructions of the specific operators and sets of postulates are provided, and representation results are obtained. We also examine Horn package contraction, or contraction by a set of formulas. Again, we give a construction and postulate set, linking them via a representation result. Last, we investigate the closely-related notion of forgetting in Horn clauses. This work is arguably interesting since Horn clauses have found widespread use in AI; as well, the results given here may potentially be extended to other areas which make use of Horn-like reasoning, such as logic programming, rule-based systems, and description logics. Finally, since Horn reasoning is weaker than classical reasoning, this work sheds light on the foundations of belief change
Adaptive Measurement-Based Policy-Driven QoS Management with Fuzzy-Rule-based Resource Allocation
Yerima, Suleiman Y., Parr, Gerard P., McClean, Sally I., Morrow, Philip J.
Fixed and wireless networks are increasingly converging towards common connectivity with IP-based core networks. Providing effective end-to-end resource and QoS management in such complex heterogeneous converged network scenarios requires unified, adaptive and scalable solutions to integrate and co-ordinate diverse QoS mechanisms of different access technologies with IP-based QoS. Policy-Based Network Management (PBNM) is one approach that could be employed to address this challenge. Hence, a policy-based framework for end-to-end QoS management in converged networks, CNQF (Converged Networks QoS Management Framework) has been proposed within our project. In this paper, the CNQF architecture, a Java implementation of its prototype and experimental validation of key elements are discussed. We then present a fuzzy-based CNQF resource management approach and study the performance of our implementation with real traffic flows on an experimental testbed. The results demonstrate the efficacy of our resource-adaptive approach for practical PBNM systems.