Fuzzy Logic
Information-Theoretic Multi-Objective Bayesian Optimization with Continuous Approximations
Belakaria, Syrine, Deshwal, Aryan, Doppa, Janardhan Rao
Many real-world applications involve black-box optimization of multiple objectives using continuous function approximations that trade-off accuracy and resource cost of evaluation. For example, in rocket launching research, we need to find designs that trade-off return-time and angular distance using continuous-fidelity simulators (e.g., varying tolerance parameter to trade-off simulation time and accuracy) for design evaluations. The goal is to approximate the optimal Pareto set by minimizing the cost for evaluations. In this paper, we propose a novel approach referred to as information-Theoretic Multi-Objective Bayesian Optimization with Continuous Approximations (iMOCA)} to solve this problem. The key idea is to select the sequence of input and function approximations for multiple objectives which maximize the information gain per unit cost for the optimal Pareto front. Our experiments on diverse synthetic and real-world benchmarks show that iMOCA significantly improves over existing single-fidelity methods.
A Review of Visual Descriptors and Classification Techniques Used in Leaf Species Identification
Thyagharajan, K. K., Raji, I. Kiruba
Plants are fundamentally important to life. Key research areas in plant science include plant species identification, weed classification using hyper spectral images, monitoring plant health and tracing leaf growth, and the semantic interpretation of leaf information. Botanists easily identify plant species by discriminating between the shape of the leaf, tip, base, leaf margin and leaf vein, as well as the texture of the leaf and the arrangement of leaflets of compound leaves. Because of the increasing demand for experts and calls for biodiversity, there is a need for intelligent systems that recognize and characterize leaves so as to scrutinize a particular species, the diseases that affect them, the pattern of leaf growth, and so on. We review several image processing methods in the feature extraction of leaves, given that feature extraction is a crucial technique in computer vision. As computers cannot comprehend images, they are required to be converted into features by individually analysing image shapes, colours, textures and moments. Images that look the same may deviate in terms of geometric and photometric variations. In our study, we also discuss certain machine learning classifiers for an analysis of different species of leaves.
Policy Gradient Reinforcement Learning for Policy Represented by Fuzzy Rules: Application to Simulations of Speed Control of an Automobile
Ishihara, Seiji, Igarashi, Harukazu
A method of a fusion of fuzzy inference and policy gradient reinforcement learning has been proposed that directly learns, as maximizes the expected value of the reward per episode, parameters in a policy function represented by fuzzy rules with weights. A study has applied this method to a task of speed control of an automobile and has obtained correct policies, some of which control speed of the automobile appropriately but many others generate inappropriate vibration of speed. In general, the policy is not desirable that causes sudden time change or vibration in the output value, and there would be many cases where the policy giving smooth time change in the output value is desirable. In this paper, we propose a fusion method using the objective function, that introduces defuzzification with the center of gravity model weighted stochastically and a constraint term for smoothness of time change, as an improvement measure in order to suppress sudden change of the output value of the fuzzy controller. Then we show the learning rule in the fusion, and also consider the effect by reward functions on the fluctuation of the output value. As experimental results of an application of our method on speed control of an automobile, it was confirmed that the proposed method has the effect of suppressing the undesirable fluctuation in time-series of the output value. Moreover, it was also showed that the difference between reward functions might adversely affect the results of learning.
Optimality-based Analysis of XCSF Compaction in Discrete Reinforcement Learning
Bishop, Jordan T., Gallagher, Marcus
Learning classifier systems (LCSs) are population-based predictive systems that were originally envisioned as agents to act in reinforcement learning (RL) environments. These systems can suffer from population bloat and so are amenable to compaction techniques that try to strike a balance between population size and performance. A well-studied LCS architecture is XCSF, which in the RL setting acts as a Q-function approximator. We apply XCSF to a deterministic and stochastic variant of the FrozenLake8x8 environment from OpenAI Gym, with its performance compared in terms of function approximation error and policy accuracy to the optimal Q-functions and policies produced by solving the environments via dynamic programming. We then introduce a novel compaction algorithm (Greedy Niche Mass Compaction - GNMC) and study its operation on XCSF's trained populations. Results show that given a suitable parametrisation, GNMC preserves or even slightly improves function approximation error while yielding a significant reduction in population size. Reasonable preservation of policy accuracy also occurs, and we link this metric to the commonly used steps-to-goal metric in maze-like environments, illustrating how the metrics are complementary rather than competitive.
A Bayesian Approach with Type-2 Student-tMembership Function for T-S Model Identification
Singh, Vikas, Bharadhwaj, Homanga, Verma, Nishchal K
Clustering techniques have been proved highly suc-cessful for Takagi-Sugeno (T-S) fuzzy model identification. Inparticular, fuzzyc-regression clustering based on type-2 fuzzyset has been shown the remarkable results on non-sparse databut their performance degraded on sparse data. In this paper, aninnovative architecture for fuzzyc-regression model is presentedand a novel student-tdistribution based membership functionis designed for sparse data modelling. To avoid the overfitting,we have adopted a Bayesian approach for incorporating aGaussian prior on the regression coefficients. Additional noveltyof our approach lies in type-reduction where the final output iscomputed using Karnik Mendel algorithm and the consequentparameters of the model are optimized using Stochastic GradientDescent method. As detailed experimentation, the result showsthat proposed approach outperforms on standard datasets incomparison of various state-of-the-art methods.
Artificial Intelligence Review
On the evaluation and combination of state-of-the-art features in Twitter sentiment analysis Authors Content type: OriginalPaper Published: 27 August 2020 Nature inspired optimization algorithms or simply variations of metaheuristics? Nature inspired optimization algorithms or simply variations of metaheuristics? Nature inspired optimization algorithms or simply variations of metaheuristics? Electric Charged Particles Optimization and its application to the optimal design of a circular antenna array Authors H. R. E. H. Bouchekara Content type: OriginalPaper Published: 20 August 2020 CHIRPS: Explaining random forest classification Authors Mohamed Medhat Gaber R. Muhammad Atif Azad Content type: OriginalPaper Published: 04 June 2020 Image classifiers and image deep learning classifiers evolved in detection of Oryza sativa diseases: survey Authors N. V. Raja Reddy Goluguri Content type: EditorialNotes Published: 28 May 2020 Novel classes of coverings based multigranulation fuzzy rough sets and corresponding applications to multiple attribute group decision-making Authors (first, second and last of 4) José Carlos R. Alcantud Content type: OriginalPaper Published: 19 May 2020
An in-depth comparison of methods handling mixed-attribute data for general fuzzy min-max neural network
Khuat, Thanh Tung, Gabrys, Bogdan
A general fuzzy min-max (GFMM) neural network is one of the efficient neuro-fuzzy systems for classification problems. However, a disadvantage of most of the current learning algorithms for GFMM is that they can handle effectively numerical valued features only. Therefore, this paper provides some potential approaches to adapting GFMM learning algorithms for classification problems with mixed-type or only categorical features as they are very common in practical applications and often carry very useful information. We will compare and assess three main methods of handling datasets with mixed features, including the use of encoding methods, the combination of the GFMM model with other classifiers, and employing the specific learning algorithms for both types of features. The experimental results showed that the target and James-Stein are appropriate categorical encoding methods for learning algorithms of GFMM models, while the combination of GFMM neural networks and decision trees is a flexible way to enhance the classification performance of GFMM models on datasets with the mixed features. The learning algorithms with the mixed-type feature abilities are potential approaches to deal with mixed-attribute data in a natural way, but they need further improvement to achieve a better classification accuracy. Based on the analysis, we also identify the strong and weak points of different methods and propose potential research directions.
Handling of uncertainty in medical data using machine learning and probability theory techniques: A review of 30 years (1991-2020)
Alizadehsani, Roohallah, Roshanzamir, Mohamad, Hussain, Sadiq, Khosravi, Abbas, Koohestani, Afsaneh, Zangooei, Mohammad Hossein, Abdar, Moloud, Beykikhoshk, Adham, Shoeibi, Afshin, Zare, Assef, Panahiazar, Maryam, Nahavandi, Saeid, Srinivasan, Dipti, Atiya, Amir F., Acharya, U. Rajendra
Understanding data and reaching valid conclusions are of paramount importance in the present era of big data. Machine learning and probability theory methods have widespread application for this purpose in different fields. One critically important yet less explored aspect is how data and model uncertainties are captured and analyzed. Proper quantification of uncertainty provides valuable information for optimal decision making. This paper reviewed related studies conducted in the last 30 years (from 1991 to 2020) in handling uncertainties in medical data using probability theory and machine learning techniques. Medical data is more prone to uncertainty due to the presence of noise in the data. So, it is very important to have clean medical data without any noise to get accurate diagnosis. The sources of noise in the medical data need to be known to address this issue. Based on the medical data obtained by the physician, diagnosis of disease, and treatment plan are prescribed. Hence, the uncertainty is growing in healthcare and there is limited knowledge to address these problems. We have little knowledge about the optimal treatment methods as there are many sources of uncertainty in medical science. Our findings indicate that there are few challenges to be addressed in handling the uncertainty in medical raw data and new models. In this work, we have summarized various methods employed to overcome this problem. Nowadays, application of novel deep learning techniques to deal such uncertainties have significantly increased.
Integrated attitude estimation and control of satellite with thruster actuator using ANFIS
Abtahi, SeyedMehdi, Assadian, Nima
This paper proposed a new estimation and control strategy to control the satellite attitude. As the attitude control strategy plays an essential role in the different kinds of space missions, scientists try to improve the performance of the satellite attitude system, regardless of the expense. In this study, we proposed an adaptive neuro-fuzzy integrated (ANFIS) satellite attitude estimation and control system. A pulse modulator is used to generate the right ON/OFF commands of the thruster actuator. To evaluate the performance of the ANFIS controller in closed-loop simulation, an ANFIS observer is used to estimate the attitude and angular velocities of the satellite using a magnetometer, sun sensor, and rate gyro data. Besides, a new ANFIS system will be proposed and evaluated that can simultaneously control and estimate the system. The performance of the ANFIS controller is compared with the optimal PID controller in a Monte Carlo simulation using different initial conditions, disturbance, and noise. The simulations are performed to verify the ANFIS controller's ability to decrease settling time and fuel consumption in comparison with the optimal PID controller. Also, examine the ANFIS estimator, and the results demonstrate the high skill of these designated observers. Moreover, we proposed an integrated ANFIS estimator and controller for satellite attitude control and estimation in the presence of noise and uncertainty, which can reduce the computational effort and offer smooth actuator actions.
An Intelligent Edge-Centric Queries Allocation Scheme based on Ensemble Models
Kolomvatsos, Kostas, Anagnostopoulos, Christos
The combination of Internet of Things (IoT) and Edge Computing (EC) can assist in the delivery of novel applications that will facilitate end users activities. Data collected by numerous devices present in the IoT infrastructure can be hosted into a set of EC nodes becoming the subject of processing tasks for the provision of analytics. Analytics are derived as the result of various queries defined by end users or applications. Such queries can be executed in the available EC nodes to limit the latency in the provision of responses. In this paper, we propose a meta-ensemble learning scheme that supports the decision making for the allocation of queries to the appropriate EC nodes. Our learning model decides over queries' and nodes' characteristics. We provide the description of a matching process between queries and nodes after concluding the contextual information for each envisioned characteristic adopted in our meta-ensemble scheme. We rely on widely known ensemble models, combine them and offer an additional processing layer to increase the performance. The aim is to result a subset of EC nodes that will host each incoming query. Apart from the description of the proposed model, we report on its evaluation and the corresponding results. Through a large set of experiments and a numerical analysis, we aim at revealing the pros and cons of the proposed scheme.