Goto

Collaborating Authors

MOANOFS: Multi-Objective Automated Negotiation based Online Feature Selection System for Big Data Classification

arXiv.org Artificial Intelligence

Abstract-- Feature Selection (FS) plays an important role in learning and classification tasks. The object of FS is to select the relevant and non-redundant features. Considering the huge amount number of features in real-world applications, FS methods using batch learning technique can't resolve big data problem especially when data arrive sequentially. In this paper, we propose an online feature selection system which resolves this problem. More specifically, we treat the problem of online supervised feature selection for binary classification as a decision-making problem. A philosophical vision to this problem leads to a hybridization between two important domains: feature selection using online learning technique (OFS) and automated negotiation (AN). The proposed OFS system called MOANOFS (Multi-Objective Automated Negotiation based Online Feature Selection) uses two levels of decision. In the first level, from n learners (or OFS methods), we decide which are the k trustful ones (with high confidence or trust value). These elected k learners will participate in the second level. In this level, we integrate our proposed Multilateral Automated Negotiation based OFS (MANOFS) method to decide finally which is the best solution or which are relevant features. We show that MOANOFS system is applicable to different domains successfully and achieves high accuracy with several real-world applications. Index Terms-- Feature selection, online learning, multi-objective automated negotiation, trust, classification, big data. URING the last three decades, Feature Selection (FS) has been extensively studied in Data Mining [1], [2], Pattern Classification [3], [4] and Machine Learning [5], [6]. FS is defined as the process of selecting a subset of relevant features and removing the redundant ones from a dataset for building effective prediction models. In recent years, an enormous increase in data (news, medical imaging) has been observed which allows an increase in redundant information. Even worse, the redundancy of irrelevant data has a negative impact on the performance of classification methods associated.



My experience at the SKA Big Data Africa School - Space in Africa

#artificialintelligence

I was lucky to be selected to the Square Kilometre Array Big Data Africa School funded by the SKA and the Development of Africa With Radio Astronomy (DARA). It was held in Cape Town, South Africa. Big Data is a cloudy idea. Easy to know when you have it, hard to describe. I like thinking of it as data that is sufficiently large such that it is difficult to draw information from it "easily".


Semantics-Empowered Big Data Processing with Applications

AI Magazine

We discuss the nature of big data and address the role of semantics in analyzing and processing big data that arises in the context of physical-cyber-social systems. To handle volume, we advocate semantic perception that can convert low-level observational data to higher-level abstractions more suitable for decision-making. To handle variety, we resort to semantic models and annotations of data so that intelligent processing can be done independent of heterogeneity of data formats and media. To handle velocity, we seek to use continuous semantics capability to dynamically create event or situation specific models and recognize relevant new concepts, entities and facts. To handle veracity, we explore trust models and approaches to glean trustworthiness. These four v's of big data are harnessed by the semantics-empowered analytics to derive value to support applications transcending physical-cyber-social continuum.


Tackling Climate Change with Machine Learning

arXiv.org Artificial Intelligence

Climate change is one of the greatest challenges facing humanity, and we, as machine learning experts, may wonder how we can help. Here we describe how machine learning can be a powerful tool in reducing greenhouse gas emissions and helping society adapt to a changing climate. From smart grids to disaster management, we identify high impact problems where existing gaps can be filled by machine learning, in collaboration with other fields. Our recommendations encompass exciting research questions as well as promising business opportunities. We call on the machine learning community to join the global effort against climate change.