Goto

Collaborating Authors

 South America


Measuring Robustness to Natural Distribution Shifts in Image Classification

arXiv.org Machine Learning

We study how robust current ImageNet models are to distribution shifts arising from natural variations in datasets. Most research on robustness focuses on synthetic image perturbations (noise, simulated weather artifacts, adversarial examples, etc.), which leaves open how robustness on synthetic distribution shift relates to distribution shift arising in real data. Informed by an evaluation of 204 ImageNet models in 213 different test conditions, we find that there is often little to no transfer of robustness from current synthetic to natural distribution shift. Moreover, most current techniques provide no robustness to the natural distribution shifts in our testbed. The main exception is training on larger and more diverse datasets, which in multiple cases increases robustness, but is still far from closing the performance gaps. Our results indicate that distribution shifts arising in real data are currently an open research problem. We provide our testbed and data as a resource for future work at https://modestyachts.github.io/imagenet-testbed/ .


Explainable Matrix -- Visualization for Global and Local Interpretability of Random Forest Classification Ensembles

arXiv.org Machine Learning

Over the past decades, classification models have proven to be essential machine learning tools given their potential and applicability in various domains. In these years, the north of the majority of the researchers had been to improve quantitative metrics, notwithstanding the lack of information about models' decisions such metrics convey. This paradigm has recently shifted, and strategies beyond tables and numbers to assist in interpreting models' decisions are increasing in importance. Part of this trend, visualization techniques have been extensively used to support classification models' interpretability, with a significant focus on rule-based models. Despite the advances, the existing approaches present limitations in terms of visual scalability, and the visualization of large and complex models, such as the ones produced by the Random Forest (RF) technique, remains a challenge. In this paper, we propose Explainable Matrix (ExMatrix), a novel visualization method for RF interpretability that can handle models with massive quantities of rules. It employs a simple yet powerful matrix-like visual metaphor, where rows are rules, columns are features, and cells are rules predicates, enabling the analysis of entire models and auditing classification results. ExMatrix applicability is confirmed via different examples, showing how it can be used in practice to promote RF models interpretability.


An Argumentation-based Approach for Explaining Goal Selection in Intelligent Agents

arXiv.org Artificial Intelligence

During the first step of practical reasoning, i.e. deliberation or goals selection, an intelligent agent generates a set of pursuable goals and then selects which of them he commits to achieve. Explainable Artificial Intelligence (XAI) systems, including intelligent agents, must be able to explain their internal decisions. In the context of goals selection, agents should be able to explain the reasoning path that leads them to select (or not) a certain goal. In this article, we use an argumentation-based approach for generating explanations about that reasoning path. Besides, we aim to enrich the explanations with information about emerging conflicts during the selection process and how such conflicts were resolved. We propose two types of explanations: the partial one and the complete one and a set of explanatory schemes to generate pseudo-natural explanations. Finally, we apply our proposal to the cleaner world scenario.


Market Status Trend of Conversational Artificial Intelligence (AI) Industry 2020-2026

#artificialintelligence

Conversational Artificial Intelligence (AI) Market report 2020, discusses various factors driving or restraining the market, which will help the future market to grow with promising CAGR. The Conversational Artificial Intelligence (AI) Market research Reports offers an extensive collection of reports on different markets covering crucial details. The report studies the competitive environment of the Conversational Artificial Intelligence (AI) Market is based on company profiles and their efforts on increasing product value and production. It incorporates Conversational Artificial Intelligence (AI) market evolution study, involving the current scenario, growth rate (CAGR), and SWOT analysis. Important the study on Conversational Artificial Intelligence (AI) market takes a closer look at the top market performers and monitors the strategies that have enabled them to occupy a strong foothold in the market.


New Era in AI : Artificial Intelligence Platform Market Forecast Revised in a New Market Research Store Report as COVID-19 Projected to Hold a Massive Impact on Sales in 2020 - NJ MMA News

#artificialintelligence

Artificial Intelligence Platform Market report is a comprehensive analysis of global market has newly added by IT Intelligence Markets to its extensive repository. The statistical report offers a prime wellspring of applicable information for global business progress. Global Artificial Intelligence Platform Market research reports growth rates and market value based on market dynamics, growth factors. Complete knowledge is based on the latest innovations in the industry, opportunities and trends. In addition to SWOT analysis by key suppliers, the report contains a comprehensive market 0061nalysis and major player's landscape. Ask for Sample Copy of This Report: https://www.itintelligencemarkets.com/request_sample.php?id 28007 The purpose of this study is to define the overview of the Global Artificial Intelligence Platform Market with respect to market size, shares, sales patterns, and pricing structures.


Radiology Initiatives Illustrate Uses for Open Data and Open AI research

#artificialintelligence

Andy OramFans of data in health care often speculate about what clinicians and researchers could achieve by reducing friction in data sharing. What if we had easy access to group repositories, expert annotations and labels, robust and consistent metadata, and standards without inconsistencies? Since 2017, the Radiological Society of North America (RSNA) has been displaying a model for such data sharing. That year marked RSNA's first AI challenge. RSNA has worked since then to make the AI challenge an increasingly international collaboration.


AI in Supply Chain & Logistics Market Drives Future Change

#artificialintelligence

Thanks for reading this article; you can also get individual chapter wise section or region wise report version like North America, Europe or Asia. We are the best market research reports provider in the industry. Report Ocean believe in providing the quality reports to clients to meet the top line and bottom line goals which will boost your market share in today's competitive environment. Report Ocean is "one-stop solution" for individuals, organizations, and industries that are looking for innovative market research reports. Report Ocean Email: [email protected] Address: 500 N Michigan Ave, Suite 600, Chicago, IIIinois 60611 – UNITED STATES Tel: 1 888 212 3539 (US – TOLL FREE) Website: https://www.reportocean.com/


Resolving Resource Incompatibilities in Intelligent Agents

arXiv.org Artificial Intelligence

An intelligent agent may in general pursue multiple procedural goals simultaneously, which may lead to arise some conflicts (incompatibilities) among them. In this paper, we focus on the incompatibilities that emerge due to resources limitations. Thus, the contribution of this article is twofold. On one hand, we give an algorithm for identifying resource incompatibilities from a set of pursued goals and, on the other hand, we propose two ways for selecting those goals that will continue to be pursued: (i) the first is based on abstract argumentation theory, and (ii) the second based on two algorithms developed by us. We illustrate our proposal using examples throughout the article.


Argumentation-based Agents that Explain their Decisions

arXiv.org Artificial Intelligence

Explainable Artificial Intelligence (XAI) systems, including intelligent agents, must be able to explain their internal decisions, behaviours and reasoning that produce their choices to the humans (or other systems) with which they interact. In this paper, we focus on how an extended model of BDI (Beliefs-Desires-Intentions) agents can be able to generate explanations about their reasoning, specifically, about the goals he decides to commit to. Our proposal is based on argumentation theory, we use arguments to represent the reasons that lead an agent to make a decision and use argumentation semantics to determine acceptable arguments (reasons). We propose two types of explanations: the partial one and the complete one. We apply our proposal to a scenario of rescue robots.


MeLIME: Meaningful Local Explanation for Machine Learning Models

arXiv.org Artificial Intelligence

Most state-of-the-art machine learning algorithms induce black-box models, preventing their application in many sensitive domains. Hence, many methodologies for explaining machine learning models have been proposed to address this problem. In this work, we introduce strategies to improve local explanations taking into account the distribution of the data used to train the black-box models. We show that our approach, MeLIME, produces more meaningful explanations compared to other techniques over different ML models, operating on various types of data. MeLIME generalizes the LIME method, allowing more flexible perturbation sampling and the use of different local interpretable models. Additionally, we introduce modifications to standard training algorithms of local interpretable models fostering more robust explanations, even allowing the production of counterfactual examples. To show the strengths of the proposed approach, we include experiments on tabular data, images, and text; all showing improved explanations. In particular, MeLIME generated more meaningful explanations on the MNIST dataset than methods such as GuidedBackprop, SmoothGrad, and Layer-wise Relevance Propagation. MeLIME is available on https://github.com/tiagobotari/melime.