Goto

Collaborating Authors

 vale


VALE: A Multimodal Visual and Language Explanation Framework for Image Classifiers using eXplainable AI and Language Models

Natarajan, Purushothaman, Nambiar, Athira

arXiv.org Artificial Intelligence

Deep Neural Networks (DNNs) have revolutionized various fields by enabling task automation and reducing human error. However, their internal workings and decision-making processes remain obscure due to their black box nature. Consequently, the lack of interpretability limits the application of these models in high-risk scenarios. To address this issue, the emerging field of eXplainable Artificial Intelligence (XAI) aims to explain and interpret the inner workings of DNNs. Despite advancements, XAI faces challenges such as the semantic gap between machine and human understanding, the trade-off between interpretability and performance, and the need for context-specific explanations. To overcome these limitations, we propose a novel multimodal framework named VALE Visual and Language Explanation. VALE integrates explainable AI techniques with advanced language models to provide comprehensive explanations. This framework utilizes visual explanations from XAI tools, an advanced zero-shot image segmentation model, and a visual language model to generate corresponding textual explanations. By combining visual and textual explanations, VALE bridges the semantic gap between machine outputs and human interpretation, delivering results that are more comprehensible to users. In this paper, we conduct a pilot study of the VALE framework for image classification tasks. Specifically, Shapley Additive Explanations (SHAP) are used to identify the most influential regions in classified images. The object of interest is then extracted using the Segment Anything Model (SAM), and explanations are generated using state-of-the-art pre-trained Vision-Language Models (VLMs). Extensive experimental studies are performed on two datasets: the ImageNet dataset and a custom underwater SONAR image dataset, demonstrating VALEs real-world applicability in underwater image classification.


Impact of Employing Weather Forecast Data as Input to the Estimation of Evapotranspiration by Deep Neural Network Models

Vaz, Pedro J., Schütz, Gabriela, Guerrero, Carlos, Cardoso, Pedro J. S.

arXiv.org Artificial Intelligence

Reference Evapotranspiration (ET0) is a key parameter for designing smart irrigation scheduling, since it is related by a coefficient to the water needs of a crop. The United Nations Food and Agriculture Organization, proposed a standard method for ET0 computation (FAO56PM), based on the parameterization of the Penman-Monteith equation, that is widely adopted in the literature. To compute ET0 using the FAO56-PM method, four main weather parameters are needed: temperature, humidity, wind, and solar radiation (SR). One way to make daily ET0 estimations for future days is to use freely available weather forecast services (WFSs), where many meteorological parameters are estimated up to the next 15 days. A problem with this method is that currently, SR is not provided as a free forecast parameter on most of those online services or, normally, such forecasts present a financial cost penalty. For this reason, several ET0 estimation models using machine and deep learning were developed and presented in the literature, that use as input features a reduced set of carefully selected weather parameters, that are compatible with common freely available WFSs. However, most studies on this topic have only evaluated model performance using data from weather stations (WSs), without considering the effect of using weather forecast data. In this study, the performance of authors' previous models is evaluated when using weather forecast data from two online WFSs, in the following scenarios: (i) direct ET0 estimation by an ANN model, and (ii) estimate SR by ANN model, and then use that estimation for ET0 computation, using the FAO56-PM method. Employing data collected from two WFSs and a WS located in Vale do Lobo, Portugal, the latter approach achieved the best result, with a coefficient of determination (R2) ranging between 0.893 and 0.667, when considering forecasts up to 15 days.


Digging smarter with technology

#artificialintelligence

Technology is at the center of the changing world. As this understanding and acceptance has started picking up steam in recent years, even those professions that are manual in nature are making use of technology to drive better business results. One such organization, Vale, S.A., which is one of the largest producers of iron ore in the world, is adapting to the times and adopting technology on the way. In a conversation with Infosys' Ashiss Kumar Dash, Gustavo Vieira, Chief Information Officer, Vale, shared his thoughts on how the mining industry is transforming, and technology is playing an increasingly important role in it. "(It's in an interesting moment in) the mining industry now… where we want to use technology really to bring the value, and also reduce the risks of our operation," says Vieira.


Vale to apply machine learning at Coleman nickel mine

#artificialintelligence

Brazil's mining major Vale is set to start applying machine learning to identify new drilling targets at its Coleman nickel mine. Coleman Mine, which is the flagship asset of Vale in Ontario, Canada, is part of the company's base metals operations. Vale has selected technology company GoldSpot Discoveries to examine and analyse the vast amount of data acquired by it over decades of mining at Coleman. GoldSpot Discoveries' team of geologists and data scientists will also discover previously unrecognised data trends, which may point to unknown areas of in-depth mineralisation. By using its geoscience and machine science expertise, GoldSpot Discoveries' team will clean, unify and analyse exploration data from Vale's Coleman Mine.


Artificial Intelligence. Our Salvation or Destruction - The Vale of Reality

#artificialintelligence

The Joey P Podject begins it's Arrogance of Man series with a look at the Pro's and Con's of Artificial Intelligence. Will A.I. be our greatest achievement or our worst Nightmare. Come take a journey with Joey P as he discusses the good and bad that can come with Man's greatest invention. We will be able to control something far superior to us? This episode is the first step in a long journey into the Arrogance of Man? Buckle up and enjoy .