single view
A Machine Learning Framework for Predicting Microphysical Properties of Ice Crystals from Cloud Particle Imagery
Ko, Joseph, Harrington, Jerry, Sulia, Kara, Przybylo, Vanessa, van Lier-Walqui, Marcus, Lamb, Kara
The microphysical properties of ice crystals are important because they significantly alter the radiative properties and spatiotemporal distributions of clouds, which in turn strongly affect Earth's climate. However, it is challenging to measure key properties of ice crystals, such as mass or morphological features. Here, we present a framework for predicting three-dimensional (3D) microphysical properties of ice crystals from in situ two-dimensional (2D) imagery. First, we computationally generate synthetic ice crystals using 3D modeling software along with geometric parameters estimated from the 2021 Ice Cryo-Encapsulation Balloon (ICEBall) field campaign. Then, we use synthetic crystals to train machine learning (ML) models to predict effective density ($ρ_{e}$), effective surface area ($A_e$), and number of bullets ($N_b$) from synthetic rosette imagery. When tested on unseen synthetic images, we find that our ML models can predict microphysical properties with high accuracy. For $ρ_{e}$ and $A_e$, respectively, our best-performing single view models achieved $R^2$ values of 0.99 and 0.98. For $N_b$, our best single view model achieved a balanced accuracy and F1 score of 0.91. We also quantify the marginal prediction improvements from incorporating a second view. A stereo view ResNet-18 model reduced RMSE by 40% for both $ρ_e$ and $A_e$, relative to a single view ResNet-18 model. For $N_b$, we find that a stereo view ResNet-18 model improved the F1 score by 8%. This work provides a novel ML-driven framework for estimating ice microphysical properties from in situ imagery, which will allow for downstream constraints on microphysical parameterizations, such as the mass-size relationship.
DoRO: Disambiguation of referred object for embodied agents
Pramanick, Pradip, Sarkar, Chayan, Paul, Sayan, Roychoudhury, Ruddra dev, Bhowmick, Brojeshwar
Robotic task instructions often involve a referred object that the robot must locate (ground) within the environment. While task intent understanding is an essential part of natural language understanding, less effort is made to resolve ambiguity that may arise while grounding the task. Existing works use vision-based task grounding and ambiguity detection, suitable for a fixed view and a static robot. However, the problem magnifies for a mobile robot, where the ideal view is not known beforehand. Moreover, a single view may not be sufficient to locate all the object instances in the given area, which leads to inaccurate ambiguity detection. Human intervention is helpful only if the robot can convey the kind of ambiguity it is facing. In this article, we present DoRO (Disambiguation of Referred Object), a system that can help an embodied agent to disambiguate the referred object by raising a suitable query whenever required. Given an area where the intended object is, DoRO finds all the instances of the object by aggregating observations from multiple views while exploring & scanning the area. It then raises a suitable query using the information from the grounded object instances. Experiments conducted with the AI2Thor simulator show that DoRO not only detects the ambiguity more accurately but also raises verbose queries with more accurate information from the visual-language grounding.
Revealing Neural Network Bias to Non-Experts Through Interactive Counterfactual Examples
Myers, Chelsea M., Freed, Evan, Pardo, Luis Fernando Laris, Furqan, Anushay, Risi, Sebastian, Zhu, Jichen
AI algorithms are not immune to biases. Traditionally, non-experts have little control in uncovering potential social bias (e.g., gender bias) in the algorithms that may impact their lives. We present a preliminary design for an interactive visualization tool CEB to reveal biases in a commonly used AI method, Neural Networks (NN). CEB combines counterfactual examples and abstraction of an NN decision process to empower non-experts to detect bias. This paper presents the design of CEB and initial findings of an expert panel (n=6) with AI, HCI, and Social science experts.
3 ways AI can bring companies and customers together
We've all heard the phrase'big data', but when you see the numbers it's clear that'big' doesn't really cut it. More than 188 million emails sent, 55,140 photos posted on Instagram and nearly 10,000 Uber rides taken. And each of those is a data source. So where does this leave the marketers who depend on data to create effective campaigns? The'single view of the customer' is the holy grail of marketing.
The Similarity-Consensus Regularized Multi-view Learning for Dimension Reduction
Meng, Xiangzhu, Wang, Huibing, Feng, Lin
During the last decades, learning a low-dimensional space with discriminative information for dimension reduction (DR) has gained a surge of interest. However, it's not accessible for these DR methods to achieve satisfactory performance when facing the features from multiple views. In multi-view learning problems, one instance can be represented by multiple heterogeneous features, which are highly related but sometimes look different from each other. In addition, correlations between features from multiple views always vary greatly, which challenges the capability of multi-view learning methods. Consequently, constructing a multi-view learning framework with generalization and scalability, which could take advantage of multi-view information as much as possible, is extremely necessary but challenging. To implement the above target, this paper proposes a novel multi-view learning framework based on similarity consensus, which makes full use of correlations among multi-view features while considering the scalability and robustness of the framework. It aims to straightforwardly extend those existing DR methods into multi-view learning domain by preserving the similarity between different views to capture the low-dimensional embedding. Two schemes based on pairwise-consensus and centroid-consensus are separately proposed to force multiple views to learn from each other and then an iterative alternating strategy is developed to obtain the optimal solution. The proposed method is evaluated on 5 benchmark datasets and comprehensive experiments show that our proposed multi-view framework can yield comparable and promising performance with previous approaches proposed in recent literatures.
Multi-view Locality Low-rank Embedding for Dimension Reduction
Feng, Lin, Meng, Xiangzhu, Wang, Huibing
During the last decades, we have witnessed a surge of interests of learning a low-dimensional space with discriminative information from one single view. Even though most of them can achieve satisfactory performance in some certain situations, they fail to fully consider the information from multiple views which are highly relevant but sometimes look different from each other. Besides, correlations between features from multiple views always vary greatly, which challenges multi-view subspace learning. Therefore, how to learn an appropriate subspace which can maintain valuable information from multi-view features is of vital importance but challenging. To tackle this problem, this paper proposes a novel multi-view dimension reduction method named Multi-view Locality Low-rank Embedding for Dimension Reduction (MvL2E). MvL2E makes full use of correlations between multi-view features by adopting low-rank representations. Meanwhile, it aims to maintain the correlations and construct a suitable manifold space to capture the low-dimensional embedding for multi-view features. A centroid based scheme is designed to force multiple views to learn from each other. And an iterative alternating strategy is developed to obtain the optimal solution of MvL2E. The proposed method is evaluated on 5 benchmark datasets. Comprehensive experiments show that our proposed MvL2E can achieve comparable performance with previous approaches proposed in recent literatures.
How can banks put AI to work? Interview with Adam Shardlow at RBS
"Running a lot faster" is something big tech firms could teach banks that are yet to dip their toes in using artificial intelligence (AI), says Adam Shardlow, Lead Journey Manager for AI at the Royal Bank of Scotland (RBS), who has previously also worked for Amazon. He believes AI and machine learning (ML) makes it possible for financial institutions to personalize their offers and revolutionize the way they communicate with customers. We sat down to discuss the opportunities AI offers to banks to get a single view of the customer, enhance customer relations and boost digital sales. Adam is going to be one of the speakers at W.UP's upcoming free webinar on AI & ML on 27 June, where we will share best practices in AI that banks can put into practice with little effort. Participants will also learn all about developing AI capabilities to increase digital sales, unlocking the power of ML in analytics, real-life use cases of AI in digital banking and innovations that help banks explore AI and provide five-star user experiences.
Reliable Multi-View Clustering
Tao, Hong (National University of Defense Technology) | Hou, Chenping (National University of Defense Technology) | Liu, Xinwang (National University of Defense Technology) | Liu, Tongliang (University of Sydney) | Yi, Dongyun (National University of Defense Technology) | Zhu, Jubo (National University of Defense Technology)
With the advent of multi-view data, multi-view learning (MVL) has become an important research direction in machine learning. It is usually expected that multi-view algorithms can obtain better performance than that of merely using a single view. However, previous researches have pointed out that sometimes the utilization of multiple views may even deteriorate the performance. This will be a stumbling block for the practical use of MVL in real applications, especially for tasks requiring high dependability. Thus, it is eager to design reliable multi-view approaches, such that their performance is never degenerated by exploiting multiple views.This issue is vital but rarely studied. In this paper, we focus on clustering and propose the Reliable Multi-View Clustering (RMVC) method. Based on several candidate multi-view clusterings, RMVC maximizes the worst-case performance gain against the best single view clustering, which is equivalently expressed as no label information available. Specifically, employing the squared χ 2 distance for clustering comparison makes the formulation of RMVC easy to solve, and an efficient strategy is proposed for optimization. Theoretically, it can be proved that the performance of RMVC will never be significantly decreased under some assumption. Experimental results on a number of data sets demonstrate that the proposed method can effectively improve the reliability of multi-view clustering.
The Future of Cybersecurity Rests in AI Technology
Cybersecurity companies estimate that new malware variants are introduced at a daily rate of up to 390,000. With each hour that passes, at least 13,000 new files emerge. If you find these numbers staggering, that's because they are. Humans simply cannot keep up with them, which is why cybersecurity analysts are turning to artificial intelligence (AI) for help. Fighting the constantly evolving and morphing threat landscape requires a combination of detection and a single view of threat data, in addition to the traditional methods of signature-based malware detection and blocking.
Data-Protection Efforts Must Prepare for New Forms of Attack
Organizations already have plenty to worry about in terms of data protection, but a new type of cyberattack could prove much more damaging and harder to remediate. A destruction of service (DeOS) attack has the potential to destroy the data backups and safety nets organizations rely on to restore their systems and data following an attack, according to Cisco. DeOS attacks are a more dangerous version of distributed denial of service (DDoS), which employs botnets to overload the target organization's servers with traffic until they can no longer handle the extra load. DDoS attacks last hours or days, after which a company can resume normal operations. This is one of the many new security risks that are emerging with the Internet of Things (IoT).