Goto

Collaborating Authors

 Energy


PaCMO: Partner Dependent Human Motion Generation in Dyadic Human Activity using Neural Operators

arXiv.org Artificial Intelligence

We address the problem of generating 3D human motions in dyadic activities. In contrast to the concurrent works, which mainly focus on generating the motion of a single actor from the textual description, we generate the motion of one of the actors from the motion of the other participating actor in the action. This is a particularly challenging, under-explored problem, that requires learning intricate relationships between the motion of two actors participating in an action and also identifying the action from the motion of one actor. To address these, we propose partner conditioned motion operator (PaCMO), a neural operator-based generative model which learns the distribution of human motion conditioned by the partner's motion in function spaces through adversarial training. Our model can handle long unlabeled action sequences at arbitrary time resolution. We also introduce the "Functional Frechet Inception Distance" ($F^2ID$) metric for capturing similarity between real and generated data for function spaces. We test PaCMO on NTU RGB+D and DuetDance datasets and our model produces realistic results evidenced by the $F^2ID$ score and the conducted user study.


Quantitative Method for Security Situation of the Power Information Network Based on the Evolutionary Neural Network

arXiv.org Artificial Intelligence

Cybersecurity is the security cornerstone of digital transformation of the power grid and construction of new power systems. The traditional network security situation quantification method only analyzes from the perspective of network performance, ignoring the impact of various power application services on the security situation, so the quantification results cannot fully reflect the power information network risk state. This study proposes a method for quantifying security situation of the power information network based on the evolutionary neural network. First, the security posture system architecture is designed by analyzing the business characteristics of power information network applications. Second, combining the importance of power application business, the spatial element index system of coupled interconnection is established from three dimensions of network reliability, threat, and vulnerability. Then, the BP neural network optimized by the genetic evolutionary algorithm is incorporated into the element index calculation process, and the quantitative model of security posture of the power information network based on the evolutionary neural network is constructed. Finally, a simulation experiment environment is built according to a power sector network topology, and the effectiveness and robustness of the method proposed in the study are verified.


Active Learning and Novel Model Calibration Measurements for Automated Visual Inspection in Manufacturing

arXiv.org Artificial Intelligence

Quality control is a crucial activity performed by manufacturing enterprises to ensure that their products meet quality standards and avoid potential damage to the brand's reputation. The decreased cost of sensors and connectivity enabled increasing digitalization of manufacturing. In addition, artificial intelligence enables higher degrees of automation, reducing overall costs and time required for defect inspection. This research compares three active learning approaches, having single and multiple oracles, to visual inspection. Six new metrics are proposed to assess the quality of calibration without the need for ground truth. Furthermore, this research explores whether existing calibrators can improve their performance by leveraging an approximate ground truth to enlarge the calibration set. The experiments were performed on real-world data provided by Philips Consumer Lifestyle BV. Our results show that the explored active learning settings can reduce the data labeling effort by between three and four percent without detriment to the overall quality goals, considering a threshold of p=0.95. Furthermore, the results show that the proposed calibration metrics successfully capture relevant information otherwise available to metrics used up to date only through ground truth data. Therefore, the proposed metrics can be used to estimate the quality of models' probability calibration without committing to a labeling effort to obtain ground truth data.


Startup Uses Speech AI to Coach Contact-Center Agents

#artificialintelligence

Minerva CQ, a startup based in the San Francisco Bay Area, is making customer service calls quicker and more efficient for both agents and customers, with a focus on those in the energy sector. The NVIDIA Inception member's name is a mashup of the Roman goddess of wisdom and knowledge -- and collaborative intelligence (CQ), or the combination of human and artificial intelligence. The Minerva CQ platform coaches contact-center agents to drive customer conversations -- whether in voice or web-based chat -- toward the most effective resolutions by offering real-time dialogue suggestions, sentiment analysis and optimal journey flows based on the customer's intent. It also surfaces relevant context, articles, forms and more. Powered by the NVIDIA Riva software development kit, Minerva CQ has best-in-class automatic speech recognition (ASR) capabilities in English, Spanish and Italian.


Machine Learning for Probabilistic Prediction

#artificialintelligence

Machine Learning for Probabilistic Prediction Quantitative Finance Webinar, Stony Brook University (11/11/2022) Valery Manokhin, PhD, MBA, CFQ Speaker Bio โ€ข PhD in Machine Learning (2022) from Royal Holloway, University of London โ€ข During PhD conducted research and published papers in probabilistic and conformal prediction. PhD supervised by Prof. Vladimir Vovk, the creator of Conformal Prediction (Prof. Vladimir Vovk is the last PhD student of Andrey Kolmogorov) โ€ข Dr. Valery Manokhin holds a number of advanced MSc degrees including from the Moscow Institute of Physics and Technology (Physics/Math), UCL (Computational Statistics and Machine Learning), University of Sussex (Quant Finance) and an MBA from the University of Warwick โ€ข Published in the leading machine learning journals, including'Neurocomputing', 'Journal of Machine Learning Research' and'Machine Learning Journal', also in the industry journals including'Frontiers in Energy Research' โ€ข Created'Awesome Conformal Prediction' - the most comprehensive professionally curated resource on Conformal Prediction (over 900 stars on GitHub). 'Awesome Conformal Prediction' has been featured at the leading conferences such as ICML and in Kevin Murphy's bestselling book'Probabilistic Machine Learning: An Introduction' Outline of this webinar Introduction to Probabilistic Prediction Probability Calibration Introduction to Conformal Prediction Conformal Prediction for Classification Conformal Prediction for Regression Conclusion 3 Why Probabilistic Prediction? Machine Learning is primarily concerned with producing functions mapping objects onto predicted labels Classical statistical techniques - for small scale, low-dimensional data High-dimensional data does not necessarily follow well-known distributions and hence required new approaches (e.g.


A posteriori learning for quasi-geostrophic turbulence parametrization

arXiv.org Artificial Intelligence

The use of machine learning to build subgrid parametrizations for climate models is receiving growing attention. State-of-the-art strategies address the problem as a supervised learning task and optimize algorithms that predict subgrid fluxes based on information from coarse resolution models. In practice, training data are generated from higher resolution numerical simulations transformed in order to mimic coarse resolution simulations. By essence, these strategies optimize subgrid parametrizations to meet so-called $\textit{a priori}$ criteria. But the actual purpose of a subgrid parametrization is to obtain good performance in terms of $\textit{a posteriori}$ metrics which imply computing entire model trajectories. In this paper, we focus on the representation of energy backscatter in two dimensional quasi-geostrophic turbulence and compare parametrizations obtained with different learning strategies at fixed computational complexity. We show that strategies based on $\textit{a priori}$ criteria yield parametrizations that tend to be unstable in direct simulations and describe how subgrid parametrizations can alternatively be trained end-to-end in order to meet $\textit{a posteriori}$ criteria. We illustrate that end-to-end learning strategies yield parametrizations that outperform known empirical and data-driven schemes in terms of performance, stability and ability to apply to different flow configurations. These results support the relevance of differentiable programming paradigms for climate models in the future.


TPA-Net: Generate A Dataset for Text to Physics-based Animation

arXiv.org Artificial Intelligence

Recent breakthroughs in Vision-Language (V&L) joint research have achieved remarkable results in various text-driven tasks. High-quality Text-to-video (T2V), a task that has been long considered mission-impossible, was proven feasible with reasonably good results in latest works. However, the resulting videos often have undesired artifacts largely because the system is purely data-driven and agnostic to the physical laws. To tackle this issue and further push T2V towards high-level physical realism, we present an autonomous data generation technique and a dataset, which intend to narrow the gap with a large number of multi-modal, 3D Text-to-Video/Simulation (T2V/S) data. In the dataset, we provide high-resolution 3D physical simulations for both solids and fluids, along with textual descriptions of the physical phenomena. We take advantage of state-of-the-art physical simulation methods (i) Incremental Potential Contact (IPC) and (ii) Material Point Method (MPM) to simulate diverse scenarios, including elastic deformations, material fractures, collisions, turbulence, etc. Additionally, high-quality, multi-view rendering videos are supplied for the benefit of T2V, Neural Radiance Fields (NeRF), and other communities. This work is the first step towards fully automated Text-to-Video/Simulation (T2V/S). Live examples and subsequent work are at https://sites.google.com/view/tpa-net.


Neural Graph Databases

arXiv.org Artificial Intelligence

Graph databases (GDBs) enable processing and analysis of unstructured, complex, rich, and usually vast graph datasets. Despite the large significance of GDBs in both academia and industry, little effort has been made into integrating them with the predictive power of graph neural networks (GNNs). In this work, we show how to seamlessly combine nearly any GNN model with the computational capabilities of GDBs. For this, we observe that the majority of these systems are based on, or support, a graph data model called the Labeled Property Graph (LPG), where vertices and edges can have arbitrarily complex sets of labels and properties. We then develop LPG2vec, an encoder that transforms an arbitrary LPG dataset into a representation that can be directly used with a broad class of GNNs, including convolutional, attentional, message-passing, and even higher-order or spectral models. In our evaluation, we show that the rich information represented as LPG labels and properties is properly preserved by LPG2vec, and it increases the accuracy of predictions regardless of the targeted learning task or the used GNN model, by up to 34% compared to graphs with no LPG labels/properties. In general, LPG2vec enables combining predictive power of the most powerful GNNs with the full scope of information encoded in the LPG model, paving the way for neural graph databases, a class of systems where the vast complexity of maintained data will benefit from modern and future graph machine learning methods.


The intersection of machine learning with forecasting and optimisation: theory and applications

arXiv.org Artificial Intelligence

Forecasting and optimisation are two major fields of operations research that are widely used in practice. These methods have contributed to each other growth in several ways. However, the nature of the relationship between these two fields and integrating them have not been explored or understood enough. We advocate the integration of these two fields and explore several problems that require both forecasting and optimisation to deal with the uncertainties. We further investigate some of the methodologies that lie at the intersection of machine learning with prediction and optimisation to address real-world problems. Finally, we provide several research directions for those interested to work in this domain.


Robust fractional-order fast terminal sliding mode control of aerial manipulator derived from a mutable inertia parameters model

arXiv.org Artificial Intelligence

The coupling disturbance between the manipulator and the unmanned aerial vehicle (UAV) deteriorates the control performance of system. To get high performance of the aerial manipulator, a robust fractional order fast terminal sliding mode control (FOFTSMC) strategy based on mutable inertia parameters is proposed in this paper. First, the dynamics of aerial manipulator with consideration of the coupling disturbance is derived by utilizing mutable inertia parameters. Then, based on the dynamic model, a robust FOFTSMC algorithm is designed to make the system fly steadily under coupling disturbance. Furthermore, stability analysis is conducted to prove the convergence of tracking errors. Finally, comparative simulation results are given to show the validity and superiority of the proposed scheme.