Government
La veille de la cybersécurité
Governments can and do use artificial intelligence to direct their citizens and their policy. But are we prepared for how far it could go? Governments have access to large amounts of data which they can -- and often do -- use to analyse and predict their citizens' behaviours using artificial intelligence (AI) strategies. However while AI can help policy-makers by delivering highly accurate predictions, identifying trends and patterns, predicting complex associations and improving profitability, it may also introduce risks to citizen's privacy and security and threaten free decision-making in society. Researchers from three Universities in Spain explored these risks in a study which surveyed government officials about their institution's use of artificial intelligence.
A Brief Introduction to Facial Recognition (Part 1)
One of the most interesting avenues unlocked by Artificial Intelligence and Analytics is Facial Recognition, powered by AI & ML algorithms. We see this application in use on a daily basis- in smartphones, security stations etc. In this introductory blog, I will provide a quick walkthrough of the technology involved in Facial Recognition. Facial Recognition is a recognition technique used to detect faces of individuals whose images are saved in the data set. Despite the fact that other methods of identification may be more accurate, Facial Recognition has always remained a significant research point because of its non-invasive nature and its ease of use. There are various algorithms that can perform Facial Recognition, but their accuracy might vary.
When governments use AI to predict what the people want
Governments can and do use artificial intelligence to direct their citizens and their policy. But are we prepared for how far it could go? Governments have access to large amounts of data which they can -- and often do -- use to analyse and predict their citizens' behaviours using artificial intelligence (AI) strategies. However while AI can help policy-makers by delivering highly accurate predictions, identifying trends and patterns, predicting complex associations and improving profitability, it may also introduce risks to citizen's privacy and security and threaten free decision-making in society. Researchers from three Universities in Spain explored these risks in a study which surveyed government officials about their institution's use of artificial intelligence.
Stabilized Neural Ordinary Differential Equations for Long-Time Forecasting of Dynamical Systems
Linot, Alec J., Burby, Joshua W., Tang, Qi, Balaprakash, Prasanna, Graham, Michael D., Maulik, Romit
In data-driven modeling of spatiotemporal phenomena careful consideration often needs to be made in capturing the dynamics of the high wavenumbers. This problem becomes especially challenging when the system of interest exhibits shocks or chaotic dynamics. We present a data-driven modeling method that accurately captures shocks and chaotic dynamics by proposing a novel architecture, stabilized neural ordinary differential equation (ODE). In our proposed architecture, we learn the right-hand-side (RHS) of an ODE by adding the outputs of two NN together where one learns a linear term and the other a nonlinear term. Specifically, we implement this by training a sparse linear convolutional NN to learn the linear term and a dense fully-connected nonlinear NN to learn the nonlinear term. This is in contrast with the standard neural ODE which involves training only a single NN for learning the RHS. We apply this setup to the viscous Burgers equation, which exhibits shocked behavior, and show better short-time tracking and prediction of the energy spectrum at high wavenumbers than a standard neural ODE. We also find that the stabilized neural ODE models are much more robust to noisy initial conditions than the standard neural ODE approach. We also apply this method to chaotic trajectories of the Kuramoto-Sivashinsky equation. In this case, stabilized neural ODEs keep long-time trajectories on the attractor, and are highly robust to noisy initial conditions, while standard neural ODEs fail at achieving either of these results. We conclude by demonstrating how stabilizing neural ODEs provide a natural extension for use in reduced-order modeling by projecting the dynamics onto the eigenvectors of the learned linear term.
FedTune: Automatic Tuning of Federated Learning Hyper-Parameters from System Perspective
Zhang, Huanle, Zhang, Mi, Liu, Xin, Mohapatra, Prasant, DeLucia, Michael
Federated learning (FL) hyper-parameters significantly affect the training overheads in terms of computation time, transmission time, computation load, and transmission load. However, the current practice of manually selecting FL hyper-parameters puts a high burden on FL practitioners since various applications prefer different training preferences. In this paper, we propose FedTune, an automatic FL hyper-parameter tuning algorithm tailored to applications' diverse system requirements of FL training. FedTune is lightweight and flexible, achieving 8.48%-26.75% improvement for different datasets compared to fixed FL hyper-parameters.
Learning with Limited Samples -- Meta-Learning and Applications to Communication Systems
Chen, Lisha, Jose, Sharu Theresa, Nikoloska, Ivana, Park, Sangwoo, Chen, Tianyi, Simeone, Osvaldo
Deep learning has achieved remarkable success in many machine learning tasks such as image classification, speech recognition, and game playing. However, these breakthroughs are often difficult to translate into real-world engineering systems because deep learning models require a massive number of training samples, which are costly to obtain in practice. To address labeled data scarcity, few-shot meta-learning optimizes learning algorithms that can efficiently adapt to new tasks quickly. While meta-learning is gaining significant interest in the machine learning literature, its working principles and theoretic fundamentals are not as well understood in the engineering community. This review monograph provides an introduction to meta-learning by covering principles, algorithms, theory, and engineering applications. After introducing meta-learning in comparison with conventional and joint learning, we describe the main meta-learning algorithms, as well as a general bilevel optimization framework for the definition of meta-learning techniques. Then, we summarize known results on the generalization capabilities of meta-learning from a statistical learning viewpoint. Applications to communication systems, including decoding and power allocation, are discussed next, followed by an introduction to aspects related to the integration of meta-learning with emerging computing technologies, namely neuromorphic and quantum computing. The monograph is concluded with an overview of open research challenges.
The Real Deal: A Review of Challenges and Opportunities in Moving Reinforcement Learning-Based Traffic Signal Control Systems Towards Reality
Chen, Rex, Fang, Fei, Sadeh, Norman
Traffic signal control (TSC) is a high-stakes domain that is growing in importance as traffic volume grows globally. An increasing number of works are applying reinforcement learning (RL) to TSC; RL can draw on an abundance of traffic data to improve signalling efficiency. However, RL-based signal controllers have never been deployed. In this work, we provide the first review of challenges that must be addressed before RL can be deployed for TSC. We focus on four challenges involving (1) uncertainty in detection, (2) reliability of communications, (3) compliance and interpretability, and (4) heterogeneous road users. We show that the literature on RL-based TSC has made some progress towards addressing each challenge. However, more work should take a systems thinking approach that considers the impacts of other pipeline components on RL.
ASGNN: Graph Neural Networks with Adaptive Structure
Zhang, Zepeng, Lu, Songtao, Huang, Zengfeng, Zhao, Ziping
The graph neural network (GNN) models have presented impressive achievements in numerous machine learning tasks. However, many existing GNN models are shown to be vulnerable to adversarial attacks, which creates a stringent need to build robust GNN architectures. In this work, we propose a novel interpretable message passing scheme with adaptive structure (ASMP) to defend against adversarial attacks on graph structure. Layers in ASMP are derived based on optimization steps that minimize an objective function that learns the node feature and the graph structure simultaneously. ASMP is adaptive in the sense that the message passing process in different layers is able to be carried out over dynamically adjusted graphs. Such property allows more fine-grained handling of the noisy (or perturbed) graph structure and hence improves the robustness. Convergence properties of the ASMP scheme are theoretically established. Integrating ASMP with neural networks can lead to a new family of GNN models with adaptive structure (ASGNN). Extensive experiments on semi-supervised node classification tasks demonstrate that the proposed ASGNN outperforms the state-of-the-art GNN architectures in terms of classification performance under various adversarial attacks.
Process Modeling, Hidden Markov Models, and Non-negative Tensor Factorization with Model Selection
Skau, Erik, Hollis, Andrew, Eidenbenz, Stephan, Rasmussen, Kim, Alexandrov, Boian
Monitoring of industrial processes is a critical capability in industry and in government to ensure reliability of production cycles, quick emergency response, and national security. Process monitoring allows users to gauge the involvement of an organization in an industrial process or predict the degradation or aging of machine parts in processes taking place at a remote location. Similar to many data science applications, we usually only have access to limited raw data, such as satellite imagery, short video clips, some event logs, and signatures captured by a small set of sensors. To combat data scarcity, we leverage the knowledge of subject matter experts (SMEs) who are familiar with the process. Various process mining techniques have been developed for this type of analysis; typically such approaches combine theoretical process models built based on domain expert insights with ad-hoc integration of available pieces of raw data. Here, we introduce a novel mathematically sound method that integrates theoretical process models (as proposed by SMEs) with interrelated minimal Hidden Markov Models (HMM), built via non-negative tensor factorization and discrete model simulations. Our method consolidates: (a) Theoretical process models development, (b) Discrete model simulations (c) HMM, (d) Joint Non-negative Matrix Factorization (NMF) and Non-negative Tensor Factorization (NTF), and (e) Custom model selection. To demonstrate our methodology and its abilities, we apply it on simple synthetic and real world process models.
Movement Analytics: Current Status, Application to Manufacturing, and Future Prospects from an AI Perspective
Baumgartner, Peter, Smith, Daniel, Rana, Mashud, Kapoor, Reena, Tartaglia, Elena, Schutt, Andreas, Rahman, Ashfaqur, Taylor, John, Dunstall, Simon
Data-driven decision making is becoming an integral part of manufacturing companies. Data is collected and commonly used to improve efficiency and produce high quality items for the customers. IoT-based and other forms of object tracking are an emerging tool for collecting movement data of objects/entities (e.g. human workers, moving vehicles, trolleys etc.) over space and time. Movement data can provide valuable insights like process bottlenecks, resource utilization, effective working time etc. that can be used for decision making and improving efficiency. Turning movement data into valuable information for industrial management and decision making requires analysis methods. We refer to this process as movement analytics. The purpose of this document is to review the current state of work for movement analytics both in manufacturing and more broadly. We survey relevant work from both a theoretical perspective and an application perspective. From the theoretical perspective, we put an emphasis on useful methods from two research areas: machine learning, and logic-based knowledge representation. We also review their combinations in view of movement analytics, and we discuss promising areas for future development and application. Furthermore, we touch on constraint optimization. From an application perspective, we review applications of these methods to movement analytics in a general sense and across various industries. We also describe currently available commercial off-the-shelf products for tracking in manufacturing, and we overview main concepts of digital twins and their applications.