Goto

Collaborating Authors

 Overview


On the minimax optimality and superiority of deep neural network learning over sparse parameter spaces

arXiv.org Machine Learning

Deep learning has been applied to various tasks in the field of machine learning and has shown superiority to other common procedures such as kernel methods. To provide a better theoretical understanding of the reasons for its success, we discuss the performance of deep learning and other methods on a nonparametric regression problem with a Gaussian noise. Whereas existing theoretical studies of deep learning have been based mainly on mathematical theories of well-known function classes such as H\"{o}lder and Besov classes, we focus on function classes with discontinuity and sparsity, which are those naturally assumed in practice. To highlight the effectiveness of deep learning, we compare deep learning with a class of linear estimators representative of a class of shallow estimators. It is shown that the minimax risk of a linear estimator on the convex hull of a target function class does not differ from that of the original target function class. This results in the suboptimality of linear methods over a simple but non-convex function class, on which deep learning can attain nearly the minimax-optimal rate. In addition to this extreme case, we consider function classes with sparse wavelet coefficients. On these function classes, deep learning also attains the minimax rate up to log factors of the sample size, and linear methods are still suboptimal if the assumed sparsity is strong. We also point out that the parameter sharing of deep neural networks can remarkably reduce the complexity of the model in our setting.


A Coupled Operational Semantics for Goals and Commitments

Journal of Artificial Intelligence Research

Commitments capture how an agent relates to another agent, whereas goals describe states of the world that an agent is motivated to bring about. Commitments are elements of the social state of a set of agents whereas goals are elements of the private states of individual agents. It makes intuitive sense that goals and commitments are understood as being complementary to each other. More importantly, an agent's goals and commitments ought to be coherent, in the sense that an agent's goals would lead it to adopt or modify relevant commitments and an agent's commitments would lead it to adopt or modify relevant goals. However, despite the intuitive naturalness of the above connections, they have not been adequately studied in a formal framework. This article provides a combined operational semantics for goals and commitments by relating their respective life cycles as a basis for how these concepts (1) cohere for an individual agent and (2) engender cooperation among agents.


Cooperative Automated Vehicles: a Review of Opportunities and Challenges in Socially Intelligent Vehicles Beyond Networking

arXiv.org Artificial Intelligence

The connected automated vehicle has been often touted as a technology that will become pervasive in society in the near future. One can view an automated vehicle as having Artificial Intelligence (AI) capabilities, being able to self-drive, sense its surroundings, recognise objects in its vicinity, and perform reasoning and decision-making. Rather than being stand alone, we examine the need for automated vehicles to cooperate and interact within their socio-cyber-physical environments, including the problems cooperation will solve, but also the issues and challenges. We review current work in cooperation for automated vehicles, based on selected examples from the literature. We conclude noting the need for the ability to behave cooperatively as a form of social-AI capability for automated vehicles, beyond sensing the immediate environment and beyond the underlying networking technology.


Deep Reinforcement Learning for Detecting Malicious Websites

arXiv.org Machine Learning

Phishing is the simplest form of cybercrime with the objective of baiting people into giving away delicate information such as individually recognizable data, banking and credit card details, or even credentials and passwords. This type of simple yet most effective cyber-attack is usually launched through emails, phone calls, or instant messages. The credential or private data stolen are then used to get access to critical records of the victims and can result in extensive fraud and monetary loss. Hence, sending malicious messages to victims is a stepping stone of the phishing procedure. A phisher usually setups a deceptive website, where the victims are conned into entering credentials and sensitive information. It is therefore important to detect these types of malicious websites before causing any harmful damages to victims. Inspired by the evolving nature of the phishing websites, this paper introduces a novel approach based on deep reinforcement learning to model and detect malicious URLs. The proposed model is capable of adapting to the dynamic behavior of the phishing websites and thus learn the features associated with phishing website detection. I. INTRODUCTION Phishing is a form of cyber attack typically performed by sending false correspondences that seem to be originated from a legitimate source.


Seeing rough road ahead, Ford sheds 7,000 white-collar jobs

The Japan Times

DETROIT - Ford revealed details of its long-awaited restructuring plan Monday as it prepared for a future of electric and autonomous vehicles by parting ways with 7,000 white-collar workers worldwide, about 10 percent of its global salaried workforce. The major revamp, which had been underway since last year, will save about $600 million per year by eliminating bureaucracy and increasing the number of workers reporting to each manager. In the U.S. about 2,300 jobs will be cut through buyouts and layoffs. About 1,500 have left voluntarily or with buyouts, while another 300 have already been laid off. About 500 workers will be let go starting this week, largely in and around the company's headquarters in Dearborn, Michigan, just outside Detroit.


Explainable Machine Learning for Scientific Insights and Discoveries

arXiv.org Machine Learning

Machine learning methods have been remarkably successful for a wide range of application areas in the extraction of essential information from data. An exciting and relatively recent development is the uptake of machine learning in the natural sciences, where the major goal is to obtain novel scientific insights and discoveries from observational or simulated data. A prerequisite for obtaining a scientific outcome is domain knowledge, which is needed to gain explainability, but also to enhance scientific consistency. In this article we review explainable machine learning in view of applications in the natural sciences and discuss three core elements which we identified as relevant in this context: transparency, interpretability, and explainability. With respect to these core elements, we provide a survey of recent scientific works incorporating machine learning, and in particular to the way that explainable machine learning is used in their respective application areas.


Deep Signatures

arXiv.org Machine Learning

The signature is an infinite graded sequence of statistics known to characterise a stream of data up to a negligible equivalence class. It is a transform which has previously been treated as a fixed feature transformation, on top of which a model may be built. We propose a novel approach which combines the advantages of the signature transform with modern deep learning frameworks. By learning an augmentation of the stream prior to the signature transform, the terms of the signature may be selected in a data-dependent way. More generally, we describe how the signature transform may be used as a layer anywhere within a neural network. In this context it may be interpreted as an activation function not operating element-wise. We present the results of empirical experiments to back up the theoretical justification.


Visual Analytics of Anomalous User Behaviors: A Survey

arXiv.org Machine Learning

The increasing accessibility of data provides substantial opportunities for understanding user behaviors. Unearthing anomalies in user behaviors is of particular importance as it helps signal harmful incidents such as network intrusions, terrorist activities, and financial frauds. Many visual analytics methods have been proposed to help understand user behavior-related data in various application domains. In this work, we survey the state of art in visual analytics of anomalous user behaviors and classify them into four categories including social interaction, travel, network communication, and transaction. We further examine the research works in each category in terms of data types, anomaly detection techniques, and visualization techniques, and interaction methods. Finally, we discuss the findings and potential research directions.


Prediction of Construction Cost for Field Canals Improvement Projects in Egypt

arXiv.org Artificial Intelligence

Field canals improvement projects (FCIPs) are one of the ambitious projects constructed to save fresh water. To finance this project, Conceptual cost models are important to accurately predict preliminary costs at the early stages of the project. The first step is to develop a conceptual cost model to identify key cost drivers affecting the project. Therefore, input variables selection remains an important part of model development, as the poor variables selection can decrease model precision. The study discovered the most important drivers of FCIPs based on a qualitative approach and a quantitative approach. Subsequently, the study has developed a parametric cost model based on machine learning methods such as regression methods, artificial neural networks, fuzzy model and case-based reasoning.


AI investment by country – survey

#artificialintelligence

With leaders increasingly seeing artificial intelligence (AI) as helping to drive the next great economic expansion, a fear of missing out is spreading around the globe. Numerous nations have developed AI strategies to advance their capabilities, through investment, incentives, talent development, and risk management. As AI's importance to the next generation of technology grows, many leaders are worried that they will be left behind and not share in the gains. There is a growing realization of AI's importance, including its ability to provide competitive advantage and change work for the better. A majority of global early adopters say that AI technologies are especially important to their business success today--a belief that is increasing. A majority also say they are using AI technologies to move ahead of their competition, and that AI empowers their workforce. AI success depends on getting the execution right. Organizations often must excel at a wide range of practices to ensure AI success, including developing a strategy, pursuing the right use cases, building a data foundation, and cultivating a strong ability to experiment. These capabilities are critical now because, as AI becomes even easier to consume, the window for competitive differentiation will likely shrink. Early adopters from different countries display varying levels of AI maturity. Enthusiasm and experience vary among early adopters from different countries. Some are pursuing AI vigorously, while others are taking a more cautious approach.