Goto

Collaborating Authors

 Europe


Ethics must be at centre of AI technology, says Lords report

#artificialintelligence

The House of Lords Select Committee on Artificial Intelligence has asked the Law Commission to investigate whether UK law is "sufficient" when systems … comes as part of a report by the 13-member committee on the "economic, ethical and social implications of advances in artificial intelligence".


Ultimate Neural Nets and Deep Learning Masterclass in Python

@machinelearnbot

My course does exactly what the title describes in a simple, relatable way. I help you to grasp the complete start to end concepts of fundamental deep learning. On your own it can be quite confusing, difficult and frustrating. I've been through the process myself, and with the help of lifelong ... I want to share this with my fellow beginners, developers, AI aspirers, with you. I will give you straightforward examples, instructions, advice, insights and resources for you to take simple steps to create your own neural networks from scratch.


AI must be 'for common good'

#artificialintelligence

Ethics should be at the centre of the development of artificial intelligence (AI), a parliamentary report has said. AI should "never" be given the "autonomous power to hurt, destroy or deceive" people, it adds. The Lords' report said the UK has the potential to be a leader in developing AI and called on the government to support businesses in the field. It also recommended that people be educated to work alongside AI in the jobs of the future. It said that such education would "mitigate the negative effects" on jobs which are possible as AI develops.


Cambridge Analytica scandal 'highlights need for AI regulation'

The Guardian

Britain needs to lead the way on artificial intelligence regulation, in order to prevent companies such as Cambridge Analytica setting precedents for dangerous and unethical use of the technology, the head of the House of Lords select committee on AI has warned. The Cambridge Analytica scandal, Lord Clement-Jones said, reinforced the committee's findings, released on Monday in the report "AI in the UK: ready, willing and able?" "These principles do come to life a little bit when you think about the Cambridge Analytica situation," he told the Guardian. "Whether or not the data analytics they carried out was actually using AI … It gives an example of where it's important that we do have strong intelligibility of what the hell is going on with our data." Clement-Jones added: "With the whole business in [the US] Congress and Cambridge Analytica, the political climate in the west now is much riper in terms of people agreeing to … a more public response to the ethics and so on involved. It isn't just going to be left to Silicon Valley to decide the principles."


Can Neural Machine Translation be Improved with User Feedback?

arXiv.org Machine Learning

We present the first real-world application of methods for improving neural machine translation (NMT) with human reinforcement, based on explicit and implicit user feedback collected on the eBay e-commerce platform. Previous work has been confined to simulation experiments, whereas in this paper we work with real logged feedback for offline bandit learning of NMT parameters. We conduct a thorough analysis of the available explicit user judgments---five-star ratings of translation quality---and show that they are not reliable enough to yield significant improvements in bandit learning. In contrast, we successfully utilize implicit task-based feedback collected in a cross-lingual search task to improve task-specific and machine translation quality metrics.


Global Robustness Evaluation of Deep Neural Networks with Provable Guarantees for L0 Norm

arXiv.org Machine Learning

Deployment of deep neural networks (DNNs) in safety or security-critical systems demands provable guarantees on their correct behaviour. One example is the robustness of image classification decisions, defined as the invariance of the classification for a given input over a small neighbourhood of images around the input. Here we focus on the L_0 norm, and study the problem of quantifying the global robustness of a trained DNN, where global robustness is defined as the expectation of the maximum safe radius over a testing dataset. We first show that the problem is NP-hard, and then propose an approach to iteratively generate lower and upper bounds on the network's robustness. The approach is anytime, i.e., it returns intermediate bounds and robustness estimates that are gradually, but strictly, improved as the computation proceeds; tensor-based, i.e., the computation is conducted over a set of inputs simultaneously, instead of one by one, to enable efficient GPU computation; and has provable guarantees, i.e., both the bounds and the robustness estimates can converge to their optimal values. Finally, we demonstrate the utility of the proposed approach in practice to compute tight bounds by applying and adapting the anytime algorithm to a set of challenging problems, including global robustness evaluation, guidance for the design of robust DNNs, competitive $L_0$ attacks, generation of saliency maps for model interpretability, and test generation for DNNs. We release the code of all case studies via Github.


SPSA-FSR: Simultaneous Perturbation Stochastic Approximation for Feature Selection and Ranking

arXiv.org Machine Learning

This manuscript presents the following: (1) an improved version of the Binary Simultaneous Perturbation Stochastic Approximation (SPSA) Method for feature selection in machine learning (Aksakalli and Malekipirbazari, Pattern Recognition Letters, Vol. 75, 2016) based on non-monotone iteration gains computed via the Barzilai and Borwein (BB) method, (2) its adaptation for feature ranking, and (3) comparison against popular methods on public benchmark datasets. The improved method, which we call SPSA-FSR, dramatically reduces the number of iterations required for convergence without impacting solution quality. SPSA-FSR can be used for feature ranking and feature selection both for classification and regression problems. After a review of the current state-of-the-art, we discuss our improvements in detail and present three sets of computational experiments: (1) comparison of SPSA-FS as a (wrapper) feature selection method against sequential methods as well as genetic algorithms, (2) comparison of SPSA-FS as a feature ranking method in a classification setting against random forest importance, chi-squared, and information main methods, and (3) comparison of SPSA-FS as a feature ranking method in a regression setting against minimum redundancy maximum relevance (MRMR), RELIEF, and linear correlation methods. The number of features in the datasets we use range from a few dozens to a few thousands. Our results indicate that SPSA-FS converges to a good feature set in no more than 100 iterations and therefore it is quite fast for a wrapper method. SPSA-FS also outperforms popular feature selection as well as feature ranking methods in majority of test cases, sometimes by a large margin, and it stands as a promising new feature selection and ranking method.


Application of the Ranking Relative Principal Component Attributes Network Model (REL-PCANet) for the Inclusive Development Index Estimation

arXiv.org Machine Learning

In 2018, at the World Economic Forum in Davos it was presented a new countries' economic performance metric named the Inclusive Development Index (IDI) composed of 12 indicators. The new metric implies that countries might need to realize structural reforms for improving both economic expansion and social inclusion performance. That is why, it is vital for the IDI calculation method to have strong statistical and mathematical basis, so that results are accurate and transparent for public purposes. In the current work, we propose a novel approach for the IDI estimation - the Ranking Relative Principal Component Attributes Network Model (REL-PCANet). The model is based on RELARM and RankNet principles and combines elements of PCA, techniques applied in image recognition and learning to rank mechanisms. Also, we define a new approach for estimation of target probabilities matrix to reflect dynamic changes in countries' inclusive development. Empirical study proved that REL-PCANet ensures reliable and robust scores and rankings, thus is recommended for practical implementation.


BELIEF: A distance-based redundancy-proof feature selection method for Big Data

arXiv.org Machine Learning

With the advent of Big Data era, data reduction methods are highly demanded given its ability to simplify huge data, and ease complex learning processes. Concretely, algorithms that are able to filter relevant dimensions from a set of millions are of huge importance. Although effective, these techniques suffer from the "scalability" curse as well. In this work, we propose a distributed feature weighting algorithm, which is able to rank millions of features in parallel using large samples. This method, inspired by the well-known RELIEF algorithm, introduces a novel redundancy elimination measure that provides similar schemes to those based on entropy at a much lower cost. It also allows smooth scale up when more instances are demanded in feature estimations. Empirical tests performed on our method show its estimation ability in manifold huge sets --both in number of features and instances--, as well as its simplified runtime cost (specially, at the redundancy detection step).


Improving Temporal Relation Extraction with a Globally Acquired Statistical Resource

arXiv.org Artificial Intelligence

Extracting temporal relations (before, after, overlapping, etc.) is a key aspect of understanding events described in natural language. We argue that this task would gain from the availability of a resource that provides prior knowledge in the form of the temporal order that events usually follow. This paper develops such a resource -- a probabilistic knowledge base acquired in the news domain -- by extracting temporal relations between events from the New York Times (NYT) articles over a 20-year span (1987--2007). We show that existing temporal extraction systems can be improved via this resource. As a byproduct, we also show that interesting statistics can be retrieved from this resource, which can potentially benefit other time-aware tasks. The proposed system and resource are both publicly available.