Goto

Collaborating Authors

 Government


Improving computer vision for AI

#artificialintelligence

Led by Sumit Jha, professor in the Department of Computer Science at UTSA, the team has changed the conventional approach employed in explaining machine learning decisions that relies on a single injection of noise into the input layer of a neural network. The team shows that adding noise -- also known as pixilation -- along multiple layers of a network provides a more robust representation of an image that's recognized by the AI and creates more robust explanations for AI decisions. This work aids in the development of what's been called "explainable AI" which seeks to enable high-assurance applications of AI such as medical imaging and autonomous driving. "It's about injecting noise into every layer," Jha said. "The network is now forced to learn a more robust representation of the input in all of its internal layers. If every layer experiences more perturbations in every training, then the image representation will be more robust and you won't see the AI fail just because you change a few pixels of the input image."


More than half of Europeans want to replace lawmakers with AI, study says

#artificialintelligence

A study has found that most Europeans would like to see some of their members of parliament replaced by algorithms. Researchers at IE University's Center for the Governance of Change asked 2,769 people from 11 countries worldwide how they would feel about reducing the number of national parliamentarians in their country and giving those seats to an AI that would have access to their data. The results, published Thursday, showed that despite AI's clear and obvious limitations, 51% of Europeans said they were in favor of such a move. Oscar Jonsson, academic director at IE University's Center for the Governance of Change and one of the report's main researchers, told CNBC that there's been a "decades long decline of belief in democracy as a form of governance." The reasons are likely linked to increased political polarization, filter bubbles and information splintering, he said.


The Future of Computational Linguistics: On Beyond Alchemy

#artificialintelligence

Over the decades, fashions in Computational Linguistics have changed again and again, with major shifts in motivations, methods and applications. When digital computers first appeared, linguistic analysis adopted the new methods of information theory, which accorded well with the ideas that dominated psychology and philosophy. Then came formal language theory and the idea of AI as applied logic, in sync with the development of cognitive science. That was followed by a revival of 1950s-style empiricismโ€”AI as applied statisticsโ€”which in turn was followed by the age of deep nets. There are signs that the climate is changing again, and we offer some thoughts about paths forward, especially for younger researchers who will soon be the leaders.


Changing the World by Changing the Data

arXiv.org Artificial Intelligence

NLP community is currently investing a lot more research and resources into development of deep learning models than training data. While we have made a lot of progress, it is now clear that our models learn all kinds of spurious patterns, social biases, and annotation artifacts. Algorithmic solutions have so far had limited success. An alternative that is being actively discussed is more careful design of datasets so as to deliver specific signals. This position paper maps out the arguments for and against data curation, and argues that fundamentally the point is moot: curation already is and will be happening, and it is changing the world. The question is only how much thought we want to invest into that process.


Using Convolutional Neural Networks for Relative Pose Estimation of a Non-Cooperative Spacecraft with Thermal Infrared Imagery

arXiv.org Artificial Intelligence

Recent interest in on-orbit servicing and Active Debris Removal (ADR) missions have driven the need for technologies to enable non-cooperative rendezvous manoeuvres. Such manoeuvres put heavy burden on the perception capabilities of a chaser spacecraft. This paper demonstrates Convolutional Neural Networks (CNNs) capable of providing an initial coarse pose estimation of a target from a passive thermal infrared camera feed. Thermal cameras offer a promising alternative to visible cameras, which struggle in low light conditions and are susceptible to overexposure. Often, thermal information on the target is not available a priori; this paper therefore proposes using visible images to train networks. The robustness of the models is demonstrated on two different targets, first on synthetic data, and then in a laboratory environment for a realistic scenario that might be faced during an ADR mission. Given that there is much concern over the use of CNN in critical applications due to their black box nature, we use innovative techniques to explain what is important to our network and fault conditions.


Rejection sampling from shape-constrained distributions in sublinear time

arXiv.org Machine Learning

We consider the task of generating exact samples from a target distribution, known up to normalization, over a finite alphabet. The classical algorithm for this task is rejection sampling, and although it has been used in practice for decades, there is surprisingly little study of its fundamental limitations. In this work, we study the query complexity of rejection sampling in a minimax framework for various classes of discrete distributions. Our results provide new algorithms for sampling whose complexity scales sublinearly with the alphabet size. When applied to adversarial bandits, we show that a slight modification of the Exp3 algorithm reduces the per-iteration complexity from $\mathcal O(K)$ to $\mathcal O(\log^2 K)$, where $K$ is the number of arms.


Support vector machines and linear regression coincide with very high-dimensional features

arXiv.org Machine Learning

The support vector machine (SVM) and minimum Euclidean norm least squares regression are two fundamentally different approaches to fitting linear models, but they have recently been connected in models for very high-dimensional data through a phenomenon of support vector proliferation, where every training example used to fit an SVM becomes a support vector. In this paper, we explore the generality of this phenomenon and make the following contributions. First, we prove a super-linear lower bound on the dimension (in terms of sample size) required for support vector proliferation in independent feature models, matching the upper bounds from previous works. We further identify a sharp phase transition in Gaussian feature models, bound the width of this transition, and give experimental support for its universality. Finally, we hypothesize that this phase transition occurs only in much higher-dimensional settings in the $\ell_1$ variant of the SVM, and we present a new geometric characterization of the problem that may elucidate this phenomenon for the general $\ell_p$ case.


The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider

arXiv.org Machine Learning

We describe the outcome of a data challenge conducted as part of the Dark Machines Initiative and the Les Houches 2019 workshop on Physics at TeV colliders. The challenged aims at detecting signals of new physics at the LHC using unsupervised machine learning algorithms. First, we propose how an anomaly score could be implemented to define model-independent signal regions in LHC searches. We define and describe a large benchmark dataset, consisting of >1 Billion simulated LHC events corresponding to $10~\rm{fb}^{-1}$ of proton-proton collisions at a center-of-mass energy of 13 TeV. We then review a wide range of anomaly detection and density estimation algorithms, developed in the context of the data challenge, and we measure their performance in a set of realistic analysis environments. We draw a number of useful conclusions that will aid the development of unsupervised new physics searches during the third run of the LHC, and provide our benchmark dataset for future studies at https://www.phenoMLdata.org. Code to reproduce the analysis is provided at https://github.com/bostdiek/DarkMachines-UnsupervisedChallenge.


AI Runs Into Skepticism From Cybersecurity Experts - AI Trends

#artificialintelligence

How effectively AI can be applied to cybersecurity was the subject of some debate at the RSA Security Conference held virtually from May 17-20. The event featured a virtual show "floor" of some 45 vendors offering various AI and machine learning capabilities for cybersecurity, and a program track dedicated to security-focused AI, according to an account in VentureBeat. Skepticism was high enough that Mitre Corp. developed an assessment tool to help buyers assess the AI and machine learning content of cybersecurity offerings. The AI Relevance Competence Cost Score (ARCCS) seeks to give defenders a way to question vendors about their AI claims, in much the same way they would assess other basic security functionality. Mitre is a US non-profit organization that manages federally funded R&D centers supporting several US government agencies.


FDA Plans Oversight for AI Medical Devices, Addressing Bias

#artificialintelligence

Part of the FDA's action plan includes support for the development of machine learning best practices to evaluate and improve ML algorithms for topics such as data management, interpretability and documentation, as well as advancing real-world performance monitoring pilots. The FDA also noted that the action plan would continue to evolve to stay current with developments in the field of AI/ML-based software as a medical device (SaMD). As the agency pointed out in an April 2019 discussion paper, the potential power of AI/ML-based SaMD lies within its ability to continuously learn, where the adaptation or change to the algorithm is realized after the SaMD is distributed for use and has learned from real-world experience. READ MORE: AI can increase efficiency in healthcare, even in a pandemic. In turn, the autonomous and adaptive nature of these tools requires a new, total product lifecycle regulatory approach that supports a rapid cycle of product improvement, allowing SaMD to continually improve.