Goto

Collaborating Authors

 Country


Learning to Self-Train for Semi-Supervised Few-Shot Classification

arXiv.org Machine Learning

Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a classification model for FSC. In this paper we propose a novel semi-supervised meta-learning method called learning to self-train (LST) that leverages unlabeled data and specifically meta-learns how to cherry-pick and label such unsupervised data to further improve performance. To this end, we train the LST model through a large number of semi-supervised few-shot tasks. On each task, we train a few-shot model to predict pseudo labels for unlabeled data, and then iterate the self-training steps on labeled and pseudo-labeled data with each step followed by fine-tuning. We additionally learn a soft weighting network (SWN) to optimize the self-training weights of pseudo labels so that better ones can contribute more to gradient descent optimization. We evaluate our LST method on two ImageNet benchmarks for semi-supervised few-shot classification and achieve large improvements over the state-of-the-art.


Analysis of high-dimensional Continuous Time Markov Chains using the Local Bouncy Particle Sampler

arXiv.org Machine Learning

Sampling the parameters of high-dimensional Continuous Time Markov Chains (CTMC) is a challenging problem with important applications in many fields of applied statistics. In this work a recently proposed type of non-reversible rejection-free Markov Chain Monte Carlo (MCMC) sampler, the Bouncy Particle Sampler (BPS), is brought to bear to this problem. BPS has demonstrated its favorable computational efficiency compared with state-of-the-art MCMC algorithms, however to date applications to real-data scenario were scarce. An important aspect of the practical implementation of BPS is the simulation of event times. Default implementations use conservative thinning bounds. Such bounds can slow down the algorithm and limit the computational performance. Our paper develops an algorithm with an exact analytical solution to the random event times in the context of CTMCs. Our local version of BPS algorithm takes advantage of the sparse structure in the target factor graph and we also provide a framework for assessing the computational complexity of local BPS algorithms.


An Effective Multi-Resolution Hierarchical Granular Representation based Classifier using General Fuzzy Min-Max Neural Network

arXiv.org Machine Learning

Motivated by the practical demands for simplification of data towards being consistent with human thinking and problem solving as well as tolerance of uncertainty, information granules are becoming important entities in data processing at different levels of data abstraction. This paper proposes a method to construct classifiers from multi-resolution hierarchical granular representations (MRHGRC) using hyperbox fuzzy sets. The proposed approach forms a series of granular inferences hierarchically through many levels of abstraction. An attractive characteristic of our classifier is that it can maintain relatively high accuracy at a low degree of granularity based on reusing the knowledge learned from lower levels of abstraction. In addition, our approach can reduce the data size significantly as well as handling the uncertainty and incompleteness associated with data in real-world applications. The construction process of the classifier consists of two phases. The first phase is to formulate the model at the greatest level of granularity, while the later stage aims to reduce the complexity of the constructed model and deduce it from data at higher abstraction levels. Experimental outcomes conducted comprehensively on both synthetic and real datasets indicated the efficiency of our method in terms of training time and predictive performance in comparison to other types of fuzzy min-max neural networks and common machine learning algorithms.


Are Graph Neural Networks Miscalibrated?

arXiv.org Machine Learning

Graph Neural Networks (GNNs) have proven to be successful in many classification tasks, outperforming previous state-of-the-art methods in terms of accuracy. However, accuracy alone is not enough for high-stakes decision making. Decision makers want to know the likelihood that a specific GNN prediction is correct. For this purpose, obtaining calibrated models is essential. In this work, we perform an empirical evaluation of the calibration of state-of-the-art GNNs on multiple datasets. Our experiments show that GNNs can be calibrated in some datasets but also badly miscalibrated in others, and that state-of-the-art calibration methods are helpful but do not fix the problem.


The Computational Structure of Unintentional Meaning

arXiv.org Artificial Intelligence

Speech-acts can have literal meaning as well as pragmatic meaning, but these both involve consequences typically intended by a speaker. Speech-acts can also have unintentional meaning, in which what is conveyed goes above and beyond what was intended. Here, we present a Bayesian analysis of how, to a listener, the meaning of an utterance can significantly differ from a speaker's intended meaning. Our model emphasizes how comprehending the intentional and unintentional meaning of speech-acts requires listeners to engage in sophisticated model-based perspective-taking and reasoning about the history of the state of the world, each other's actions, and each other's observations. To test our model, we have human participants make judgments about vignettes where speakers make utterances that could be interpreted as intentional insults or unintentional faux pas. In elucidating the mechanics of speech-acts with unintentional meanings, our account provides insight into how communication both functions and malfunctions.


On Privacy Protection of Latent Dirichlet Allocation Model Training

arXiv.org Artificial Intelligence

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for discovery of hidden semantic architecture of text datasets, and plays a fundamental role in many machine learning applications. However, like many other machine learning algorithms, the process of training a LDA model may leak the sensitive information of the training datasets and bring significant privacy risks. To mitigate the privacy issues in LDA, we focus on studying privacy-preserving algorithms of LDA model training in this paper. In particular, we first develop a privacy monitoring algorithm to investigate the privacy guarantee obtained from the inherent randomness of the Collapsed Gibbs Sampling (CGS) process in a typical LDA training algorithm on centralized curated datasets. Then, we further propose a locally private LDA training algorithm on crowdsourced data to provide local differential privacy for individual data contributors. The experimental results on real-world datasets demonstrate the effectiveness of our proposed algorithms.


Training Neural Machine Translation To Apply Terminology Constraints

arXiv.org Artificial Intelligence

This paper proposes a novel method to inject custom terminology into neural machine translation at run time. Previous works have mainly proposed modifications to the decoding algorithm in order to constrain the output to include run-time-provided target terms. While being effective, these constrained decoding methods add, however, significant computational overhead to the inference step, and, as we show in this paper, can be brittle when tested in realistic conditions. In this paper we approach the problem by training a neural MT system to learn how to use custom terminology when provided with the input. Comparative experiments show that our method is not only more effective than a state-of-the-art implementation of constrained decoding, but is also as fast as constraint-free decoding.


Meta Reinforcement Learning with Task Embedding and Shared Policy

arXiv.org Artificial Intelligence

Despite significant progress, deep reinforcement learning (RL) suffers from data-inefficiency and limited generalization. Recent efforts apply meta-learning to learn a meta-learner from a set of RL tasks such that a novel but related task could be solved quickly. Though specific in some ways, different tasks in meta-RL are generally similar at a high level. However, most meta-RL methods do not explicitly and adequately model the specific and shared information among different tasks, which limits their ability to learn training tasks and to generalize to novel tasks. In this paper, we propose to capture the shared information on the one hand and meta-learn how to quickly abstract the specific information about a task on the other hand. Methodologically, we train an SGD meta-learner to quickly optimize a task encoder for each task, which generates a task embedding based on past experience. Meanwhile, we learn a policy which is shared across all tasks and conditioned on task embeddings. Empirical results on four simulated tasks demonstrate that our method has better learning capacity on both training and novel tasks and attains up to 3 to 4 times higher returns compared to baselines.


BAE Systems Partners with UiPath to Expedite Machine Learning Adoption across the U.S. Defense and Intelligence Communities

#artificialintelligence

BAE Systems is a technology partner with robotic process automation (RPA) leader, UiPath, in developing suites of software robots that its customers can use to automate high-volume, repetitive business processes. This press release features multimedia. BAE Systems is now a technology partner with robotic process automation leader, UiPath, to integrate machine learning capabilities into defense and intelligence community programs. "RPAs fuel machine learning tools by feeding them high volumes of structured data necessary for it to begin learning and improving automatically, without being programmed," said Don DeSanto, director of strategic partnerships for the BAE Systems Intelligence & Security sector. "Human-machine teaming is the future of technology, and RPAs serve as workforce multipliers that can be designed to automate many common tasks performed in organizations every day."


Global Artificial Intelligence (AI) in Construction Market 2018-2024: Industrial Output, Import & Export, Consumer Consumption and Forecast 2024 – The Scripps Voice

#artificialintelligence

Artificial Intelligence (AI) in Construction Market reports provides 5 year pre-historic and forecast for the sector and include data on socio-economic data of global. Key stakeholders can consider statistics, tables & figures mentioned in this report for strategic planning which lead to success of the organization.Artificial Intelligence (AI) in Construction Market reports provides a comprehensive overview of the global market size and share. Global Artificial Intelligence (AI) in Construction Market report provides strategists, marketers and senior management with the critical information they need to assess the global Artificial Intelligence (AI) in Construction sector. With the slowdown in world economic growth, the Keyword industry has also suffered a certain impact, but still maintained a relatively optimistic growth, the past four years, Keyword market size to maintain the average annual growth rate of XXX from XXX million $ in 2015 to XXX million $ in 2018, Industry Report analysts believe that in the next few years, Keyword market size will be further expanded, we expect that by 2024, The market size of the Keyword will reach XXX million $. The overviews, SWOT analysis and strategies of each vendor in the Artificial Intelligence (AI) in Construction market provide understanding about the market forces and how those can be exploited to create future opportunities.