Goto

Collaborating Authors

 Oceania


Rk-means: Fast Clustering for Relational Data

arXiv.org Machine Learning

Conventional machine learning algorithms cannot be applied until a data matrix is available to process. When the data matrix needs to be obtained from a relational database via a feature extraction query, the computation cost can be prohibitive, as the data matrix may be (much) larger than the total input relation size. This paper introduces Rk-means, or relational k -means algorithm, for clustering relational data tuples without having to access the full data matrix. As such, we avoid having to run the expensive feature extraction query and storing its output. Our algorithm leverages the underlying structures in relational data. It involves construction of a small {\it grid coreset} of the data matrix for subsequent cluster construction. This gives a constant approximation for the k -means objective, while having asymptotic runtime improvements over standard approaches of first running the database query and then clustering. Empirical results show orders-of-magnitude speedup, and Rk-means can run faster on the database than even just computing the data matrix.


Fast and Furious Convergence: Stochastic Second Order Methods under Interpolation

arXiv.org Machine Learning

We consider stochastic second order methods for minimizing strongly-convex functions under an interpolation condition satisfied by over-parameterized models. Under this condition, we show that the regularized sub-sampled Newton method (R-SSN) achieves global linear convergence with an adaptive step size and a constant batch size. By growing the batch size for both the sub-sampled gradient and Hessian, we show that R-SSN can converge at a quadratic rate in a local neighbourhood of the solution. We also show that R-SSN attains local linear convergence for the family of self-concordant functions. Furthermore, we analyse stochastic BFGS algorithms in the interpolation setting and prove their global linear convergence. We empirically evaluate stochastic L-BFGS and a "Hessian-free" implementation of R-SSN for binary classification on synthetic, linearly-separable datasets and consider real medium-size datasets under a kernel mapping. Our experimental results show the fast convergence of these methods both in terms of the number of iterations and wall-clock time.


Estimation of Utility-Maximizing Bounds on Potential Outcomes

arXiv.org Machine Learning

Estimation of individual treatment effects is often used as the basis for contextual decision making in fields such as healthcare, education, and economics. However, in many real-world applications it is sufficient for the decision maker to have upper and lower bounds on the potential outcomes of decision alternatives, allowing them to evaluate the trade-off between benefit and risk. With this in mind, we develop an algorithm for directly learning upper and lower bounds on the potential outcomes under treatment and non-treatment. Our theoretical analysis highlights a trade-off between the complexity of the learning task and the confidence with which the resulting bounds cover the true potential outcomes; the more confident we wish to be, the more complex the learning task is. We suggest a novel algorithm that maximizes a utility function while maintaining valid potential outcome bounds. We illustrate different properties of our algorithm, and highlight how it can be used to guide decision making using two semi-simulated datasets.


Distributed Bayesian Computation for Model Choice

arXiv.org Machine Learning

We propose a general method for distributed Bayesian model choice, where each worker has access only to non-overlapping subsets of the data. Our approach approximates the model evidence for the full data set through Monte Carlo sampling from the posterior on every subset generating a model evidence per subset. The model evidences per worker are then consistently combined using a novel approach which corrects for the splitting using summary statistics of the generated samples. This divide-and-conquer approach allows Bayesian model choice in the large data setting, exploiting all available information but limiting communication between workers. Our work thereby complements the work on consensus Monte Carlo (Scott et al., 2016) by explicitly enabling model choice. In addition, we show how the suggested approach can be extended to model choice within a reversible jump setting that explores multiple models within one run.


PAC-Bayesian Contrastive Unsupervised Representation Learning

arXiv.org Machine Learning

Contrastive unsupervised representation learning (CURL) is the state-of-the-art technique to learn representations (as a set of features) from unlabelled data. While CURL has collected several empirical successes recently, theoretical understanding of its performance was still missing. In a recent work, Arora et al. ( 2019) provide the first generalisation bounds for CURL, relying on a Rademacher complexity. We extend their framework to the flexible PAC-Bayes setting, allowing to deal with the non-iid setting. We present PAC-Bayesian generalisation bounds for CURL, which are then used to derive a new representation learning algorithm. Numerical experiments on real-life datasets illustrate that our algorithm achieves competitive accuracy, and yields generalisation bounds with non-vacuous values.


The Investment in Artificial Intelligence is benefitting companies largely – Global Analytics Market

#artificialintelligence

Smarter Search is an inside created reason fabricated search motor, which uses AI to adaptively and self-sufficiently gain from applicants' searching hirers' activity advertisements on SEEK. This venture has driven the conveyance of increasingly important search results from each time an applicant searches the stage. These advantages of Smarter Search for applicants and hirers stretch out over SEEK's foundation, regardless of whether got to on portable or work area – which is urgent as more than 71 percent of visits to SEEK happen on a cell phone (31 percent versatile web and 39%). Application appearance has expanded by 25 percent and 16 percent year-on-year, with 52 percent of all applications presently submitted through portable. With 22 years of experience helping hirers and competitors associate through computerized stages, SEEK has utilized this information and family in occupation market understanding, joined with the abilities of their artificial intelligence group, to fabricate an altered AI-based search motor.


Machines as consumers: The future according to Dell Technologies ZDNet

#artificialintelligence

Dell Technologies Australia and New Zealand managing director Angela Fox has painted a future where humans and machines learn to live in harmony and machines evolve to be consumers. Delivering the Dell Technologies Forum keynote in Sydney last week, Fox discussed research that was conducted with the Institute of the Future, which looked at the next era of human-machine partnerships. Fox touched on three developments that she expects will shift the economy in the future, with the first being autonomous commerce. "We believe that you'll see machines evolving into consumers. They will use a mix of sensors, software updates, and artificial intelligence (AI) to determine when they -- and the people they serve -- are functioning sub-optimally, but more importantly, they will find ways to remedy it autonomously," Fox said.


Technologists Are Creating Artificial Intelligence to Help Us Tap Into Our Humanity. Here's How (and Why).

#artificialintelligence

When being empathetic is your full-time job, burning out is only human. Few people are more aware of this than customer service representatives, who are tasked with approaching each conversation with energy and compassion -- whether it's their first call of the day or their 60th. It's their job to make even the most difficult customer feel understood and respected while still providing them accurate information. But over the last few years, an unlikely aide has come forward: artificial intelligence tools designed to help people tap into and maintain "human" characteristics like empathy and compassion. One of these tools is a platform called Cogito, named for the famous Descartes philosophy Cogito, ergo sum ("I think, therefore I am").



Robotics 2020 Robotics Conferences Artificial Intelligence Conferences Machine Learning Conferences Mechatronics Conferences France

#artificialintelligence

Robotics is a combination of engineering and technology, which includes mechanical engineering, electronics engineering, computer science, and other engineering domains. Robotics is one of the emerging fields now in the industry. Now in approximately every sector robots are using for making simple the situations. For a robotic process, the system requires a combination of software and physical components such as power supply, actuators, sensors, locomotive parts, storage devices, and control software. Robotics is now widely used in military, security, construction, and field of medical, agriculture, household operation, and education.