Goto

Collaborating Authors

 Country


Gradient Surgery for Multi-Task Learning

arXiv.org Machine Learning

While deep learning and deep reinforcement learning (RL) systems have demonstrated impressive results in domains such as image classification, game playing, and robotic control, data efficiency remains a major challenge. Multi-task learning has emerged as a promising approach for sharing structure across multiple tasks to enable more efficient learning. However, the multi-task setting presents a number of optimization challenges, making it difficult to realize large efficiency gains compared to learning tasks independently. The reasons why multi-task learning is so challenging compared to single-task learning are not fully understood. In this work, we identify a set of three conditions of the multi-task optimization landscape that cause detrimental gradient interference, and develop a simple yet general approach for avoiding such interference between task gradients. We propose a form of gradient surgery that projects a task's gradient onto the normal plane of the gradient of any other task that has a conflicting gradient. On a series of challenging multi-task supervised and multi-task RL problems, this approach leads to substantial gains in efficiency and performance. Further, it is model-agnostic and can be combined with previously-proposed multi-task architectures for enhanced performance.


Image denoising via K-SVD with primal-dual active set algorithm

arXiv.org Machine Learning

K-SVD algorithm has been successfully applied to image denoising tasks dozens of years but the big bottleneck in speed and accuracy still needs attention to break. For the sparse coding stage in K-SVD, which involves $\ell_{0}$ constraint, prevailing methods usually seek approximate solutions greedily but are less effective once the noise level is high. The alternative $\ell_{1}$ optimization is proved to be powerful than $\ell_{0}$, however, the time consumption prevents it from the implementation. In this paper, we propose a new K-SVD framework called K-SVD$_P$ by applying the Primal-dual active set (PDAS) algorithm to it. Different from the greedy algorithms based K-SVD, the K-SVD$_P$ algorithm develops a selection strategy motivated by KKT (Karush-Kuhn-Tucker) condition and yields to an efficient update in the sparse coding stage. Since the K-SVD$_P$ algorithm seeks for an equivalent solution to the dual problem iteratively with simple explicit expression in this denoising problem, speed and quality of denoising can be reached simultaneously. Experiments are carried out and demonstrate the comparable denoising performance of our K-SVD$_P$ with state-of-the-art methods.


Algebraic and Analytic Approaches for Parameter Learning in Mixture Models

arXiv.org Machine Learning

We present two different approaches for parameter learning in several mixture models in one dimension. Our first approach uses complex-analytic methods and applies to Gaussian mixtures with shared variance, binomial mixtures with shared success probability, and Poisson mixtures, among others. An example result is that $\exp(O(N^{1/3}))$ samples suffice to exactly learn a mixture of $k


An Approach for Time-aware Domain-based Social Influence Prediction

arXiv.org Artificial Intelligence

Online Social Networks(OSNs) have established virtual platforms enabling people to express their opinions, interests and thoughts in a variety of contexts and domains, allowing legitimate users as well as spammers and other untrustworthy users to publish and spread their content. Hence, the concept of social trust has attracted the attention of information processors/data scientists and information consumers/business firms. One of the main reasons for acquiring the value of Social Big Data (SBD) is to provide frameworks and methodologies using which the credibility of OSNs users can be evaluated. These approaches should be scalable to accommodate large-scale social data. Hence, there is a need for well comprehending of social trust to improve and expand the analysis process and inferring the credibility of SBD. Given the exposed environment's settings and fewer limitations related to OSNs, the medium allows legitimate and genuine users as well as spammers and other low trustworthy users to publish and spread their content. Hence, this paper presents an approach incorporates semantic analysis and machine learning modules to measure and predict users' trustworthiness in numerous domains in different time periods. The evaluation of the conducted experiment validates the applicability of the incorporated machine learning techniques to predict highly trustworthy domain-based users.


Correcting Knowledge Base Assertions

arXiv.org Artificial Intelligence

The usefulness and usability of knowledge bases (KBs) is often limited by quality issues. One common issue is the presence of erroneous assertions, often caused by lexical or semantic confusion. We study the problem of correcting such assertions, and present a general correction framework which combines lexical matching, semantic embedding, soft constraint mining and semantic consistency checking. The framework is evaluated using DBpedia and an enterprise medical KB.


FRESH: Interactive Reward Shaping in High-Dimensional State Spaces using Human Feedback

arXiv.org Artificial Intelligence

Reinforcement learning has been successful in training autonomous agents to accomplish goals in complex environments. Although this has been adapted to multiple settings, including robotics and computer games, human players often find it easier to obtain higher rewards in some environments than reinforcement learning algorithms. This is especially true of high-dimensional state spaces where the reward obtained by the agent is sparse or extremely delayed. In this paper, we seek to effectively integrate feedback signals supplied by a human operator with deep reinforcement learning algorithms in high-dimensional state spaces. We call this FRESH (Feedback-based REward SHaping). During training, a human operator is presented with trajectories from a replay buffer and then provides feedback on states and actions in the trajectory. In order to generalize feedback signals provided by the human operator to previously unseen states and actions at test-time, we use a feedback neural network. We use an ensemble of neural networks with a shared network architecture to represent model uncertainty and the confidence of the neural network in its output. The output of the feedback neural network is converted to a shaping reward that is augmented to the reward provided by the environment. We evaluate our approach on the Bowling and Skiing Atari games in the arcade learning environment. Although human experts have been able to achieve high scores in these environments, state-of-the-art deep learning algorithms perform poorly. We observe that FRESH is able to achieve much higher scores than state-of-the-art deep learning algorithms in both environments. FRESH also achieves a 21.4% higher score than a human expert in Bowling and does as well as a human expert in Skiing.


[Interview] How AI, robotics and digital technologies are transforming healthcare

#artificialintelligence

New Delhi: Advances in technology and medical research could mean seismic changes in the healthcare industry. Soon, cancer, heart disease, diabetes and other debilitating illnesses could be defeated - perhaps, 20 years from now (unbelievable as it may sound) - thanks to scientists, medical doctors and researchers who are working vigorously, making stupendous progress on all these fronts. Over the last decade, healthcare is one of the industries that has evolved the most, yet, we're going to see changes in the way diseases are being treated. It's evident that we're going to witness drastic changes in a number of dimensions - from robots in the role of healthcare professionals to smart technology and artificial intelligence tools that will improve the quality of care and population health. Dr Sanjay Pandey, Head - Andrology and Reconstructive Urology - Kokilaben Dhirubhai Ambani Hospital, Mumbai, spoke on how digital technology, robotics and AI are transforming the face of medicine.


Fintech profile: Lemonade, the AI-driven insurtech

#artificialintelligence

As of December 2019, there are more than 400 unicorns worldwide - that's according to the aptly named Global Unicorn Club report from CB Insights. A significant number of those, private companies valued at more than $1bn for the uninitiated, are firmly entrenched in the financial services sector. One such company is Lemonade. The New York-based business uses artificial intelligence, chatbots and other innovative technologies to disrupt the home and rental insurance sectors. It recently appeared in FinTech magazine's Top 10 Unicorns list, which provided a comprehensive snapshot of those most innovative companies to achieve this coveted status.


From local explanations to global understanding with explainable AI for trees

#artificialintelligence

Tree-based machine learning models such as random forests, decision trees and gradient boosted trees are popular nonlinear predictive models, yet comparatively little attention has been paid to explaining their predictions. Here we improve the interpretability of tree-based models through three main contributions. We apply these tools to three medical machine learning problems and show how combining many high-quality local explanations allows us to represent global structure while retaining local faithfulness to the original model. These tools enable us to (1) identify high-magnitude but low-frequency nonlinear mortality risk factors in the US population, (2) highlight distinct population subgroups with shared risk characteristics, (3) identify nonlinear interaction effects among risk factors for chronic kidney disease and (4) monitor a machine learning model deployed in a hospital by identifying which features are degrading the model's performance over time. Given the popularity of tree-based machine learning models, these improvements to their interpretability have implications across a broad set of domains.


Life will soon be like 'Her' -- and we'll fall in love with AI

#artificialintelligence

It has penetrated almost every industry and is helping them become innovative, develop authentic tools, and build strategies towards a sustainable future. Researchers are eagerly exploring new use cases of artificial intelligence that have the power to radically transform societies around us. But as we develop intelligence artificially, will be there a room for this AI to rewire us as humans? Artificial intelligence has come a long way since its inception. We are at the brink of a massive change where world leaders are constantly discussing whether AI will take over the world and start controlling us. Even though it might not seem possible at the moment, there are plenty of theories that suggest the deadly impact of AI in the future.