Goto

Collaborating Authors

 Education


Machine Learning Tool Identifies 800 Million-Year-Old Amino Acid Pattern

#artificialintelligence

An iterative machine learning approach has identified elusive 800 million-year-old amino acid patterns that are responsible for facilitating protein interactions, cell morphogenesis and adhesion and in diseases like cancer. Leucine-aspartic acid (LD) motifs are short amino acid sequences embedded within some proteins to link them to cellular molecules that control cell adhesion, motility and survival. They are known to also play a role in cancer cell spreading and in cardiovascular and infectious diseases. LD motifs were first revealed in 1996 in a family of proteins called paxillin. Only three other LD motif-containing proteins have been discovered since then, and scientists do not know the importance of LD motifs or how many other types of proteins contain them.


35 Best IT Certifications Online, Training, Courses 2019 JA Directives

#artificialintelligence

Are you looking for the Best IT Training Online? Grab this Best IT Courses Online which will help you to get the Best IT Certifications Online to skyrocket your career. Information Technology Certifications will assist you to understand the real-life implementation of Artificial Intelligence (AI), Data Analytics and Cloud Computing how this has changed the way we work and the way we think. Taking these IT Certifications Online 2020 will assist you to gain robust knowledge in IT sector and new doors will open for you too. Revolutionary changes have taken places in the IT sector due to some big companies like Space X, Amazon, eBay, Microsoft, Facebook and so on.


AutoML for Time Series Forecasting

#artificialintelligence

Although I'm not a fan of nowadays AutoML, I enjoy participating in AutoML competitions. I believe that such competitions are a great learning opportunity and could give strong pipelines for future projects. AutoML competitions are something in between Kaggle-like competitions and LeetCode tasks: your code should give high scores, and it should be steady and fast. Recently I took part in AutoSeries -- AutoML competition on time-series data, in which I managed to get the first place among 40 competitors (15 in the finals). This post is an overview of my solution.


On Thompson Sampling for Smoother-than-Lipschitz Bandits

arXiv.org Machine Learning

Thompson Sampling is a well established approach to bandit and reinforcement learning problems. However its use in continuum armed bandit problems has received relatively little attention. We provide the first bounds on the regret of Thompson Sampling for continuum armed bandits under weak conditions on the function class containing the true function and sub-exponential observation noise. Our bounds are realised by analysis of the eluder dimension, a recently proposed measure of the complexity of a function class, which has been demonstrated to be useful in bounding the Bayesian regret of Thompson Sampling for simpler bandit problems under sub-Gaussian observation noise. We derive a new bound on the eluder dimension for classes of functions with Lipschitz derivatives, and generalise previous analyses in multiple regards.


Dissecting Catastrophic Forgetting in Continual Learning by Deep Visualization

arXiv.org Machine Learning

Interpreting the behaviors of Deep Neural Networks (usually considered as a black box) is critical especially when they are now being widely adopted over diverse aspects of human life. Taking the advancements from Explainable Artificial Intelligent, this paper proposes a novel technique called Auto DeepVis to dissect catastrophic forgetting in continual learning. A new method to deal with catastrophic forgetting named critical freezing is also introduced upon investigating the dilemma by Auto DeepVis. Experiments on a captioning model meticulously present how catastrophic forgetting happens, particularly showing which components are forgetting or changing. The effectiveness of our technique is then assessed; and more precisely, critical freezing claims the best performance on both previous and coming tasks over baselines, proving the capability of the investigation. Our techniques could not only be supplementary to existing solutions for completely eradicating catastrophic forgetting for life-long learning but also explainable.


Multipurpose Intelligent Process Automation via Conversational Assistant

arXiv.org Artificial Intelligence

Intelligent Process Automation (IPA) is an emerging technology with a primary goal to assist the knowledge worker by taking care of repetitive, routine and low-cognitive tasks. Conversational agents that can interact with users in a natural language are potential application for IPA systems. Such intelligent agents can assist the user by answering specific questions and executing routine tasks that are ordinarily performed in a natural language (i.e., customer support). In this work, we tackle a challenge of implementing an IPA conversational assistant in a real-world industrial setting with a lack of structured training data. Our proposed system brings two significant benefits: First, it reduces repetitive and time-consuming activities and, therefore, allows workers to focus on more intelligent processes. Second, by interacting with users, it augments the resources with structured and to some extent labeled training data. We showcase the usage of the latter by re-implementing several components of our system with Transfer Learning (TL) methods.


CNN 101: Interactive Visual Learning for Convolutional Neural Networks

arXiv.org Artificial Intelligence

The success of deep learning solving previously-thought hard problems has inspired many non-experts to learn and understand this exciting technology. However, it is often challenging for learners to take the first steps due to the complexity of deep learning models. We present our ongoing work, CNN 101, an interactive visualization system for explaining and teaching convolutional neural networks. Through tightly integrated interactive views, CNN 101 offers both overview and detailed descriptions of how a model works. Built using modern web technologies, CNN 101 runs locally in users' web browsers without requiring specialized hardware, broadening the public's education access to modern deep learning techniques.


Frequency Fitness Assignment: Making Optimization Algorithms Invariant under Bijective Transformations of the Objective Function

arXiv.org Artificial Intelligence

Under Frequency Fitness Assignment (FFA), the fitness corresponding to an objective value is its encounter frequency in fitness assignment steps and is subject to minimization. FFA renders optimization processes invariant under bijective transformations of the objective function. This is the strongest invariance property of any optimization procedure to our knowledge. On TwoMax, Jump, and Trap functions of scale s, a (1+1)-EA with standard mutation at rate 1/s can have expected running times exponential in s. In our experiments, a (1+1)-FEA, the same algorithm but using FFA, exhibits mean running times quadratic in s. Since Jump and Trap are bijective transformations of OneMax, it behaves identical on all three. On the LeadingOnes and Plateau problems, it seems to be slower than the (1+1)-EA by a factor linear in s. The (1+1)-FEA performs much better than the (1+1)-EA on W-Model and MaxSat instances. Due to the bijection invariance, the behavior of an optimization algorithm using FFA does not change when the objective values are encrypted. We verify this by applying the Md5 checksum computation as transformation to some of the above problems and yield the same behaviors. Finally, FFA can improve the performance of a Memetic Algorithm for Job Shop Scheduling.


A Comprehensive Survey of Multilingual Neural Machine Translation

arXiv.org Artificial Intelligence

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of translation knowledge transfer (transfer learning). MNMT is more promising and interesting than its statistical machine translation counterpart because end-to-end modeling and distributed representations open new avenues for research on machine translation. Many approaches have been proposed in order to exploit multilingual parallel corpora for improving translation quality. However, the lack of a comprehensive survey makes it difficult to determine which approaches are promising and hence deserve further exploration. In this paper, we present an in-depth survey of existing literature on MNMT. We first categorize various approaches based on their central use-case and then further categorize them based on resource scenarios, underlying modeling principles, core-issues and challenges. Wherever possible we address the strengths and weaknesses of several techniques by comparing them with each other. We also discuss the future directions that MNMT research might take. This paper is aimed towards both, beginners and experts in NMT. We hope this paper will serve as a starting point as well as a source of new ideas for researchers and engineers interested in MNMT.


Satisficing in Time-Sensitive Bandit Learning

arXiv.org Artificial Intelligence

Much of the recent literature on bandit learning focuses on algorithms that aim to converge on an optimal action. One shortcoming is that this orientation does not account for time sensitivity, which can play a crucial role when learning an optimal action requires much more information than near-optimal ones. Indeed, popular approaches such as upper-confidence-bound methods and Thompson sampling can fare poorly in such situations. We consider instead learning a satisficing action, which is near-optimal while requiring less information, and propose satisficing Thompson sampling, an algorithm that serves this purpose. We establish a general bound on expected discounted regret and study the application of satisficing Thompson sampling to linear and infinite-armed bandits, demonstrating arbitrarily large benefits over Thompson sampling. We also discuss the relation between the notion of satisficing and the theory of rate distortion, which offers guidance on the selection of satisficing actions.