Goto

Collaborating Authors

 Education


Lifelong Knowledge Learning in Rule-based Dialogue Systems

arXiv.org Artificial Intelligence

One of the main weaknesses of current chatbots or dialogue systems is that they do not learn online during conversations after they are deployed. This is a major loss of opportunity. Clearly, each human user has a great deal of knowledge about the world that may be useful to others. If a chatbot can learn from their users during chatting, it will greatly expand its knowledge base and serve its users better. This paper proposes to build such a learning capability in a rule-based chatbot so that it can continuously acquire new knowledge in its chatting with users. This work is useful because many real-life deployed chatbots are rule-based.


Anderson acceleration of coordinate descent

arXiv.org Machine Learning

Acceleration of first order methods is mainly obtained via inertial techniques \`a la Nesterov, or via nonlinear extrapolation. The latter has known a recent surge of interest, with successful applications to gradient and proximal gradient techniques. On multiple Machine Learning problems, coordinate descent achieves performance significantly superior to full-gradient methods. Speeding up coordinate descent in practice is not easy: inertially accelerated versions of coordinate descent are theoretically accelerated, but might not always lead to practical speed-ups. We propose an accelerated version of coordinate descent using extrapolation, showing considerable speed up in practice, compared to inertial accelerated coordinate descent and extrapolated (proximal) gradient descent. Experiments on least squares, Lasso, elastic net and logistic regression validate the approach.


WNGrad: Learn the Learning Rate in Gradient Descent

arXiv.org Machine Learning

Adjusting the learning rate schedule in stochastic gradient methods is an important unresolved problem which requires tuning in practice. If certain parameters of the loss function such as smoothness or strong convexity constants are known, theoretical learning rate schedules can be applied. However, in practice, such parameters are not known, and the loss function of interest is not convex in any case. The recently proposed batch normalization reparametrization is widely adopted in most neural network architectures today because, among other advantages, it is robust to the choice of Lipschitz constant of the gradient in loss function, allowing one to set a large learning rate without worry. Inspired by batch normalization, we propose a general nonlinear update rule for the learning rate in batch and stochastic gradient descent so that the learning rate can be initialized at a high value, and is subsequently decreased according to gradient observations along the way. The proposed method is shown to achieve robustness to the relationship between the learning rate and the Lipschitz constant, and near-optimal convergence rates in both the batch and stochastic settings ($O(1/T)$ for smooth loss in the batch setting, and $O(1/\sqrt{T})$ for convex loss in the stochastic setting). We also show through numerical evidence that such robustness of the proposed method extends to highly nonconvex and possibly non-smooth loss function in deep learning problems.Our analysis establishes some first theoretical understanding into the observed robustness for batch normalization and weight normalization.


PyTorch: Deep Learning and Artificial Intelligence

#artificialintelligence

Welcome to PyTorch: Deep Learning and Artificial Intelligence! Although Google's Deep Learning library Tensorflow has gained massive popularity over the past few years, PyTorch has been the library of choice for professionals and researchers around the globe for deep learning and artificial intelligence. Is it possible that Tensorflow is popular only because Google is popular and used effective marketing? Why did Tensorflow change so significantly between version 1 and version 2? Was there something deeply flawed with it, and are there still potential problems? It is less well-known that PyTorch is backed by another Internet giant, Facebook (specifically, the Facebook AI Research Lab - FAIR).


Did a University Use Facial Recognition to ID Students?

WIRED

In late September, Mars Fernandez-Burgos, a doctoral student in counseling psychology at the University of Miami, received a one-line email from the assistant to the school's dean of students. She and eight others were asked to attend a Zoom meeting to discuss the "incident that happened on September 4." Fernandez-Burgos is a member of the University of Miami Employee Student Alliance (UMESA). Weeks earlier, she attended a campus protest around Covid protections and sick pay for contract workers like cafeteria workers and janitors. Afterward, university officials had ignored the student's group's attempts for a meeting. She didn't understand why the dean was reaching out now. "I believe this discussion necessary to understand policies around use of university space," wrote dean of students Ryan Holmes.


Data Science & Deep Learning for Business 20 Case Studies

#artificialintelligence

Data Science & Deep Learning for Business 20 Case Studies - Use Python to solve problems in Retail, Marketing, Product Recommendation, Customer Clustering, NLP, Forecasting & more! Created by Rajeev D. RatanPreview this Course - GET COUPON CODE Welcome to the course on Data Science & Deep Learning for Business 20 Case Studies! This course teaches you how Data Science & Deep Learning can be used to solve real-world business problems and how you can apply these techniques to 20 real-world case studies. Traditional Businesses are hiring Data Scientists in droves, and knowledge of how to apply these techniques in solving their problems will prove to be one of the most valuable skills in the next decade! What student reviews of this course are saying, "I'm only half way through this course, but i have to say WOW. It's so far, a lot better than my Business Analytics MSc I took at UCL. The content is explained better, it's broken down so simply.


Create a Custom Deep Reinforcement Learning Environment in UE4

#artificialintelligence

While the scope of reinforcement learning (RL) is likely to soon extend far beyond computer simulation, today the main location for training RL agents is within the digital environment. In the world of artificial intelligence, simulators are often the environments in which an algorithm functions. For humans, we are born directly into our simulator and it requires no effort on our part to go on functioning. We call this simulator the universe and it exists whether we believe in it or not. Similarly, the laws of physics apply whether you acknowledge them or not. They require no effort or acquiescence on our part.


Inteligencia Artificial, Conectivismo y Educación. Edgard Altamirano Carmona @edgaraltamirano

#artificialintelligence

In today's Digital era, capability building and knowledge retention in an organization has changed. Among the wider demographic as well, people have varied ways of learning. Some prefer reading, others watching videos and yet others who prefer audio based podcasts etc. What is the best way to target this wide audience of keen learners and personalize the experience to make e-learning easily accessible and much more immersive and interesting? In this session about applying AI/ML to learning, we will look at how to tackle this problem and take learning into the next generation.


Adding Common Sense to Machine Learning with TensorFlow Lattice

#artificialintelligence

Training-serving skew: The offline numbers may look great, but what if your model will be evaluated on a different or broader set of examples than those found in the training set? This phenomenon, more generally referred to as "dataset shift" or "distribution shift", happens all the time in real-world situations. Models are trained on a curated set of examples, or clicks on top-ranked recommendations, or a specific geographical region, and then applied to every user or use case. Curiosities and anomalies in your training and testing data become genuine and sustained loss patterns. Bad individual errors: Models are often judged by their worst behavior --- a single egregious outcome can damage the faith that important stakeholders have in the model and even cause serious reputational harm to your business or institution.


Learn Machine Learning For Free

#artificialintelligence

Is it possible to learn everything in Machine Learning for free? In this article, I will take you through the best resources available on the internet to learn machine learning for free. Machine Learning is a continuously developing field. So many technologies have been benefited from Machine Learning and there is still so much more to explore that nobody knows what benefits we may get from machine learning in the future. As machine learning is futuristic so there are so many offline and online courses available today.