Goto

Collaborating Authors

 Instructional Material


Static Seeding and Clustering of LSTM Embeddings to Learn from Loosely Time-Decoupled Events

arXiv.org Artificial Intelligence

Humans learn from the occurrence of events in a different place and time to predict similar trajectories of events. We define Loosely Decoupled Timeseries (LDT) phenomena as two or more events that could happen in different places and across different timelines but share similarities in the nature of the event and the properties of the location. In this work we improve on the use of Recurring Neural Networks (RNN), in particular Long Short-Term Memory (LSTM) networks, to enable AI solutions that generate better timeseries predictions for LDT. We use similarity measures between timeseries based on the trends and introduce embeddings representing those trends. The embeddings represent properties of the event which, coupled with the LSTM structure, can be clustered to identify similar temporally unaligned events. In this paper, we explore methods of seeding a multivariate LSTM from time-invariant data related to the geophysical and demographic phenomena being modeled by the LSTM. We apply these methods on the timeseries data derived from the COVID-19 detected infection and death cases. We use publicly available socio-economic data to seed the LSTM models, creating embeddings, to determine whether such seeding improves case predictions. The embeddings produced by these LSTMs are clustered to identify best-matching candidates for forecasting an evolving timeseries. Applying this method, we show an improvement in 10-day moving average predictions of disease propagation at the US County level.


No Language Left Behind: Scaling Human-Centered Machine Translation

arXiv.org Artificial Intelligence

Driven by the goal of eradicating language barriers on a global scale, machine translation has solidified itself as a key focus of artificial intelligence research today. However, such efforts have coalesced around a small subset of languages, leaving behind the vast majority of mostly low-resource languages. What does it take to break the 200 language barrier while ensuring safe, high quality results, all while keeping ethical considerations in mind? In No Language Left Behind, we took on this challenge by first contextualizing the need for low-resource language translation support through exploratory interviews with native speakers. Then, we created datasets and models aimed at narrowing the performance gap between low and high-resource languages. More specifically, we developed a conditional compute model based on Sparsely Gated Mixture of Experts that is trained on data obtained with novel and effective data mining techniques tailored for low-resource languages. We propose multiple architectural and training improvements to counteract overfitting while training on thousands of tasks. Critically, we evaluated the performance of over 40,000 different translation directions using a human-translated benchmark, Flores-200, and combined human evaluation with a novel toxicity benchmark covering all languages in Flores-200 to assess translation safety. Our model achieves an improvement of 44% BLEU relative to the previous state-of-the-art, laying important groundwork towards realizing a universal translation system.


CVPR 2022 notes with focus on Medical Imaging

#artificialintelligence

These are notes from some of the talks and papers/posters. The main platform for works on medical imaging at CVPR is Medical Computer Vision Workshop, held this year for the ninth time. Bonus: All the lectures from the workshop are publicly available online with no need to buy a conference ticket. Trustworthy AI entails four major criteria: robustness, interpretability, self-awareness(identifying cases where confident predictions), and sensitivity (useful at realistic operation points). Test-time adaptable networks are trained in the same way as all conventional segmentation models but differ at the inference stage.


AWS Deep Learning Challenge sees innovative and impactful use of Amazon EC2 DL1 instances

#artificialintelligence

In the AWS Deep Learning Challenge held from January 5, 2022, to March 1, 2022, participants from academia, startups, and enterprise organizations joined to test their skills and train a deep learning model of their choice using Amazon Elastic Compute Cloud (Amazon EC2) DL1 instances and Habana's SynapseAI SDK. The EC2 DL1 instances powered by Gaudi accelerators from Habana Labs, an Intel company, are designed specifically for training deep learning models. Participants were able to realize the significant price/performance benefits that DL1 offers over GPU-based instances. We are excited to announce the winners and showcase some of the machine learning (ML) models that were trained in this hackathon. You will learn about some of the deep learning use cases that are supported by EC2 DL1 instances, including computer vision, natural language processing, and acoustic modeling.


Advanced SQL Bootcamp

#artificialintelligence

Created by Jose Portilla 10.5 hours on-demand video course Welcome to the best online course to take your SQL skills to the next level! This course is designed to take you from basic SQL knowledge to a SQL Developer Professional. After completing this course you will have a better understanding of how tables and databases work as well as advanced capabilities in querying the information that is stored in a SQL database effectively. SQL is a critical skill for the modern workforce and we've created an online course specifically designed to take your current SQL knowledge to an advanced level. We'll begin the course with a deep dive into understanding how to construct subqueries and common table expressions, afterwards we'll move on to discussing window functions and advanced Join operations.


Strategic Management of Machine Learning Projects

#artificialintelligence

You can sometimes break an end-to-end model into two and introduce a hand-designed component in the middle that extracts some features or does some processing to make the whole system much better. For instance, you might find that a model where there is a hand-designed component that crops to the person's face before starting on the facial recognition task when a human is found to exist in an image makes a better face recognition system compared to one that's completely end-to-end.


Artificial Intelligence in Web Design + Live Class - Coursemetry

#artificialintelligence

In the beginning website, design developers and designers designed websites using HTML. Soon, the internet was formless and empty, darkness was over the surface of the deep web, and the Spirit of Code was hovering over the pinnacle of utmost ignorance. We've come a long way from that time. The internet is still a dark, dreadful place, but it's much more stylish, sophisticated, and amazing now. Website Design has grown exponentially in scale and sophistication over the last few years, thanks to new Artificial Intelligence-based website creation tools that are dominating the digital marketing industry.


New algorithm aces university math course questions

#artificialintelligence

Multivariable calculus, differential equations, linear algebra -- topics that many MIT students can ace without breaking a sweat -- have consistently stumped machine learning models. The best models have only been able to answer elementary or high school-level math questions, and they don't always find the correct solutions. Now, a multidisciplinary team of researchers from MIT and elsewhere, led by Iddo Drori, a lecturer in the MIT Department of Electrical Engineering and Computer Science (EECS), has used a neural network model to solve university-level math problems in a few seconds at a human level. The model also automatically explains solutions and rapidly generates new problems in university math subjects. When the researchers showed these machine-generated questions to university students, the students were unable to tell whether the questions were generated by an algorithm or a human.


Introduction to Pytorch Machine Learning

#artificialintelligence

"Nanodegree" is a registered trademark of Udacity. Udacity is not an accredited university and we don't confer traditional degrees. Udacity Nanodegree programs represent collaborations with our industry partners who help us develop our content and who hire many of our program graduates.


Deep Learning With Python

#artificialintelligence

I found the book quite didactic and entertaining. Theano and Tensorflow are explored briefly in some specific chapters at the beginning of the book, but most of the material covers how to use Keras effectively with CNNs and RNNs. I found the Time Series and model improvement chapters specially interesting. I recommend this book for newbies willing to get a soft landing into Deep Learning with Python&Keras. I think this is Jason's best book to date. Starting with no previous deep learning experience and little familiarity with Python, over the course of a weekend I was able to develop and train a Convolutional Neural Net that achieved a 0.8% error rate on the famous MNIST digit recognition task (best-in-class is 0.23%). If you're struggling to get up to speed with deep learning, this book is a great way to get started.