Instructional Material
Introduction to Deep Learning
Deep Learning is the go-to technique for many applications, from natural language processing to biomedical. Deep learning can handle many different types of data such as images, texts, voice/sound, graphs and so on. This course will cover the basics of DL including how to build and train multilayer perceptron, convolutional neural networks (CNNs), recurrent neural networks (RNNs), autoencoders (AE) and generative adversarial networks (GANs). The course includes several hands-on projects, including cancer detection with CNNs, RNNs on disaster tweets, and generating dog images with GANs. Prior coding or scripting knowledge is required.
TensorFlow 2 for Deep Learning
This Specialization is intended for machine learning researchers and practitioners who are seeking to develop practical skills in the popular deep learning framework TensorFlow. The first course of this Specialization will guide you through the fundamental concepts required to successfully build, train, evaluate and make predictions from deep learning models, validating your models and including regularisation, implementing callbacks, and saving and loading models. The second course will deepen your knowledge and skills with TensorFlow, in order to develop fully customised deep learning models and workflows for any application. You will use lower level APIs in TensorFlow to develop complex model architectures, fully customised layers, and a flexible data workflow. You will also expand your knowledge of the TensorFlow APIs to include sequence models.
Multi-Layer Personalized Federated Learning for Mitigating Biases in Student Predictive Analytics
Chu, Yun-Wei, Hosseinalipour, Seyyedali, Tenorio, Elizabeth, Cruz, Laura, Douglas, Kerrie, Lan, Andrew, Brinton, Christopher
Traditional learning-based approaches to student modeling (e.g., predicting grades based on measured activities) generalize poorly to underrepresented/minority student groups due to biases in data availability. In this paper, we propose a Multi-Layer Personalized Federated Learning (MLPFL) methodology which optimizes inference accuracy over different layers of student grouping criteria, such as by course and by demographic subgroups within each course. In our approach, personalized models for individual student subgroups are derived from a global model, which is trained in a distributed fashion via meta-gradient updates that account for subgroup heterogeneity while preserving modeling commonalities that exist across the full dataset. To evaluate our methodology, we consider case studies of two popular downstream student modeling tasks, knowledge tracing and outcome prediction, which leverage multiple modalities of student behavior (e.g., visits to lecture videos and participation on forums) in model training. Experiments on three real-world datasets from online courses demonstrate that our approach obtains substantial improvements over existing student modeling baselines in terms of increasing the average and decreasing the variance of prediction quality across different student subgroups. Visual analysis of the resulting students' knowledge state embeddings confirm that our personalization methodology extracts activity patterns which cluster into different student subgroups, consistent with the performance enhancements we obtain over the baselines.
Continual Learning with Optimal Transport based Mixture Model
Tran, Quyen, Phan, Hoang, Than, Khoat, Phung, Dinh, Le, Trung
Online Class Incremental learning (CIL) is a challenging setting in Continual Learning (CL), wherein data of new tasks arrive in incoming streams and online learning models need to handle incoming data streams without revisiting previous ones. Existing works used a single centroid adapted with incoming data streams to characterize a class. This approach possibly exposes limitations when the incoming data stream of a class is naturally multimodal. To address this issue, in this work, we first propose an online mixture model learning approach based on nice properties of the mature optimal transport theory (OT-MM). Specifically, the centroids and covariance matrices of the mixture model are adapted incrementally according to incoming data streams. The advantages are two-fold: (i) we can characterize more accurately complex data streams and (ii) by using centroids for each class produced by OT-MM, we can estimate the similarity of an unseen example to each class more reasonably when doing inference. Moreover, to combat the catastrophic forgetting in the CIL scenario, we further propose Dynamic Preservation. Particularly, after performing the dynamic preservation technique across data streams, the latent representations of the classes in the old and new tasks become more condensed themselves and more separate from each other. Together with a contraction feature extractor, this technique facilitates the model in mitigating the catastrophic forgetting. The experimental results on real-world datasets show that our proposed method can significantly outperform the current state-of-the-art baselines.
Learn Game Artificial Intelligence in Unity Visual Scripting - Coupons ME
Created by Penny de Byl, Jim Walsh, Penny @Holistic3D.com Strap yourself in: Programming Artificial Intelligence is about to click! Since making the official tutorials for Bolt on Unity's Learn Site, creating this course has been a dream of mine. In collaboration with Holistic3D, I took Penny's quintessential C# tutorial series The Beginner's Guide to Artificial Intelligence and adapted it to *drumroll*… Unity Visual Scripting! In this course, you're getting the best of both worlds: Learning content from a renowned expert on AI and computer science remixed, reconfigured, and riffed on by a creative artist and designer who has helped thousands learn visual scripting from the early years to today… that's me!
Vaddi Keshava Reddy on LinkedIn: Internship on Artificial intelligence
Today this was been my first webinar in my career, so I wanna share my thoughts on #AutonomousVehicles #nvidia AI is the solution to self driving, Everything that will be autonomous The future is autonomous, and the possibilities are limitless. There are some gnarly waves in the topic, so what exactly an autonomous vehicle is and how does it work? Nowadays, AI is transforming the transportation industry without a human at the wheel. . Perception is the most important component of Autonomous vehicles. Mapping and adversal sceneries are the major components in AV.
December Newsletter – Royal Statistical Society Data Science Section
It certainly feels like winter is here judging by the lack of sunlight. But a December like no other, as we have a World Cup to watch – although half empty, beer-less, air-conditioned stadiums in repressive Qatar does not sit well …Perhaps time for a breather, with a wrap up of data science developments in the last month. Following is the December edition of our Royal Statistical Society Data Science and AI Section newsletter. Hopefully some interesting topics and titbits to feed your data science curiosity. If you like these, do please send on to your friends- we are looking to build a strong community of data science practitioners.
Free Machine Learning with Python Course by MIT
If you have specific questions about this course, please contact us atsds-mm@mit.edu. Machine learning methods are commonly used across engineering and sciences, from computer systems to physics. Moreover, commercial sites such as search engines, recommender systems (e.g., Netflix, Amazon), advertisers, and financial institutions employ machine learning algorithms for content recommendation, predicting customer behavior, compliance, or risk. As a discipline, machine learning tries to design and understand computer programs that learn from experience for the purpose of prediction or control. In this course, students will learn about principles and algorithms for turning training data into effective automated predictions.
Masters in Artificial Intelligence in USA - AbGyan Overseas
MS in AI courses at American universities are very popular globally. This is why many aspiring AI experts go to the US for completing their training. Besides this, the country houses numerous AI startups which means there is no shortage of jobs for AI professionals in America. In short, it's worthwhile to study artificial intelligence in the country. With this in mind today we are sharing with you a guide regarding studying MS in Artificial Intelligence in USA. Here are all the things you must know if you plan to study Artificial Intelligence in USA.
PyTorch 2.0
Both DistributedDataParallel (DDP) and FullyShardedDataParallel (FSDP) work in compiled mode and provide improved performance and memory utilization relative to eager mode, with some caveats and limitations. External launcher scripts and wrappers that simply apply DDP under the hood generally should work out of the box. Hugging Face Accelerate, Lightning, torchrun, and Ray Train have all been tested and verified working. DeepSpeed and Horovod have not been tested and we expect to enable them soon.