Instructional Material
Machine Learning: Clustering & Retrieval
A reader is interested in a specific news article and you want to find similar articles to recommend. What is the right notion of similarity? Moreover, what if there are millions of other documents? Each time you want to a retrieve a new document, do you need to search through all other documents? How do you group similar documents together?
GRAIMATTER Green Paper: Recommendations for disclosure control of trained Machine Learning (ML) models from Trusted Research Environments (TREs)
Jefferson, Emily, Liley, James, Malone, Maeve, Reel, Smarti, Crespi-Boixader, Alba, Kerasidou, Xaroula, Tava, Francesco, McCarthy, Andrew, Preen, Richard, Blanco-Justicia, Alberto, Mansouri-Benssassi, Esma, Domingo-Ferrer, Josep, Beggs, Jillian, Chuter, Antony, Cole, Christian, Ritchie, Felix, Daly, Angela, Rogers, Simon, Smith, Jim
TREs are widely, and increasingly used to support statistical analysis of sensitive data across a range of sectors (e.g., health, police, tax and education) as they enable secure and transparent research whilst protecting data confidentiality. There is an increasing desire from academia and industry to train AI models in TREs. The field of AI is developing quickly with applications including spotting human errors, streamlining processes, task automation and decision support. These complex AI models require more information to describe and reproduce, increasing the possibility that sensitive personal data can be inferred from such descriptions. TREs do not have mature processes and controls against these risks. This is a complex topic, and it is unreasonable to expect all TREs to be aware of all risks or that TRE researchers have addressed these risks in AI-specific training. GRAIMATTER has developed a draft set of usable recommendations for TREs to guard against the additional risks when disclosing trained AI models from TREs. The development of these recommendations has been funded by the GRAIMATTER UKRI DARE UK sprint research project. This version of our recommendations was published at the end of the project in September 2022. During the course of the project, we have identified many areas for future investigations to expand and test these recommendations in practice. Therefore, we expect that this document will evolve over time.
Scaling Multimodal Pre-Training via Cross-Modality Gradient Harmonization
Wu, Junru, Liang, Yi, Han, Feng, Akbari, Hassan, Wang, Zhangyang, Yu, Cong
Self-supervised pre-training recently demonstrates success on large-scale multimodal data, and state-of-the-art contrastive learning methods often enforce the feature consistency from cross-modality inputs, such as video/audio or video/text pairs. Despite its convenience to formulate and leverage in practice, such cross-modality alignment (CMA) is only a weak and noisy supervision, since two modalities can be semantically misaligned even they are temporally aligned. For example, even in the (often adopted) instructional videos, a speaker can sometimes refer to something that is not visually present in the current frame; and the semantic misalignment would only be more unpredictable for the raw videos collected from unconstrained internet sources. We conjecture that might cause conflicts and biases among modalities, and may hence prohibit CMA from scaling up to training with larger and more heterogeneous data. This paper first verifies our conjecture by observing that, even in the latest VATT pre-training using only narrated videos, there exist strong gradient conflicts between different CMA losses within the same sample triplet (video, audio, text), indicating them as the noisy source of supervision. We then propose to harmonize such gradients during pre-training, via two techniques: (i) cross-modality gradient realignment: modifying different CMA loss gradients for one sample triplet, so that their gradient directions are in more agreement; and (ii) gradient-based curriculum learning: leveraging the gradient conflict information on an indicator of sample noisiness, to develop a curriculum learning strategy to prioritize training with less noisy sample triplets. Applying those gradient harmonization techniques to pre-training VATT on the HowTo100M dataset, we consistently improve its performance on different downstream tasks. Moreover, we are able to scale VATT pre-training to more complicated non-narrative Youtube8M dataset to further improve the state-of-the-arts.
Human in the loop approaches in multi-modal conversational task guidance system development
Manuvinakurike, Ramesh, Biswas, Sovan, Raffa, Giuseppe, Beckwith, Richard, Rhodes, Anthony, Shi, Meng, Mejia, Gesem Gudino, Sahay, Saurav, Nachman, Lama
Development of task guidance systems for aiding humans in a situated task remains a challenging problem. The role of search (information retrieval) and conversational systems for task guidance has immense potential to help the task performers achieve various goals. However, there are several technical challenges that need to be addressed to deliver such conversational systems, where common supervised approaches fail to deliver the expected results in terms of overall performance, user experience and adaptation to realistic conditions. In this preliminary work we first highlight some of the challenges involved during the development of such systems. We then provide an overview of existing datasets available and highlight their limitations. We finally develop a model-in-the-loop wizard-of-oz based data collection tool and perform a pilot experiment.
Graph Lifelong Learning: A Survey
Febrinanto, Falih Gozi, Xia, Feng, Moore, Kristen, Thapa, Chandra, Aggarwal, Charu
Graph learning is a popular approach for performing machine learning on graph-structured data. It has revolutionized the machine learning ability to model graph data to address downstream tasks. Its application is wide due to the availability of graph data ranging from all types of networks to information systems. Most graph learning methods assume that the graph is static and its complete structure is known during training. This limits their applicability since they cannot be applied to problems where the underlying graph grows over time and/or new tasks emerge incrementally. Such applications require a lifelong learning approach that can learn the graph continuously and accommodate new information whilst retaining previously learned knowledge. Lifelong learning methods that enable continuous learning in regular domains like images and text cannot be directly applied to continuously evolving graph data, due to its irregular structure. As a result, graph lifelong learning is gaining attention from the research community. This survey paper provides a comprehensive overview of recent advancements in graph lifelong learning, including the categorization of existing methods, and the discussions of potential applications and open research problems.
DeepSpeech for Dummies - A Tutorial and Overview
DeepSpeech is a neural network architecture first published by a research team at Baidu. In 2017, Mozilla created an open source implementation of this paper - dubbed "Mozilla DeepSpeech". The original DeepSpeech paper from Baidu popularized the concept of "end-to-end" speech recognition models. "End-to-end" means that the model takes in audio, and directly outputs characters or words. This is compared to traditional speech recognition models, like those built with popular open source libraries such as Kaldi or CMU Sphinx, that predict phonemes, and then convert those phonemes to words in a later, downstream process. The goal of "end-to-end" models, like DeepSpeech, was to simplify the speech recognition pipeline into a single model. In addition, the theory introduced by the Baidu research paper was that training large deep learning models, on large amounts of data, would yield better performance than classical speech recognition models.
Other - Visual C++ programming for desktop application development
Visual C programming for desktop application development Published 10/2022 MP4 Video: h264, 1280x720 Audio: AAC, 44.1 KHz, 2 Ch Genre: eLearning Language: English Duration: 19 lectures (3h 53m) Size: 1.69 GB Visual C programming for desktop application development What you'll learn Upon successful completion of the course, the students will be able to develop Graphical User Interface (GUI)-based applications using Visual C Students will be able to develop GUI desktop applications in VC for the applications that they have previously made in console environment using C Develop desktop application using VC in the latest version of Microsoft Visual Studio that will enable students to perform various user interface operations Students previously knowing only C will be able to learn how to develop Graphical User Interface applications through VC via easy to learn short tutorials Requirements Basic knowledge of C (console based programming) Basic knowledge of Object-Oriented programming Description Welcome to the course of, Beginning Visual C programming for desktop application development. This is a must to take course if you have just learned the basic C using console interface and wondering how various user-interface applications can be created using C . This course will enable you to understand the basics of desktop application development using the latest version of Microsoft's visual studio. The teaching methodology of this course is based on hands-on topic specific examples that enable quicker learning. In this course, you will be learning VC using the latest version of Microsoft's visual studio.
Machine Learning With Python - All-In-One Bootcamp
In this course, you will learn all the techniques used by real time Data Scientists and the various methods involved in Machine learning using Python. GreyCampus is an online training platform, that has been in this field for more than 12 years. Before we set up a curriculum, we ensure that the learner understands the core fundamentals of any course they opt for. That's why our curriculum begins at the basics and ends at how to deal advance level topics. Python is a powerful tool used to analyse data, create beautiful visualisations, and use powerful machine learning algorithms!