Education
Self-supervised Autoregressive Domain Adaptation for Time Series Data
Ragab, Mohamed, Eldele, Emadeldeen, Chen, Zhenghua, Wu, Min, Kwoh, Chee-Keong, Li, Xiaoli
Unsupervised domain adaptation (UDA) has successfully addressed the domain shift problem for visual applications. Yet, these approaches may have limited performance for time series data due to the following reasons. First, they mainly rely on large-scale dataset (i.e., ImageNet) for the source pretraining, which is not applicable for time-series data. Second, they ignore the temporal dimension on the feature space of the source and target domains during the domain alignment step. Last, most of prior UDA methods can only align the global features without considering the fine-grained class distribution of the target domain. To address these limitations, we propose a Self-supervised Autoregressive Domain Adaptation (SLARDA) framework. In particular, we first design a self-supervised learning module that utilizes forecasting as an auxiliary task to improve the transferability of the source features. Second, we propose a novel autoregressive domain adaptation technique that incorporates temporal dependency of both source and target features during domain alignment. Finally, we develop an ensemble teacher model to align the class-wise distribution in the target domain via a confident pseudo labeling approach. Extensive experiments have been conducted on three real-world time series applications with 30 cross-domain scenarios. Results demonstrate that our proposed SLARDA method significantly outperforms the state-of-the-art approaches for time series domain adaptation.
Sublinear Regret for Learning POMDPs
Xiong, Yi, Chen, Ningyuan, Gao, Xuefeng, Zhou, Xiang
We study the model-based undiscounted reinforcement learning for partially observable Markov decision processes (POMDPs). The oracle we consider is the optimal policy of the POMDP with a known environment in terms of the average reward over an infinite horizon. We propose a learning algorithm for this problem, building on spectral method-of-moments estimations for hidden Markov models, the belief error control in POMDPs and upper-confidence-bound methods for online learning. We establish a regret bound of $O(T^{2/3}\sqrt{\log T})$ for the proposed learning algorithm where $T$ is the learning horizon. This is, to the best of our knowledge, the first algorithm achieving sublinear regret with respect to our oracle for learning general POMDPs.
Perspectives on Incorporating Expert Feedback into Model Updates
Chen, Valerie, Bhatt, Umang, Heidari, Hoda, Weller, Adrian, Talwalkar, Ameet
Machine learning (ML) practitioners are increasingly tasked with developing models that are aligned with non-technical experts' values and goals. However, there has been insufficient consideration on how practitioners should translate domain expertise into ML updates. In this paper, we consider how to capture interactions between practitioners and experts systematically. We devise a taxonomy to match expert feedback types with practitioner updates. A practitioner may receive feedback from an expert at the observation- or domain-level, and convert this feedback into updates to the dataset, loss function, or parameter space. We review existing work from ML and human-computer interaction to describe this feedback-update taxonomy, and highlight the insufficient consideration given to incorporating feedback from non-technical experts. We end with a set of open questions that naturally arise from our proposed taxonomy and subsequent survey.
Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model
Chen, Xiaolin, Song, Xuemeng, Jing, Liqiang, Li, Shuo, Hu, Linmei, Nie, Liqiang
Text response generation for multimodal task-oriented dialog systems, which aims to generate the proper text response given the multimodal context, is an essential yet challenging task. Although existing efforts have achieved compelling success, they still suffer from two pivotal limitations: 1) overlook the benefit of generative pre-training, and 2) ignore the textual context related knowledge. To address these limitations, we propose a novel dual knowledge-enhanced generative pretrained language model for multimodal task-oriented dialog systems (DKMD), consisting of three key components: dual knowledge selection, dual knowledge-enhanced context learning, and knowledge-enhanced response generation. To be specific, the dual knowledge selection component aims to select the related knowledge according to both textual and visual modalities of the given context. Thereafter, the dual knowledge-enhanced context learning component targets seamlessly integrating the selected knowledge into the multimodal context learning from both global and local perspectives, where the cross-modal semantic relation is also explored. Moreover, the knowledge-enhanced response generation component comprises a revised BART decoder, where an additional dot-product knowledge-decoder attention sub-layer is introduced for explicitly utilizing the knowledge to advance the text response generation. Extensive experiments on a public dataset verify the superiority of the proposed DKMD over state-of-the-art competitors.
CAM/CAD Point Cloud Part Segmentation via Few-Shot Learning
Wang, Jiahui, Zhu, Haiyue, Guo, Haoren, Mamun, Abdullah Al, Prahlad, Vadakkepat, Lee, Tong Heng
3D part segmentation is an essential step in advanced CAM/CAD workflow. Precise 3D segmentation contributes to lower defective rate of work-pieces produced by the manufacturing equipment (such as computer controlled CNCs), thereby improving work efficiency and attaining the attendant economic benefits. A large class of existing works on 3D model segmentation are mostly based on fully-supervised learning, which trains the AI models with large, annotated datasets. However, the disadvantage is that the resulting models from the fully-supervised learning methodology are highly reliant on the completeness of the available dataset, and its generalization ability is relatively poor to new unknown segmentation types (i.e. further additional novel classes). In this work, we propose and develop a noteworthy few-shot learning-based approach for effective part segmentation in CAM/CAD; and this is designed to significantly enhance its generalization ability and flexibly adapt to new segmentation tasks by using only relatively rather few samples. As a result, it not only reduces the requirements for the usually unattainable and exhaustive completeness of supervision datasets, but also improves the flexibility for real-world applications. As further improvement and innovation, we additionally adopt the transform net and the center loss block in the network. These characteristics serve to improve the comprehension for 3D features of the various possible instances of the whole work-piece and ensure the close distribution of the same class in feature space.
[100%OFF] Introduction To Object Oriented Programing
The course will also cover writing simple data structures and sorting algorithms. In future lectures, we will introduce more advanced data structures, such as binary search trees and hashing tables. The objective of this video series is to give aspiring programmers all the necessary tools to kick start their learning journey. We will cover not only how to write code, but also the inner workings of the machines on which we code in order to prepare students for success in the field.
Azure Data Architect
HSO are a leading Microsoft Dynamics Gold partner who were founded in 1987 specialising in sectors such as Retail, Rental, Manufacturing, Professional Services and Local Government. With a head count of over 280 employees in the UK, winning multiple awards such as 2020 Microsoft Partner of the Year, Best Tech company 2021 and Top 3 Large Companies to work for 2021 our reputation in the Dynamics Market is higher than ever. Prioritising customer satisfaction, our expertise and pragmatic approach to each customer's business needs enable us to provide a 100% reference-able solution, supported by award winning 24-hour support. Our recruitment moto has always been โ 'We don't want good people to just join us, we want them to stay with us'. Ensuring our employees are challenged, supported and engaged in our wider family is key to our continued success โ we have a designated Learning and Development Team who are continuously offering the best training on the market, combined with an Engagement Team who are creative in ways we can have social activities virtually.
Generative Adversarial Networks for Image Generation: Mao, Xudong, Li, Qing: 9789813360471: Amazon.com: Books
Qing Li is currently a Chair Professor at the Hong Kong Polytechnic University. He also serves/served as a Guest Professor of Zhejiang University, an Adjunct Professor of the University of Science and Technology of China, and a Visiting Professor at the Wuhan University and the Hunan University. His research interests include database modeling, multimedia retrieval and management, social media computing and e-learning systems. Dr. Li has published over 400 papers in technical journals and international conferences in these areas, and is actively involved in the research community by serving as a journal reviewer, program committee chair/co-chair, and as an organizer/co-organizer of numerous international conferences. Currently he is the Chairman of the Hong Kong Web Society, a councillor of the Database Society of Chinese Computer Federation (CCF), a member of the CCF Big Data Experts Committee, and a member of the international WISE Society's steering committee.
[FREE] Artificial Neural Networks With NeuroLab And Python
Udemy is the biggest website in the world that offer courses in many categories, all the skills that you would be looking for are offered in Udemy, including languages, design, marketing and a lot of other categories, so when you ever want to buy a courses and pay for a new skills, Udemy would be the best forum for you. You can find payment courses, 100 free courses and coupons also, more than 12 categories are offered, and that what makes sure you will find the domain and the skill you are looking for. Our duty is to search for 100 off courses and free coupons. You're going to learn hands-on artificial neural networks with neurolab, a lesser-known and traditional Python library for artificial intelligence. This is a hands-on course and you will be working your way through with Python and Jupyter notebooks.
Roadmap to Learn Machine Learning for FREE
So you want to learn machine learning but are stuck with a question, "How to Learn Machine Learning Online Free?". In this article, I will discuss the complete machine learning roadmap with some FREE online resources. And you don't need to pay $$$$ amount to any course to learn machine learning. Are you excited to know "How to Learn Machine Learning Online Free?". So without any further ado, let's get started- First, let's understand what is machine learning and why you need to learn machine learning?