Goto

Collaborating Authors

 Education


The future of work won't be about college degrees, it will be about job skills

#artificialintelligence

Twenty million students started college this fall, and this much is certain: The vast majority of them will be taking on debt -- a lot of debt. What's less certain is whether their degrees will pay off. According to the survey Freelancing in America 2018, released Wednesday, freelancers put more value on skills training: 93 percent of freelancers with a four-year college degree say skills training was useful versus only 79 percent who say their college education was useful to the work they do now. In addition, 70 percent of full-time freelancers participated in skills training in the past six months compared to only 49 percent of full-time non-freelancers. The fifth annual survey, conducted by research firm Edelman Intelligence and co-commissioned by Upwork and Freelancers Union, polled 6,001 U.S. workers.


Harnessing the power of artificial intelligence

#artificialintelligence

On an early visit to the University of South Carolina, Amit Sheth was surprised when 10 deans showed up for a meeting with him about artificial intelligence. Sheth -- the incoming director of the university's Artificial Intelligence Institute at the time -- thought he would need to sell the deans on the idea. Instead, it was them pitching the importance of artificial intelligence to him. "All of them were telling me why they are interested in AI, rather than me telling them why they should be interested in AI," Sheth said in a 2020 interview with the university's Breakthrough research magazine. "The awareness of AI was already there and the desire to incorporate AI into the activities that their faculty and students do was already on the campus."


Predicting Loan Default using Machine Learning with MindsDB

#artificialintelligence

A loan is money borrowed to someone (the debtor) with the intent to pay back at an agreed date. Ideally, things should go as planned but when the debtor fails to pay the person they borrowed the loan from (the creditor), the debtor is said to have defaulted on the loan. It is then important for creditors/loan companies to know/predict if a certain debtor will default or not. This is a problem that machine learning solves, this is a classification machine learning problem. As with every machine learning problem, data is the major ingredient in solving it.


Artificial intelligence-supported art education: a deep learning-based system for promoting university students' artwork appreciation and painting outcomes

#artificialintelligence

In a conventional art course, it is important for a teacher to provide feedback and guidance to individual students based on their learning status. However, it is challenging for teachers to provide immediate feedback to students without any aid. The advancement of artificial intelligence (AI) has provided a possible solution to cope with this problem. In this study, a deep learning-based art learning system (DL-ALS) was developed by employing a fine-tuned ResNet50 model for helping students identify and classify artworks. We aimed at cultivating students' accurate appreciation knowledge and artwork creation competence, as well as providing instant feedback and personalized guidance with the help of AI technology.


Is there any difference between data science and machine learning?

#artificialintelligence

Data Science and machine learning are two wonderful and exciting disciplines and are a great part of our lives. Sometimes people confuse them, but they are quite different things. Data Science is, like the name suggests, the science of data. It's a set of techniques and tools that make the data scientist extract information behind data. Such a mining process can be done using statistical tools or mathematical models.


Domain Adaptive Hand Keypoint and Pixel Localization in the Wild

arXiv.org Artificial Intelligence

We aim to improve the performance of regressing hand keypoints and segmenting pixel-level hand masks under new imaging conditions (e.g., outdoors) when we only have labeled images taken under very different conditions (e.g., indoors). In the real world, it is important that the model trained for both tasks works under various imaging conditions. However, their variation covered by existing labeled hand datasets is limited. Thus, it is necessary to adapt the model trained on the labeled images (source) to unlabeled images (target) with unseen imaging conditions. While self-training domain adaptation methods (i.e., learning from the unlabeled target images in a self-supervised manner) have been developed for both tasks, their training may degrade performance when the predictions on the target images are noisy. To avoid this, it is crucial to assign a low importance (confidence) weight to the noisy predictions during self-training. In this paper, we propose to utilize the divergence of two predictions to estimate the confidence of the target image for both tasks. These predictions are given from two separate networks, and their divergence helps identify the noisy predictions. To integrate our proposed confidence estimation into self-training, we propose a teacher-student framework where the two networks (teachers) provide supervision to a network (student) for self-training, and the teachers are learned from the student by knowledge distillation. Our experiments show its superiority over state-of-the-art methods in adaptation settings with different lighting, grasping objects, backgrounds, and camera viewpoints. Our method improves by 4% the multi-task score on HO3D compared to the latest adversarial adaptation method. We also validate our method on Ego4D, egocentric videos with rapid changes in imaging conditions outdoors.


Strongly Augmented Contrastive Clustering

arXiv.org Artificial Intelligence

Deep clustering has attracted increasing attention in recent years due to its capability of joint representation learning and clustering via deep neural networks. In its latest developments, the contrastive learning has emerged as an effective technique to substantially enhance the deep clustering performance. However, the existing contrastive learning based deep clustering algorithms mostly focus on some carefully-designed augmentations (often with limited transformations to preserve the structure), referred to as weak augmentations, but cannot go beyond the weak augmentations to explore the more opportunities in stronger augmentations (with more aggressive transformations or even severe distortions). In this paper, we present an end-to-end deep clustering approach termed Strongly Augmented Contrastive Clustering (SACC), which extends the conventional two-augmentation-view paradigm to multiple views and jointly leverages strong and weak augmentations for strengthened deep clustering. Particularly, we utilize a backbone network with triply-shared weights, where a strongly augmented view and two weakly augmented views are incorporated. Based on the representations produced by the backbone, the weak-weak view pair and the strong-weak view pairs are simultaneously exploited for the instance-level contrastive learning (via an instance projector) and the cluster-level contrastive learning (via a cluster projector), which, together with the backbone, can be jointly optimized in a purely unsupervised manner. Experimental results on five challenging image datasets have shown the superiority of our SACC approach over the state-of-the-art. The code is available at https://github.com/dengxiaozhi/SACC.


Large-scale Knowledge Distillation with Elastic Heterogeneous Computing Resources

arXiv.org Artificial Intelligence

Although more layers and more parameters generally improve the accuracy of the models, such big models generally have high computational complexity and require big memory, which exceed the capacity of small devices for inference and incurs long training time. In addition, it is difficult to afford long training time and inference time of big models even in high performance servers, as well. As an efficient approach to compress a large deep model (a teacher model) to a compact model (a student model), knowledge distillation emerges as a promising approach to deal with the big models. Existing knowledge distillation methods cannot exploit the elastic available computing resources and correspond to low efficiency. In this paper, we propose an Elastic Deep Learning framework for knowledge Distillation, i.e., EDL-Dist. The advantages of EDL-Dist are three-fold. First, the inference and the training process is separated. Second, elastic available computing resources can be utilized to improve the efficiency. Third, fault-tolerance of the training and inference processes is supported. We take extensive experimentation to show that the throughput of EDL-Dist is up to 3.125 times faster than the baseline method (online knowledge distillation) while the accuracy is similar or higher.


Distance Learner: Incorporating Manifold Prior to Model Training

arXiv.org Artificial Intelligence

The manifold hypothesis (real world data concentrates near low-dimensional manifolds) is suggested as the principle behind the effectiveness of machine learning algorithms in very high dimensional problems that are common in domains such as vision and speech. Multiple methods have been proposed to explicitly incorporate the manifold hypothesis as a prior in modern Deep Neural Networks (DNNs), with varying success. In this paper, we propose a new method, Distance Learner, to incorporate this prior for DNN-based classifiers. Distance Learner is trained to predict the distance of a point from the underlying manifold of each class, rather than the class label. For classification, Distance Learner then chooses the class corresponding to the closest predicted class manifold. Distance Learner can also identify points as being out of distribution (belonging to neither class), if the distance to the closest manifold is higher than a threshold. We evaluate our method on multiple synthetic datasets and show that Distance Learner learns much more meaningful classification boundaries compared to a standard classifier. We also evaluate our method on the task of adversarial robustness, and find that it not only outperforms standard classifier by a large margin, but also performs at par with classifiers trained via state-of-the-art adversarial training.


Deep Learning Methods for Protein Family Classification on PDB Sequencing Data

arXiv.org Artificial Intelligence

Composed of amino acid chains that influence how they fold and thus dictating their function and features, proteins are a class of macromolecules that play a central role in major biological processes and are required for the structure, function, and regulation of the body's tissues. Understanding protein functions is vital to the development of therapeutics and precision medicine, and hence the ability to classify proteins and their functions based on measurable features is crucial; indeed, the automatic inference of a protein's properties from its sequence of amino acids, known as its primary structure, remains an important open problem within the field of bioinformatics, especially given the recent advancements in sequencing technologies and the extensive number of known but uncategorized proteins with unknown properties. In this work, we demonstrate and compare the performance of several deep learning frameworks, including novel bi-directional LSTM and convolutional models, on widely available sequencing data from the Protein Data Bank (PDB) of the Research Collaboratory for Structural Bioinformatics (RCSB), as well as benchmark this performance against classical machine learning approaches, including k-nearest neighbors and multinomial regression classifiers, trained on experimental data. Our results show that our deep learning models deliver superior performance to classical machine learning methods, with the convolutional architecture providing the most impressive inference performance.