Deep Learning
8 Deep Learning Project Ideas for Beginners - KDnuggets
There are various dog breeds, and most of them are similar to each other. As a beginner, you can build a Dog's breed identification model to identify the dog's breed. For this project, you can use the dog breeds dataset to classify various dog breeds from an image. I also found this complete tutorial for Dog Breed Classification using Deep Learning by Kirill Panarin. This is also a good deep learning project for beginners. In this project, you have to build a deep learning model that detects the human faces from the image.
Machine Learning: Makes Human to Train Them
Machine learning is one of the technology that has become more and more popular with time and machine learning is the subset of the Artificial Intelligence which comes to your knowledge when you are connected to IT industry. Most of the companies like Netflix, Google and smaller companies uses Machine learning algoithms to predict the insights from the data. Although terms like artificial intelligence, machine learning and deep learning are used interchangeably but, they are not the same thing. Machine learning is the subset of artificial intelligence and deep learning is a subset of machine learning. Alan Turing's vision towards machine learning is being explained in one of his seminal paper such as " Machine learning is an application of artificial intelligence where a computer/machine learns from the past experiences (input data) and make future predictions. The performance of such a system should be at least human level."
Deep learning model classifies brain tumors with single MRI scan
"This is the first study to address the most common intracranial tumors and to directly determine the tumor class or the absence of tumor from a 3D MRI volume," said Satrajit Chakrabarty, M.S., a doctoral student under the direction of Aristeidis Sotiras, Ph.D., and Daniel Marcus, Ph.D., in Mallinckrodt Institute of Radiology's Computational Imaging Lab at Washington University School of Medicine in St. Louis, Missouri. The six most common intracranial tumor types are high-grade glioma, low-grade glioma, brain metastases, meningioma, pituitary adenoma and acoustic neuroma. Each was documented through histopathology, which requires surgically removing tissue from the site of a suspected cancer and examining it under a microscope. "Non-invasive MRI may be used as a complement, or in some cases, as an alternative to histopathologic examination," he said. To build their machine learning model, called a convolutional neural network, Chakrabarty and researchers from Mallinckrodt Institute of Radiology developed a large, multi-institutional dataset of intracranial 3D MRI scans from four publicly available sources.
How could Transfer Learning be used in Artificial Intelligence?
Machine Learning and Artificial Intelligence are being used in many industries and their usage keeps growing with an increase in the performance of the systems respectively. Some of the interesting applications of machine learning are in Self-driving cars and pharmaceutical industries. There are a lot of latest interesting applications being created every day with the use of AI and machine learning. There is a subset of Artificial Intelligence called Deep Learning where there are complex units of neurons that would perform the computations when needed. One thing to note is that when performing these computations, the models would optimize their weights and biases in the process of classifying a certain set of objects in images in the case of image classification tasks.
Quantitative reconstruction of defects in multi-layered bonded composites using fully convolutional network-based ultrasonic inversion
Rao, Jing, Yang, Fangshu, Mo, Huadong, Kollmannsberger, Stefan, Rank, Ernst
Ultrasonic methods have great potential applications to detect and characterize defects in multi-layered bonded composites. However, it remains challenging to quantitatively reconstruct defects, such as disbonds and kissing bonds, that influence the integrity of adhesive bonds and seriously reduce the strength of assemblies. In this work, an ultrasonic method based on the supervised fully convolutional network (FCN) is proposed to quantitatively reconstruct defects hidden in multi-layered bonded composites. In the training process of this method, an FCN establishes a non-linear mapping from measured ultrasonic data to the corresponding velocity models of multi-layered bonded composites. In the predicting process, the trained network obtained from the training process is used to directly reconstruct the velocity models from the new measured ultrasonic data of adhesively bonded composites. The presented FCN-based inversion method can automatically extract useful features in multi-layered composites. Although this method is computationally expensive in the training process, the prediction itself in the online phase takes only seconds. The numerical results show that the FCN-based ultrasonic inversion method is capable to accurately reconstruct ultrasonic velocity models of the high contrast defects, which has great potential for online detection of adhesively bonded composites.
Sequential Modelling with Applications to Music Recommendation, Fact-Checking, and Speed Reading
Sequential modelling entails making sense of sequential data, which naturally occurs in a wide array of domains. One example is systems that interact with users, log user actions and behaviour, and make recommendations of items of potential interest to users on the basis of their previous interactions. In such cases, the sequential order of user interactions is often indicative of what the user is interested in next. Similarly, for systems that automatically infer the semantics of text, capturing the sequential order of words in a sentence is essential, as even a slight re-ordering could significantly alter its original meaning. This thesis makes methodological contributions and new investigations of sequential modelling for the specific application areas of systems that recommend music tracks to listeners and systems that process text semantics in order to automatically fact-check claims, or "speed read" text for efficient further classification.
Towards a Rigorous Evaluation of Time-series Anomaly Detection
Kim, Siwon, Choi, Kukjin, Choi, Hyun-Soo, Lee, Byunghan, Yoon, Sungroh
In recent years, proposed studies on time-series anomaly detection (TAD) report high F1 scores on benchmark TAD datasets, giving the impression of clear improvements. However, most studies apply a peculiar evaluation protocol called point adjustment (PA) before scoring. In this paper, we theoretically and experimentally reveal that the PA protocol has a great possibility of overestimating the detection performance; that is, even a random anomaly score can easily turn into a state-of-the-art TAD method. Therefore, the comparison of TAD methods with F1 scores after the PA protocol can lead to misguided rankings. Furthermore, we question the potential of existing TAD methods by showing that an untrained model obtains comparable detection performance to the existing methods even without PA. Based on our findings, we propose a new baseline and an evaluation protocol. We expect that our study will help a rigorous evaluation of TAD and lead to further improvement in future researches.
AdaK-NER: An Adaptive Top-K Approach for Named Entity Recognition with Incomplete Annotations
Ruan, Hongtao, Zheng, Liying, Hu, Peixian, Xu, Liang, Xiao, Jing
State-of-the-art Named Entity Recognition(NER) models rely heavily on large amountsof fully annotated training data. However, ac-cessible data are often incompletely annotatedsince the annotators usually lack comprehen-sive knowledge in the target domain. Normallythe unannotated tokens are regarded as non-entities by default, while we underline thatthese tokens could either be non-entities orpart of any entity. Here, we study NER mod-eling with incomplete annotated data whereonly a fraction of the named entities are la-beled, and the unlabeled tokens are equiva-lently multi-labeled by every possible label.Taking multi-labeled tokens into account, thenumerous possible paths can distract the train-ing model from the gold path (ground truthlabel sequence), and thus hinders the learn-ing ability. In this paper, we propose AdaK-NER, named the adaptive top-Kapproach, tohelp the model focus on a smaller feasible re-gion where the gold path is more likely to belocated. We demonstrate the superiority ofour approach through extensive experimentson both English and Chinese datasets, aver-agely improving 2% in F-score on the CoNLL-2003 and over 10% on two Chinese datasetscompared with the prior state-of-the-art works.
Empirical Analysis of Training Strategies of Transformer-based Japanese Chit-chat Systems
Sugiyama, Hiroaki, Mizukami, Masahiro, Arimoto, Tsunehiro, Narimatsu, Hiromi, Chiba, Yuya, Nakajima, Hideharu, Meguro, Toyomi
In recent years, several high-performance conversational systems have been proposed based on the Transformer encoder-decoder model. Although previous studies analyzed the effects of the model parameters and the decoding method on subjective dialogue evaluations with overall metrics, they did not analyze how the differences of fine-tuning datasets affect on user's detailed impression. In addition, the Transformer-based approach has only been verified for English, not for such languages with large inter-language distances as Japanese. In this study, we develop large-scale Transformer-based Japanese dialogue models and Japanese chit-chat datasets to examine the effectiveness of the Transformer-based approach for building chit-chat dialogue systems. We evaluated and analyzed the impressions of human dialogues in different fine-tuning datasets, model parameters, and the use of additional information.
Pyramid Hybrid Pooling Quantization for Efficient Fine-Grained Image Retrieval
Zeng, Ziyun, Wang, Jinpeng, Chen, Bin, Dai, Tao, Xia, Shu-Tao
Deep hashing approaches, including deep quantization and deep binary hashing, have become a common solution to large-scale image retrieval due to high computation and storage efficiency. Most existing hashing methods can not produce satisfactory results for fine-grained retrieval, because they usually adopt the outputs of the last CNN layer to generate binary codes, which is less effective to capture subtle but discriminative visual details. To improve fine-grained image hashing, we propose Pyramid Hybrid Pooling Quantization (PHPQ). Specifically, we propose a Pyramid Hybrid Pooling (PHP) module to capture and preserve fine-grained semantic information from multi-level features. Besides, we propose a learnable quantization module with a partial attention mechanism, which helps to optimize the most relevant codewords and improves the quantization. Comprehensive experiments demonstrate that PHPQ outperforms state-of-the-art methods.