Goto

Collaborating Authors


Offensive Language and Hate Speech Detection with Deep Learning and Transfer Learning

arXiv.org Artificial Intelligence

Toxic online speech has become a crucial problem nowadays due to an exponential increase in the use of internet by people from different cultures and educational backgrounds. Differentiating if a text message belongs to hate speech and offensive language is a key challenge in automatic detection of toxic text content. In this paper, we propose an approach to automatically classify tweets into three classes: Hate, offensive and Neither. Using public tweet data set, we first perform experiments to build BI-LSTM models from empty embedding and then we also try the same neural network architecture with pre-trained Glove embedding. Next, we introduce a transfer learning approach for hate speech detection using an existing pre-trained language model BERT (Bidirectional Encoder Representations from Transformers), DistilBert (Distilled version of BERT) and GPT-2 (Generative Pre-Training). We perform hyper parameters tuning analysis of our best model (BI-LSTM) considering different neural network architectures, learn-ratings and normalization methods etc. After tuning the model and with the best combination of parameters, we achieve over 92 percent accuracy upon evaluating it on test data. We also create a class module which contains main functionality including text classification, sentiment checking and text data augmentation. This model could serve as an intermediate module between user and Twitter.


Build Your First Deep Learning Classifier using TensorFlow: Dog Breed Example

#artificialintelligence

In this article, I will present several techniques for you to make your first steps towards developing an algorithm that could be used for a classic image classification problem: detecting dog breed from an image. By the end of this article, we'll have developed code that will accept any user-supplied image as input and return an estimate of the dog's breed. Also, if a human is detected, the algorithm will provide an estimate of the dog breed that is most resembling. This project was completed as part of Udacity's Machine Learning Nanodegree (GitHub repo). Convolutional neural networks (also refered to as CNN or ConvNet) are a class of deep neural networks that have seen widespread adoption in a number of computer vision and visual imagery applications.


Build Your First Deep Learning Classifier using TensorFlow: Dog Breed Example

#artificialintelligence

In this article, I will present several techniques for you to make your first steps towards developing an algorithm that could be used for a classic image classification problem: detecting dog breed from an image. By the end of this article, we'll have developed code that will accept any user-supplied image as input and return an estimate of the dog's breed. Also, if a human is detected, the algorithm will provide an estimate of the dog breed that is most resembling. This project was completed as part of Udacity's Machine Learning Nanodegree (GitHub repo). Convolutional neural networks (also refered to as CNN or ConvNet) are a class of deep neural networks that have seen widespread adoption in a number of computer vision and visual imagery applications.


What is transfer learning? Exploring the popular deep learning approach

#artificialintelligence

Transfer learning is the reuse of a pre-trained model on a new problem. It's currently very popular in deep learning because it can train deep neural networks with comparatively little data. This is very useful since most real-world problems typically do not have millions of labeled data points to train such complex models. We'll take a look at what transfer learning is, how it works, why and when you it should be used. Additionally, we'll cover the different approaches of transfer learning and provide you with some resources on already pre-trained models.