Goto

Collaborating Authors

 Deep Learning


Sub-pixel face landmarks using heatmaps and a bag of tricks

arXiv.org Artificial Intelligence

Accurate face landmark localization is an essential part of face recognition, reconstruction and morphing. To accurately localize face landmarks, we present our heatmap regression approach. Each model consists of a MobileNetV2 backbone followed by several upscaling layers, with different tricks to optimize both performance and inference cost. We use five na\"ive face landmarks from a publicly available face detector to position and align the face instead of using the bounding box like traditional methods. Moreover, we show by adding random rotation, displacement and scaling -- after alignment -- that the model is more sensitive to the face position than orientation. We also show that it is possible to reduce the upscaling complexity by using a mixture of deconvolution and pixel-shuffle layers without impeding localization performance. We present our state-of-the-art face landmark localization model (ranking second on The 2nd Grand Challenge of 106-Point Facial Landmark Localization validation set). Finally, we test the effect on face recognition using these landmarks, using a publicly available model and benchmarks.


Designing Custom 2D and 3D CNNs in PyTorch

#artificialintelligence

This tutorial is based on my repository pytorch-computer-vision which contains PyTorch code for training and evaluating custom neural networks on custom data. If you want to follow along with this tutorial and/or use the code, you should clone or download the repository. For more background on using Git see this post. Inside the repository, there is a yml file, tutorial_environment.yml, that includes all the dependencies needed to run the tutorial code. Note that in the conda environment the Python version and package versions are not "bleeding edge" so that this environment should work on Linux, Mac, or Windows. For more background on Anaconda and why it's useful for machine learning projects, see this post.


Applied Deep Learning PDF

#artificialintelligence

Work with advanced topics in deep learning, such as optimization algorithms, hyper-parameter tuning, dropout, and error analysis as well as strategies to address typical problems encountered when training deep neural networks. You'll begin by studying the activation functions mostly with a single neuron (ReLu, sigmoid, and Swish), seeing how to perform linear and logistic regression using TensorFlow, and choosing the right cost function. The next section talks about more complicated neural network architectures with several layers and neurons and explores the problem of random initialization of weights. An entire chapter is dedicated to a complete overview of neural network error analysis, giving examples of solving problems originating from variance, bias, overfitting, and datasets coming from different distributions. Applied Deep Learning also discusses how to implement logistic regression completely from scratch without using any Python library except NumPy, to let you appreciate how libraries such as TensorFlow allow quick and efficient experiments.


DALL-E Makes Creative Images From Text: Science Fiction in the News

#artificialintelligence

Dall-E is a model based on GPT-3 that generates images using a short text caption. The name "DALL-E" is a portmanteau of the artist Salvador Dal-- and Pixar--s WALL--E . For example, if you asked for an armchair like an avocado, what might it look like?


The Future of AI Innovation

#artificialintelligence

Exploring how deep reasoning, small data, unsupervised learning, more efficient deep learning models, and new AI hardware can accelerate AI innovation.


How to Update Neural Network Models With More Data

#artificialintelligence

Deep learning neural network models used for predictive modeling may need to be updated. This may be because the data has changed since the model was developed and deployed, or it may be the case that additional labeled data has been made available since the model was developed and it is expected that the additional data will improve the performance of the model. It is important to experiment and evaluate with a range of different approaches when updating neural network models for new data, especially if model updating will be automated, such as on a periodic schedule. There are many ways to update neural network models, although the two main approaches involve either using the existing model as a starting point and retraining it, or leaving the existing model unchanged and combining the predictions from the existing model with a new model. In this tutorial, you will discover how to update deep learning neural network models in response to new data.


AI Researchers Make A Case For Better Benchmarks In AI

#artificialintelligence

Stanford University recently released the 2021 AI Index, highlighting major trends and advancements in artificial intelligence. The fourth edition of the report talked about technology's impact on society, education, and policy and outlined the progress made in other AI subdomains such as deep learning, object detection, NLP, etc. The highlights from the 2021 report included AI research citations, AI startup fundings, and growing conversation around AI ethics. One of the more significant observations made in the report was about the need for more and better benchmarks in AI and other related fields such as ethics, NLP, and computer vision. "We're running out of tests as fast as we can build them," said Jack Clark, head of an OECD group working on algorithm impact assessment and former policy director for OpenAI.


Computer Vision: Python OCR & Object Detection Quick Starter

#artificialintelligence

Free Coupon Discount - Computer Vision: Python OCR & Object Detection Quick Starter Quick Starter for Optical Character Recognition, Image Recognition Object Detection and Object Recognition using Python Created by Abhilash Nelson Students also bought Deep Learning Prerequisites: Logistic Regression in Python Deep Learning: Convolutional Neural Networks in Python Deep Learning A-Z: Hands-On Artificial Neural Networks The Complete Self-Driving Car Course - Applied Deep Learning The Complete Neural Networks Bootcamp: Theory, Applications Preview this Udemy Course GET COUPON CODE Description Hi There! welcome to my new course'Optical Character Recognition and Object Recognition Quick Start with Python'. This is the third course from my Computer Vision series. Image Recognition, Object Detection, Object Recognition and also Optical Character Recognition are among the most used applications of Computer Vision. Using these techniques, the computer will be able to recognize and classify either the whole image, or multiple objects inside a single image predicting the class of the objects with the percentage accuracy score. Using OCR, it can also recognize and convert text in the images to machine readable format like text or a document.


Developing smarter, faster machine intelligence with light: Researchers invent an optical convolutional neural network accelerator for machine learning

#artificialintelligence

Global demand for machine learning hardware is dramatically outpacing current computing power supplies. State-of-the-art electronic hardware, such as graphics processing units and tensor processing unit accelerators, help mitigate this, but are intrinsically challenged by serial data processing that requires iterative data processing and encounters delays from wiring and circuit constraints. Optical alternatives to electronic hardware could help speed up machine learning processes by simplifying the way information is processed in a non-iterative way. However, photonic-based machine learning is typically limited by the number of components that can be placed on photonic integrated circuits, limiting the interconnectivity, while free-space spatial-light-modulators are restricted to slow programming speeds. To achieve a breakthrough in this optical machine learning system, the researchers replaced spatial light modulators with digital mirror-based technology, thus developing a system over 100 times faster.


GPT-3 & Beyond: 10 NLP Research Papers You Should Read

#artificialintelligence

NLP research advances in 2020 are still dominated by large pre-trained language models, and specifically transformers. There were many interesting updates introduced this year that have made transformer architecture more efficient and applicable to long documents. Another hot topic relates to the evaluation of NLP models in different applications. We still lack evaluation approaches that clearly show where a model fails and how to fix it. Also, with the growing capabilities of language models such as GPT-3, conversational AI is enjoying a new wave of interest. Chatbots are improving, with several impressive bots like Meena and Blender introduced this year by top technology companies.