floydhub
GPT-2: How to Build "The AI That's Too Dangerous to Release"
The sentence you just read wasn't written by me, the author of this article, nor was it written by the editor. No. What you just read was written entirely by OpenAI's GPT-2 language model, prompted only with the word "Today". Apart from another fancy acronym, GPT-2 brought along somewhat coherent (semantically, at least) language generation capabilities, some semblance of hope for zero-shot transfer learning, and a transformer network trained with approximately 1.5 billion parameters on a text corpus with over 40 gigabytes of internet wisdom. In this post, I'm not going to talk about better language models and their implications. As the great Stan Lee once said, "nuff said" about that.
How to colorize black & white photos with just 100 lines of neural network code
Earlier this year, Amir Avni used neural networks to troll the subreddit/r/Colorization -- a community where people colorize historical black and white images manually using Photoshop. They were astonished with Amir's deep learning bot. What could take up to a month of manual labour could now be done in just a few seconds. I was fascinated by Amir's neural network, so I reproduced it and documented the process. First off, let's look at some of the results/failures from my experiments (scroll to the bottom for the final result). Today, colorization is usually done by hand in Photoshop. In short, a picture can take up to one month to colorize. A face alone needs up to 20 layers of pink, green and blue shades to get it just right. This article is for beginners. Yet, if you're new to deep learning terminology, you can read my previous two posts here and here, and watch Andrej Karpathy's lecture for more background. I'll show you how to build your own colorization neural net in three steps. We'll build a bare-bones 40-line neural network as an "alpha" colorization bot.
floydhub/examples
If you are new to FloydHub, we recommend creating a free account so that you'll be able run jobs and workspaces on our service. Check out FloydHub Templates for more information on these examples. Each example provides a one-click "Run on FloydHub" button. We'd love to add more examples from the community! Please add examples via Pull requests!
Ten Techniques Learned From fast.ai
Right now, Jeremy Howard โ the co-founder of fast.ai Why? His own students are beating him. And their names can now be found across the tops of leaderboards all over Kaggle. So what are these secrets that are allowing novices to implement world-class algorithms in mere weeks, leaving behind experienced deep learning practitioners in their GPU-powered wake? Allow me to tell you in ten simple steps.
Lessons Learned Reproducing a Deep Reinforcement Learning Paper
There are a lot of neat things going on in deep reinforcement learning. One of the coolest things from last year was OpenAI and DeepMind's work on training an agent using feedback from a human rather than a classical reward signal. There's a great blog post about it at Learning from Human Preferences, and the original paper is at Deep Reinforcement Learning from Human Preferences. I've seen a few recommendations that reproducing papers is a good way of levelling up machine learning skills, and I decided this could be an interesting one to try with. It was indeed a super fun project, and I'm happy to have tackled it - but looking back, I realise it wasn't exactly the experience I thought it would be. If you're thinking about reproducing papers too, here are some notes on what surprised me about working with deep RL.
How you can train an AI to convert your design mockups into HTML and CSS
Currently, the largest barrier to automating front-end development is computing power. However, we can use current deep learning algorithms, along with synthesized training data, to start exploring artificial front-end automation right now. In this post, we'll teach a neural network how to code a basic a HTML and CSS website based on a picture of a design mockup. We'll build the neural network in three iterations. First, we'll make a bare minimum version to get a hang of the moving parts. The second version, HTML, will focus on automating all the steps and explaining the neural network layers. In the final version, Bootstrap, we'll create a model that can generalize and explore the LSTM layer.
How you can train AI to convert design mockups into HTML and CSS
Currently, the largest barrier to automating front-end development is computing power. However, we can use current deep learning algorithms, along with synthesized training data, to start exploring artificial front-end automation right now. In this post, we'll teach a neural network how to code a b...
Turning Design Mockups Into Code With Deep Learning - FloydHub Blog
Within three years deep learning will change front-end development. It will increase prototyping speed and lower the barrier for building software. The field took off last year when Tony Beltramelli introduced the pix2code paper and Airbnb launched sketch2code. Currently, the largest barrier to au...
How you can train AI to convert design mockups into HTML and CSS
Currently, the largest barrier to automating front-end development is computing power. However, we can use current deep learning algorithms, along with synthesized training data, to start exploring artificial front-end automation right now. In this post, we'll teach a neural network how to code a basic HTML and CSS website based on a picture of a design mockup using deep-learning platform FloydHub. We'll build the neural network in three iterations. First, we'll make a bare minimum version to get a hang of the moving parts. The second version, HTML, will focus on automating all the steps and explaining the neural network layers. In the final version, Bootstrap, we'll create a model that can generalize and explore the LSTM layer.
How you can train an AI to convert your design mockups into HTML and CSS
Currently, the largest barrier to automating front-end development is computing power. However, we can use current deep learning algorithms, along with synthesized training data, to start exploring artificial front-end automation right now. In this post, we'll teach a neural network how to code a basic a HTML and CSS website based on a picture of a design mockup. We'll build the neural network in three iterations. First, we'll make a bare minimum version to get a hang of the moving parts. The second version, HTML, will focus on automating all the steps and explaining the neural network layers. In the final version, Bootstrap, we'll create a model that can generalize and explore the LSTM layer.