Generating User Interface Code From Images Using Machine Learning

As machine learning matures, we're finding more and more applications for the technology, beyond the niche and novelty. It's even starting to encroach on the jobs of designers and programmers, if Tony Beltramelli's research project "pix2code" is anything to go by. As the video above shows, using a trained neural network Beltramelli is able to input an image of a user interface and the program will output code (either for iOS, Android or web) of that UI. According to Beltramelli, the current iteration is able to produce results with 77 per cent accuracy. Of course, the idea behind pix2code is to simply show what's possible -- it's in no way ready for prime time.