How to Prepare a Photo Caption Dataset for Training a Deep Learning Model - Machine Learning Mastery

Automatic photo captioning is a problem where a model must generate a human-readable textual description given a photograph. It is a challenging problem in artificial intelligence that requires both image understanding from the field of computer vision as well as language generation from the field of natural language processing. It is now possible to develop your own image caption models using deep learning and freely available datasets of photos and their descriptions. In this tutorial, you will discover how to prepare photos and textual descriptions ready for developing a deep learning automatic photo caption generation model. How to Prepare a Photo Caption Dataset for Training a Deep Learning Model Photo by beverlyislike, some rights reserved. This tutorial assumes you have a Python 3 SciPy environment installed. You can use Python 2, but you may need to change some of the examples. You must have Keras (2.0 or higher) installed with either the TensorFlow or Theano backend.