Bringing the Mona Lisa Effect to Life with TensorFlow.js

Urban legend says that Mona Lisa's eyes will follow you as you move around the room. This is known as the "Mona Lisa effect." For fun, I recently programmed an interactive digital portrait that brings this phenomenon to life through your browser and webcam. The general idea is as follows: first, we must generate a sequence of images of Mona Lisa's head, with eyes gazing from the left to right. From this pool, we'll continuously select and display a single frame in real-time based on the viewer's location. In this post, I'll walk through the specifics of the project's technical design and implementation.