[R] Frame Interpolation with Multi-Scale Deep Loss Functions and Generative Adversarial Networks • r/MachineLearning

Really happy to see more work coming out for video frame interpolation! My experience with the SepConv paper they compare to was quite good (see this .25x-speed With this paper promising even better performance at comparable quality, it seems like time is ripe for a neatly packaged docker image/app bundle/in-browser network to automatically temporally upsample movie files to 60fps on consumer hardware. As an aside–naively operating on each pair of frames independently doesn't necessarily work when applied to film or animation, because of jump cuts (film) and repeated frames (animation). But it seems reasonably straightforward to detect those two special cases (based on total/max per-pixel difference between successive frames, I guess?) and avoid them with a bit of coding.