Recent advances in text-conditioned video diffusion have greatly improved video quality. However, these methods offer limited or sometimes no control to users on camera aspects, including dynamic camera motion, zoom, distorted lens and focus shifts. These motion and optical aspects are crucial for adding controllability and cinematic elements to generation frameworks, ultimately resulting in visual content that draws focus, enhances mood, and guides emotions according to filmmakers' controls. In this paper, we aim to close the gap between controllable video generation and camera optics. To achieve this, we propose AKiRa (Augmentation Kit on Rays), a novel augmentation framework that builds and trains a camera adapter with a complex camera model over an existing video generation backbone. It enables fine-tuned control over camera motion as well as complex optical parameters (focal length, distortion, aperture) to achieve cinematic effects such as zoom, fisheye effect, and bokeh. Extensive experiments demonstrate AKiRa's effectiveness in combining and composing camera optics while outperforming all state-of-the-art methods. This work sets a new landmark in controlled and optically enhanced video generation, paving the way for future optical video generation methods.

In the following sections, I will introduce various articles and papers not only on the above contents but also on the following five topics. Since molecules have different interatomic distances depending on the nature of the target atoms, they proposed multi-scale Self-Attention, which adjusts the application of Attention according to the distance, and AFPS, which downsamples according to the Attention score. It showed good performance on quantum chemical molecular data sets.

In the following sections, I will introduce various articles and papers not only on the above contents but also on the following five topics. MERLOT: Multimodal Neural Script Knowledge Models Using as much as 6 million video data and accompanying subtitles, MERIOT is proposed to perform self-supervised learning on both temporal and spatial tasks. It does not use any label information but can achieve SotA performance. Also, the accuracy of the pre-training continues to increase even with 6 million data, which is considered a promising research direction for the future.

In the following sections, I will introduce various articles and papers not only on the above contents but also on the following five topics. Winning tickets in pre-training are transferable -- arxiv.org The results show that Winning Ticket is present regardless of whether pre-training is supervised or unsupervised.

Jiro's pick this week is CNN for Old Japanese Character Classification by one of my colleagues Akira Agata. Nowadays, I probably go many days without seeing a handwritten document. From computers, to smartphones, to TVs, to books, almost every character I see is a printed character. So it's refreshing to see a handwritten document from time to time. This demo by Akira uses deep learning (convolutional neural networks) to classify various handwritten Japanese characters.

The sacred Olympic flame can surely be trusted to stay lit in the care of Godzilla -- a famous Japanese character in the form of a giant, fire-breathing monster. There's literally a game called "Mario & Sonic at the Olympic Games," so when Shinzo Abe appeared as Mario, he left many fans wondering where exactly Sonic was. Hopefully Tokyo will take advantage of this beautiful opportunity and give Sonic the attention he deserves. If you think the real 2020 Olympics are gonna be cool wait till you see Mario and Sonic at the Tokyo games. I'm just saying Mario and Sonic at Tokyo 2020 SEGA, you have the Miku license I'M JUST SAYIN' If Tokyo 2020 isn't just a huge recreation of Mario and Sonic at the Olympic Games, I'm going to be thoroughly disappointed Can Mario please be the icon of the 2020 Olympics? And then Mario's face is literally the logo of Mario and Sonic 2020 games