vmaf
High-Quality, ROS Compatible Video Encoding and Decoding for High-Definition Datasets
Li, Jian, Xu, Bowen, Schwertfeger, Sören
In order for the compressed Datasets are an important tool for research and development dataset to be useful as a reference dataset for SLAM research in mobile robotics. For example, for evaluating Simultaneous and benchmarking, a truly excellent video quality has to be Localization and Mapping (SLAM) algorithms [1], maintained. As reported in [8], [9], compression artefacts can datasets play an important role [2], [3]. Sensor technology in fact reduce the applicability of video streams to various is advancing rapidly, such that better camera sensors with applications such as object detection. Specifically, we do higher resolutions and higher frame rates are available for not need to encode the videos in real-time, but will do use in robotic systems. While older datasets like KITTI from the compression in post-processing, because there are not 2013 [4] use 1.4MP cameras with a frame rate of 10Hz, later enough computation resources even on a 16-node cluster to datasets offer for example 5MP images with 10 Hz [5].
VMAF Re-implementation on PyTorch: Some Experimental Results
Aistov, Kirill, Koroteev, Maxim
Note, that these estimates in principle less susceptible to such preprocessing. The original VMAF have to be computed over the sample of images. Instead, the algorithm was implemented in C [3] and no effort is known assumption is made that the estimates can be computed over to us to re-implement it fully, i.e., including all its sub-metrics the patches ([4], section IV; [5]) using some ML framework. One of the reasons for that is VIF is computed on four scales by downsampling the image; the claimed non-differentiability of this metric. We propose four values per frame are used as features for final score an implementation of VMAF using PyTorch and analyze regression. The original version of VIF included the wavelet its differentiability with various methods. We also discuss transform, but the same authors released another version of potential problems related to the computation of this metric VIF in the pixel domain [6]. VMAF uses only the pixel domain in the end of the paper.
LSTM-based Video Quality Prediction Accounting for Temporal Distortions in Videoconferencing Calls
Mittag, Gabriel, Naderi, Babak, Gopal, Vishak, Cutler, Ross
Although other pooling mechanisms have been studied in order to take recency effects into account, in most studies Current state-of-the-art video quality models, such as VMAF, mean pooling achieved the best performance [6, 7]. VMAF is give excellent prediction results by comparing the degraded the only of those metrics that include a temporal component, video with its reference video. However, they do not consider which considers temporal masking effects. However, video temporal distortions (e.g., frame freezes or skips) that transmitted during VC calls can be affected by a number of occur during videoconferencing calls. In this paper, we temporal distortions that are perceived as frame freezes, frame present a data-driven approach for modeling such distortions skips, frame rate variations (e.g., video is played back faster automatically by training an LSTM with subjective after delayed packets arrive), or generally low frame rate.
Deep Video Precoding
Bourtsoulatze, Eirina, Chadha, Aaron, Fadeev, Ilya, Giotsas, Vasileios, Andreopoulos, Yiannis
An open question is how to make deep neural networks work in conjunction with existing (and upcoming) video codecs, such as MPEG H.264/A VC, H.265/HEVC, VVC, Google VP9 and AOMedia A V1, as well as existing container and transport formats, without imposing any changes at the client side. Such compatibility is a crucial aspect when it comes to practical deployment, especially when considering the fact that the video content industry and hardware manufacturers are expected to remain committed to supporting these standards for the foreseeable future. We propose to use deep neural networks as precoders for current and future video codecs and adaptive video streaming systems. In our current design, the core precoding component comprises a cascaded structure of downscaling neural networks that operates during video encoding, prior to transmission. This is coupled with a precoding mode selection algorithm for each independently-decodable stream segment, which adjusts the downscaling factor according to scene characteristics, the utilized encoder, and the desired bitrate and encoding configuration. Our framework is compatible with all current and future codec and transport standards, as our deep precoding network structure is trained in conjunction with linear upscaling filters (e.g., the bilinear filter), which are supported by all web video players. Results with FHD (1080p) and UHD (2160p) content and widely-used H.264/A VC, H.265/HEVC and VP9 encoders show that coupling such standards with the proposed deep video precoding allows for 15% to 45% rate reduction under encoding configurations and bitrates suitable for video-on-demand adaptive streaming systems. The use of precoding can also lead to encoding complexity reduction, which is essential for cost-effective cloud deployment of complex encoders like H.265/HEVC and VP9, especially when considering the prominence of high-resolution adaptive video streaming.