Goto

Collaborating Authors

 daegu


VIINTER: View Interpolation with Implicit Neural Representations of Images

arXiv.org Artificial Intelligence

We present VIINTER, a method for view interpolation by interpolating the implicit neural representation (INR) of the captured images. We leverage the learned code vector associated with each image and interpolate between these codes to achieve viewpoint transitions. We propose several techniques that significantly enhance the interpolation quality. VIINTER signifies a new way to achieve view interpolation without constructing 3D structure, estimating camera poses, or computing pixel correspondence. We validate the effectiveness of VIINTER on several multi-view scenes with different types of camera layout and scene composition. As the development of INR of images (as opposed to surface or volume) has centered around tasks like image fitting and super-resolution, with VIINTER, we show its capability for view interpolation and offer a promising outlook on using INR for image manipulation tasks.


CLIP-Mesh: Generating textured meshes from text using pretrained image-text models

arXiv.org Artificial Intelligence

We present a technique for zero-shot generation of a 3D model using only a target text prompt. Without any 3D supervision our method deforms the control shape of a limit subdivided surface along with its texture map and normal map to obtain a 3D asset that corresponds to the input text prompt and can be easily deployed into games or modeling applications. We rely only on a pre-trained CLIP model that compares the input text prompt with differentiably rendered images of our 3D model. While previous works have focused on stylization or required training of generative models we perform optimization on mesh parameters directly to generate shape, texture or both. To constrain the optimization to produce plausible meshes and textures we introduce a number of techniques using image augmentations and the use of a pretrained prior that generates CLIP image embeddings given a text embedding.


A Markov Reward Process-Based Approach to Spatial Interpolation

arXiv.org Artificial Intelligence

The interpolation of spatial data can be of tremendous value in various applications, such as forecasting weather from only a few measurements of meteorological or remote sensing data. Existing methods for spatial interpolation, such as variants of kriging and spatial autoregressive models, tend to suffer from at least one of the following limitations: (a) the assumption of stationarity, (b) the assumption of isotropy, and (c) the trade-off between modelling local or global spatial interaction. Addressing these issues in this work, we propose the use of Markov reward processes (MRPs) as a spatial interpolation method, and we introduce three variants thereof: (i) a basic static discount MRP (SD-MRP), (ii) an accurate but mostly theoretical optimised MRP (O-MRP), and (iii) a transferable weight prediction MRP (WP-MRP). All variants of MRP interpolation operate locally, while also implicitly accounting for global spatial relationships in the entire system through recursion. Additionally, O-MRP and WP-MRP no longer assume stationarity and are robust to anisotropy. We evaluated our proposed methods by comparing the mean absolute errors of their interpolated grid cells to those of 7 common baselines, selected from models based on spatial autocorrelation, (spatial) regression, and deep learning. We performed detailed evaluations on two publicly available datasets (local GDP values, and COVID-19 patient trajectory data). The results from these experiments clearly show the competitive advantage of MRP interpolation, which achieved significantly lower errors than the existing methods in 23 out of 40 experimental conditions, or 35 out of 40 when including O-MRP.


South Korean firm develop a test that detects coronavirus in 10 minutes

#artificialintelligence

Most of the major economies are struggling to control the Wuhan virus in their region, but one country that stands out from the rest: South Korea. Utilizing big-data analysis, AI-based warning system & observation tools, Korea has already managed to bring coronavirus situation in the country under control in a short time. One of the major reasons behind this is their strategy to aggressively boost the number of coronavirus tests per day. Recently a South Korean company reports that by using artificial intelligence they have developed a simple tester that it said could detect if a person is infected with coronavirus disease 2019 in just 10 minutes. The company, PCL, a provider of in vitro diagnostic products, said its breakthrough testing kit, named COVID-19 Ag GICA Rapid, this testing kit can check nasal discharge for the presence of the virus within a period of time 10 minutes with an accuracy rate of more than 85 percent.