Collaborating Authors

Nvidia's latest AI tech translates text into landscape images


Nvidia today detailed an AI system called GauGAN2, the successor to its GauGAN model, that lets users create lifelike landscape images that don't exist. Combining techniques like segmentation mapping, inpainting, and text-to-image generation in a single tool, GauGAN2 is designed to create photorealistic art with a mix of words and drawings. "Compared to state-of-the-art models specifically for text-to-image or segmentation map-to-image applications, the neural network behind GauGAN2 produces a greater variety and higher-quality of images," Isha Salian, a member of Nvidia's corporate communications team, wrote in a blog post. "Rather than needing to draw out every element of an imagined scene, users can enter a brief phrase to quickly generate the key features and theme of an image, such as a snow-capped mountain range. This starting point can then be customized with sketches to make a specific mountain taller or add a couple of trees in the foreground, or clouds in the sky."

NVIDIA's AI Creates Realistic Photos Based Only on Text Descriptions


NVIDIA's GauGAN2 artificial intelligence (AI) can now use simple written phrases to generate a fitting photorealistic image. The deep-learning model is able to craft different scenes in just three or four words. GauGAN is NVIDIA's AI program that was used to turn simple doodles into photorealistic masterpieces in 2019, a technology that was eventually turned into the NVIDIA Canvas app earlier this year. Now NVIDIA has advanced the AI even further to where it only needs a brief description in order to generate a "photo." NVIDIA says that the deep learning model behind GauGAH allows anyone to make beautiful scenes, and now it's even easier than it ever has been.

The absurd beauty of hacking Nvidia's GauGAN 2 AI image machine


Typing the words "ZDNet superb reporting" into Nvidia's GauGAN 2 AI program automatically produces surreal images. Type the words "ZDNet superb reporting" into Nvidia's new artificial intelligence demo, GauGAN 2, and you will see a picture of what looks like large pieces of foam insulation wrestling in a lake against a snowy backdrop. Add more words, such as "ZDNet superb reporting comely," and you'll see the image morphed into something new, some barely recognizable form, perhaps a Formula One race car that has been digested, proceeding along what looks sort-of like a road, in front of blurry views of a man-made structure. GauGAN 2 produces a strange interpretation of the phrase "ZDNet superb reporting comely." Roll the dice with a little button of an image of two dice, and you'll, and the same phrase becomes a spooky, mist-shrouded landscape with a yawning mouth of some sort of organic nature, but completely unidentifiable as to its exact species.

Nvidia Canvas uses GauGAN2 AI model to achieve 4x resolution boost


Nvidia has updated its Canvas real-time painting tool with a new AI model based on GauGAN2 research to achieve a 4x resolution boost. Canvas enables artists to turn simple brushstrokes into realistic landscapes filled with materials including water, grass, snow, mountains, and more. The idea is that concepts can be turned into final versions far quicker than ever before. The free software, which is still in beta, is the perfect example of how AI complements and enhances human abilities rather than replaces. Canvas' latest update achieves close to photorealism with greater definition and fewer artifacts: The software delivers images in up to 1K pixel resolution and the results can be exported to apps like Adobe Photoshop to integrate with an artist's existing workflow. GauGAN2 combines segmentation mapping, inpainting, and text-to-image generation in a single model.

GauGAN Turns Doodles into Stunning, Realistic Landscapes NVIDIA Blog


A novice painter might set brush to canvas aiming to create a stunning sunset landscape -- craggy, snow-covered peaks reflected in a glassy lake -- only to end up with something that looks more like a multi-colored inkblot. But a deep learning model developed by NVIDIA Research can do just the opposite: it turns rough doodles into photorealistic masterpieces with breathtaking ease. The tool leverages generative adversarial networks, or GANs, to convert segmentation maps into lifelike images. The interactive app using the model, in a lighthearted nod to the post-Impressionist painter, has been christened GauGAN. GauGAN could offer a powerful tool for creating virtual worlds to everyone from architects and urban planners to landscape designers and game developers.