NVIDIA Research project uses AI to instantly turn drawings into photorealistic images
NVIDIA Research has demonstrated GauGAN, a deep learning model that converts simple doodles into photorealistic images. The tool crafts images nearly instantaneously, and can intelligently adjust elements within images, such as adding reflections to a body of water when trees or mountains are placed near it.
The new tool is made possible using generative adversarial networks called GANs. With GauGAN, users select image elements like 'snow' and 'sky,' then draw lines to segment an image into different elements. The AI automatically generates the appropriate image for that element, such as a cloudy sky, grass, and trees.
As NVIDIA reveals in its demonstration video, GauGAN maintains a realistic image by dynamically adjusting parts of the render to match new elements. For example, transforming a grassy field to a snow-covered landscape will result in an automatic sky change, ensuring the two elements are compatible and realistic.
GauGAN was trained using millions of images of real environments. In addition to generating photorealistic landscapes, the tool allows users to apply style filters, including ones that give the appearance of sunset or a particular painting style. According to NVIDIA, the technology could be used to generate images of other environments, including buildings and people.
Talking about GauGAN is NVIDIA VP of applied deep learning research Bryan Catanzaro, who explained:
This technology is not just stitching together pieces of other images, or cutting and pasting textures. It's actually synthesizing new images, very similar to how an artist would draw something.
NVIDIA envisions a tool based on GauGAN could one day be used by architects and other professionals who need to quickly fill a scene or visualize an environment. Similar technology may one day be offered as a tool in image editing applications, enabling users to add or adjust elements in photos.
The company offers online demos of other AI-based tools on its AI Playground.
|a lost person by dalgo|
from - Fond Memories - (in BW Only)
|Diver's Watch-2757 by vbuhay|
|Cerulean Sukhoi by cjf2|
|Cheetah in the wild by cmgpereira|
The EOS 90D is Canon's newest DSLR camera, sporting a new 32.5MP sensor and 4K video without a crop. As Chris and Jordan discovered during their testing, there's a lot to like.
A new gallery from the Canon EOS 90D, shot by Chris and Jordan while filming this week's episode of DPReview TV. As usual, it comes complete with reflected images in puddles.
The Axibo slider can detect and keep focused on faces and most objects thanks to an integrated 6 + 1 AI core CPU
Fujifilm has announced that it is developing a 50mm F1.0 lens for its X-series, instead of the promised 33mm F1.0, as part of its X Summit event in Tokyo.
Fujifilm has revealed extensive detail about its forthcoming X-Pro3 model in a development announcement at its Fujifilm X Summit in Tokyo, Japan.
Ricoh has stated that it's developing a new flagship APS-C DSLR that it'll preview later this month and expects to bring to market in 2020.
Apple says the iPhone XR isn't going anywhere – even now that the iPhone 11 is on sale. The two devices are priced $100 apart – so what does that extra cash get you?
Something about these seems a little familiar, but we can't quite put our finger on it.
ON1 Photo RAW 2020 is now available as a public beta, bringing with it new and improved features across the board, including more AI-powered tools, improved performance and multiple integrations for a more streamlined workflow.
Huawei has announced the details of its new flagship smartphone, the Mate 30 Pro.
Sebastiaan de With, co-founder of the iOS camera app Halide, has used his app's technical readout feature to obtain very detailed camera specifications for the iPhone 11 Pro.
Our guide to the best cameras over $2000 has been updated to include overviews of some of the latest contenders.
Apple joked about the new 120 fps recording mode on its latest smartphone with 'slofies,' a made-up word that combines slo-mo and selfies, but it turns out it might've not been quite as tongue-in-cheek as we initially thought.
The C1 and C1 Plus aspire to bring studio-style lights to the world of smartphone photography for $299 and 499, respectively.
In a press release on its website, Photokina has confirmed that Leica, Nikon and Olympus have canceled their reservations for Photokina 2020.
Readers were quick to point out that Robert Frank wasn't the only iconic artist the photography community lost recently. Peter Lindbergh, Charlie Cole and Fred Herzog have also passed away.
Back in the film days Canon had 'eye-controlled' focus that let you set an AF point just by looking at it, and a recent patent suggests Canon is still interested in this technology. Chris and Jordan consider what a modern eye-controlled AF system might mean to photographers.
CyberLink has revealed the latest updates to its suite of creative production apps, including PhotoDirector 11, PowerDirector 18 and more.
Aputure's impending LED light has 600W raw output in a size not much larger than your standard cinema light.
Apple's iPhone 11 camera updates will inevitably be seen as attempts to catch up to Android. But, taken together, we think they stack up to meaningful upgrades that might make an already very capable camera one of the most compelling options on the market.
Monogram, a company formerly known as Palette Gear, has a new crowdfunded campaign up for its next-generation modular control panel, the Creative Console.
Rumors have been heating up regarding Canon's potential IBIS system and this new patent application gives us the best look yet at what Canon is up to.
The new filters use artificial intelligence to automatize and simplify a range of portrait retouching tasks.
The Laowa 100mm F2.8 2X Ultra Macro APO is unusual among macro optics for offering a maximum reproduction ratio of 2:1. Check out our gallery to see how it performs.
A group of friends traversed around California in an attempt to recreate the stock wallpapers Apple has included with macOS.
With iOS 13 the iPhones XS and XR as well as the latest iPad Pro models will be capable of simultaneously recording video streams from multiple cameras.
The paid firmware update doubles the range for remote cameras/flash units and brings a number of additional features.
The two ‘MicroPrime’ lenses add additional options to SLR Magic's current MFT cine lens lineup, which includes the 12mm T2.8 and 18mm T2.8.
It's not every day that we get to shoot with a system like the medium-format IQ4. We took it into the studio for some portraiture as well as a more casual spin around the block because, well, why not?