NVIDIA Research creates AI tool to convert series of 2D images into impressive 3D models
NVIDIA researchers have developed a new inverse rendering pipeline, NVIDIA 3D MoMa, that allows users to reconstruct a series of still photos into a 3D computer model of an object, or even a scene. The key benefit of this workflow, compared to more traditional photogrammetry methods, is its ability to output clean 3D models capable of being imported and edited out-of-the-box by 3D gaming and visual engines.
While there are other photogrammetry programs that will turn 2D images into 3D models, NVIDIA's 3D MoMa technology takes it a step further by producing mesh, material and lighting information of the subjects and outputting it in a format that's compatible with existing 3D graphics engines and modeling tools. And it's all done in a relatively short timeframe, with NVIDIA saying 3D MoMa can generate triangle mesh models within an hour using a single NVIDIA Tensor Core GPU.
|These five models were created using NVIDIA 3D MoMa. Credit: NVIDIA|
The model that's output has three primary components: the 3D mesh model, the parameters for material(s) the object is made from and parameters about the lighting in the scene. This all-in-one output makes it easier to go from capture to implementation into the final product, be it for a video game or visual effects.
To showcase 3D MoMa and celebrate the rich jazz history in New Orleans, where the paper behind 3D MoMa will be presented at the Conference on Computer Vision and Pattern Recognition, NVIDIA captured around 100 images each of five jazz band instruments from different angles. The trumpet, trombone, saxophone, drum set and clarinet were then modeled using MoMa. You can see the results above.
Earlier this year, NVIDIA Research showed off Instant NeRF, which can turn 2D images into a 3D scene 'in seconds.' That's not all, so far in 2022, we've also seen NVIDIA's landmark achievement in neural graphics training and an impressive new NVIDIA Canvas update. There's no doubt that AI offers some major benefits to creators, especially when it comes to saving time with creating artwork and models.
Take a trip inside the mind (and mouth) of a creative, quirky pinhole photographer.
While peak Milky Way season is on hiatus, there are other night sky wonders to focus on. We look at the Orion constellation and Northern Lights, which are prevalent during the winter months.
We've gone hands-on with Nikon's new 17-28mm F2.8 lens for its line of Z-mount cameras. Check out the sample gallery to see what kind of image quality it has to offer on a Nikon Z7 II.
The winning and finalist images from the annual Travel Photographer of the Year awards have been announced, showcasing incredible scenes from around the world. Check out the gallery to see which photographs took the top spots.
The rumor mill suggests the announcement will be a 50mm F1.4 DG DN lens for full-frame mirrorless camera systems.
The a7R V is the fifth iteration of Sony's high-end, high-res full-frame mirrorless camera. The new 60MP Mark IV, gains advanced AF, focus stacking and a new rear screen arrangement. We think it excels at stills.
Using affordable Sony NP-F batteries and the Power Junkie V2 accessory, you can conveniently power your camera and accessories, whether they're made by Sony or not.
According to Japanese financial publication Nikkei, Sony has moved nearly all of its camera production out of China and into Thailand, citing geopolitical tensions and supply chain diversification.
Got a new camera? Get started with your Canon EOS R7 by changing these critical settings.
A pro chimes in with his long-term impressions of DJI's Mavic 3. While there were ups and downs, filmmaker José Fransisco Salgado found that in his use of the drone, firmware updates have made it better with every passing month.
Landscape photography has a very different set of requirements from other types of photography. We pick the best options at three different price ranges.
AI is here to stay, so we must prepare ourselves for its many consequences. We can use AI to make our lives easier, but it's also possible to use AI technology for more nefarious purposes, such as making stealing photos a simple one-click endeavor.
This DIY project uses an Adafruit board and $40 worth of other components to create a light meter and metadata capture device for any film photography camera.
Scientists at the Green Bank Observatory in West Virginia have used a transmitter with 'less power than a microwave' to produce the highest resolution images of the moon ever captured from Earth.
The tiny cameras, which weigh just 1.4g, fit inside the padding of a driver's helmet, offering viewers at home an eye-level perspective as F1 cars race through the corners of the world's most exciting race tracks. In 2023, all drivers will be required to wear the cameras.
The announcement is believed to be the M.Zuiko Digital ED 90mm F3.5 Macro IS Pro lens, which was confirmed on the OM System roadmap last year.
The new ultrafast prime for Nikon Z-mount cameras is a re-worked version of Cosina's existing Voigtländer 50mm F1 Aspherical lens for Leica M-mount cameras.
There are plenty of hybrid cameras on the market, but often a user needs to choose between photo- or video-centric models in terms of features. Jason Hendardy explains why he would want to see shutter angle and 32-bit float audio as added features in cameras that highlight both photo and video functionalities.
SkyFi's new Earth Observation service is now fully operational, allowing users to order custom high-resolution satellite imagery of any location on Earth using a network of more than 80 satellites.
The firmware update adds eye-detection AF to video capture and improves autofocus performance in other modes.
In some parts of the world, winter brings picturesque icy and snowy scenes. However, your drone's performance will be compromised in cold weather. Here are some tips for performing safe flights during the chilliest time of the year.
The winners of the Ocean Art Photo Competition 2022 have been announced, showcasing incredible sea-neries (see what we did there?) from around the globe.
Venus Optics has announced a quartet of new anamorphic cine lenses for Super35 cameras, the Proteus 2x series. The 2x anamorphic lenses promise ease of use, accessibility and high-end performance for enthusiast and professional video applications.
We've shot the new Fujinon XF 56mm F1.2R WR lens against the original 56mm F1.2R, to check whether we should switch the lens we use for our studio test scene or maintain consistency.
Nature photographer Erez Marom continues his series about landscape composition by discussing the multifaceted role played by the sky in a landscape image.
Check out some of our full resolution Canon EOS R6 Mark II photos, captured over the holidays and in the mountains.
After weeks with a production Canon EOS R6 Mark II, Chris and Jordan get into more detail than they could in their initial review.
The NONS SL660 is an Instax Square instant camera with an interchangeable lens design. It's made of CNC-milled aluminum alloy, has an SLR-style viewfinder, and retails for a $600. We've gone hands-on to see what it's like to shoot with.
Recently, DJI made Waypoints available for their Mavic 3 series of drones, bringing a formerly high-end feature to the masses. We'll look at what this flight mode is and why you should use it.
Astrophotographer Bray Falls was asked to help verify the discovery of the Andromeda Oxygen arc. He describes his process for verification, the equipment he used and where astronomers should point their telescopes next.