NVIDIA researchers can now turn 30fps video into 240fps slo-mo footage using AI
NVIDIA researchers have developed a new method to create 240fps slow-motion video from 30fps content using artificial intelligence.
Detailed in a paper submitted to the Cornell University Library, NVIDIA researchers trained the system by processing more than 11,000 videos through NVIDIA Tesla V100 GPUs and a cuDNN-accelerated PyTorch deep learning framework. This archive of videos, shot at 240fps, taught the system how to better predict the positioning differences in videos shot at only 30fps.
This isn't the first time something like this has been done. A post-production plug-in called Twixtor has been doing this for almost a decade now. But it doesn't come anywhere close to NVIDIA's results in terms of quality and accuracy. Even in scenes where there is a great amount of detail, there appears to be minimal artifacts in the interpolated frames.
The researchers also note that while there are smartphones that can shoot 240fps video, it's not necessarily worth it to use all of that processing power and storage when something that will get you 99% of the way there is possible using a system such as theirs. 'While it is possible to take 240-frame-per-second videos with a cell phone, recording everything at high frame rates is impractical, as it requires large memories and is power-intensive for mobile devices,' the researchers wrote in the paper.
The research and findings detailed in the paper will be presented at the annual Computer Vision and Pattern Recognition (CVPR) conference in Salt Lake City, Utah this week.
This week Chris and Jordan are joined by renowned macro photographer Don Komarechka, who demonstrates a few simple techniques that can improve your macro photos in a big way.
The group that provides Canon users with programs to expand the feature set of their cameras has begun cracking the new EOS R mirrorless firmware.
The Pixel 3 represents another step forward in computational photography for Google's smartphone. We're just getting started with our testing – for now take a look at some sample images, including 'computational Raw' files available for download.
Lens Rentals Founder, Roger Cicala, has given the Canon EOS R one of his signature camera teardowns.
Nikon says firmware version 1.03 "Fixes an issue that in rare circumstances would delay the shutter release or the start of the autofocus operation."
The Kickstarter campaign for Yashica’s digiFilm Y35 camera has produced a wave of complaints about delays in shipping product as well as cameras that don’t work.
Pixelmator today released Pixelmator Pro 1.2 Quicksilver, a major update to its image editing app for Mac.
Although Raw performance of the EOS R is very similar to the 5D Mark IV, Canon's done some tweaking on the JPEGs - take a look at our studio scene to see for yourself.
If you've backed one of the company's crowdfunding projects, the reward will not arrive and you won't get your money back either as Meyer Optik Görlitz's parent company, Net SE, is completely dead.
The importance of APS-C, a future a7S model in development and why customers want two card slots – read our full interview with Sony's Kenji Tanaka.
Google's Super Res Zoom technology uses pixel-shifting methods to achieve zoom results comparable to some optical solutions. Google has published an in-depth explanation on its AI blog.
CyberLink has release the latest version of its photo editing and design program PhotoDirector.
Toy manufacturer Tomy has launched a no-battery-required smartphone printer that is remarkably like the one Holga has been promoting via a Kickstarter campaign but which is already available for $40/£39.
A handful of Sony users have noticed a particular model of SanDisk SD cards is showing errors when used with Sony a7 III camera.
The Fujifilm X-T3's 4K video more than lives up to its impressive specification, making it one of the most capable video cameras we've ever tested.
VSCO has made it easier to find the right presets for your photos with a few interface changes to its smartphone app.
TinyMOS is back with NANO1, an all-new astrophotography camera that's one-third the size of the TINY1 it announced three years ago.
Huawei's latest flagship device comes with the widest range of focal lengths of all current smartphones.
After shaking up the Lightroom ecosystem with Lightroom CC last year, Adobe has released version 2.0 of the cloud-centric photo organizer and editor. We look at new features like People View, how far Lightroom CC has come in its first year, and where Lightroom is headed.
Today, at Adobe MAX 2018, Adobe previewed Photoshop CC on iPad, a full-featured, desktop-class version of Photoshop for iOS.
The weather and has most definitely taken a turn toward fall here, and our shooting opportunities have followed suit. We brought the Canon RF 35mm F1.8 along to a harvest festival of sorts and a few of our usual haunts.
Pennsylvania Governor Tom Wolf has signed House Bill 1346 into effect, which imposes a fine upwards of $300 to drone operators who invade the privacy or harm the physical wellbeing of citizens.
Sigma is a company in flux, but CEO Kazuto Yamaki is undaunted by the upcoming prospect of developing lenses for eight lens mounts. The challenge will be keeping the company's identity along the way.
If you've been meaning to convert all of your old photos, video, and audio to digital formats, but simply lack the time or willpower to get through it all, a new service from Kodak will help you get the job done.
Almost all new cameras include impressive video features, but for the best results you'll often need an off-camera recorder. Chris and Jordan take a look at the brand new Ninja V from Atomos, and explain why it might just be one of the most useful tools you can add to your camera.
Collect allows you to transform 360-degree into a more easily digestible format by transforming it into directed traditional videos.
Sick of using your plain ol' keyboard to edit your photos in Lightroom and Photoshop? TourBox is hoping to expedite your post-production workflow using a clever combination of dials, buttons, and knobs.
Bag and accessory manufacturer Hex has launched two bags as part of its latest collection: the Clamshell Backpack and DSLR Sling.
Crank out instant photos with Holga Digital's new analog printer, currently being funded on Kickstarter.