Microsoft introduces hyperlapse algorithm to fix shaky first-person videos
Microsoft's Research division in Redmond, Washington has published material detailing a method for turning shaky first-person camera footage into a stabilized hyperlapse video. Hyperlapsing is a technique used in multimedia to string together a collection of photographs or video frames in order to produce a cinematic experience; the methodology is also more commonly known as a stop-motion time-lapse.
Microsoft researchers, Johannes Kopf, Michael Cohen, and Richard Szeliski, all noted that first-person video cameras could capture interesting footage during activities such as 'rock climbing or bicycling', but can be 'dead boring' to watch at normal speeds.
The three researchers found that simply speeding up the video by a factor of 10 (also known as subsampling), did not produce the smooth result they wanted, but instead an extremely shaky video where every movement was amplified. When the researchers attempted to, instead, stabilize the video, they found that they simply didn't have enough information to do so.
The algorithm they've developed uses a 3-step process to produce exceptionally stable videos that play back in a single fluid camera sweep. First researchers reconstruct the scene by creating a 3D model of the world based on similar structures detected within each frame. Next, they proceed to plan a camera path through the world and create 3D point-clouds from overlapping frames. Lastly, the dense depth maps are stitched together, color changes are made, and the video is rendered for viewing.
The resulting video, seen in the demo below, is quite impressive. As of now, the team does not have a release date, but mentions that those who are interested should stay tuned as they 'are working hard on making [their] hyperlapse algorithm available as a Windows app' - Note that the word app most likely hints at a Windows 8 application and not legacy desktop software (sorry Windows 7 users).
For more information, you can visit the official research page for technical papers and supplemental material.
Michael Archambault is a contributing writer for DPReview.
Aug 10, 2017
Aug 7, 2017
Jul 27, 2017
Jul 11, 2017
Read the story behind this gorgeous wedding photo captured at Trolltunga in Norway by husband and wife duo Priscila Valentina Photography. The 14 hour hike in the rain that preceded this shot was TOTALLY worth it.
Go behind the scenes with filmmaker Nick Arcivos, who recently created a beautiful cinematic short film in Paris using only the iPhone X, a couple of gimbals, and a few lights. The results are very impressive.
A Bay Area startup offering a pay-by-the-photo camera service cleverly addresses the pain points photographers experience when they pick up their first DSLR. But can it survive the smartphone?
It's been a big year for software innovations, dual cameras and huge displays. Take a look at our picks for the top smartphone cameras and why we think they stand out.
We're counting down our top 10 most popular sample galleries of 2017. At the #7 spot is the ready-for-any-weather Olympus Tough TG-5.
By combining his skills as a time-lapse filmmaker and an engineer, Julian Tryba created this out-of-this-world creative 'layer-lapse' of New York City that alternates between night and day in time with the music.
Canon Japan's new lineup of novelty camera-themed gifts was just revealed online, including a lens mug and lens thermos, two retro camera-themed USB drives, and a picnic mat.
The Profoto A1 most certainly isn’t for everyone [...] But for those who are used to using the Profoto systems, and want something that pairs seamlessly with the strobes you already have, there is no better companion.
Fujifilm has asked a US district court to clear it of any wrongdoing, after allegedly being threatened with trademark litigation by Polaroid.
While a couple of our reviewers are out testing the Sony a7R III in Arizona, back in Seattle we slapped the camera in front of our studio scene to get a close look at its image quality. See how it stacks up against the competition.
We're counting down our top 10 most popular sample galleries of 2017, and the #8 ranking belongs to the Nikon D7500.
B+W has announced a new aluminum filter holder that offers three slots so users can use multiple filters at the same time. The holder goes with the 2mm thick 100mm square filters it launched earlier this year.
8K video is coming a lot faster than you think, and Blackmagic is ready for it. Meet the DeckLink 8K Pro, a new high performance PCI-E capture and playback card built to handle 'real time high resolution 8K workflows.'
"Glass is everywhere in photography. From Eugène Atget’s reflective vitrines to Lee Friedlander’s sly self-portraiture, photographers have long been in thrall to the visual complications glass can inject into a composition."
Former Apple Aperture lead developer Nik Bhatt has designed an iOS app called RAW Power that lets you edit raw photos from your professional camera using your phone and tablet.... color us intrigued.
Advertising photographer Blair Bunting got his hands on the new Microsoft Surface Book 2, and it blew him away. Bye bye MacBook Pro...
The OnePlus 5T retains many of the 5's features and specs, but comes with an edge-to-edge display and a dual-camera that is optimized for low light.
Sony's recently announced IMX461 backside illuminated medium format sensor will bring 100MP resolution and almost 2x the speed to the next-gen Fuji GFX and Hasselblad X1D.
With the ‘Rent a Hasselblad’ camera equipment renting program, the camera makers is aiming to give enthusiast and professional photographers easier access to its medium-format photography products.
They say seeing is believing, and that's exactly what happened when one DPR staffer took the Google Pixel 2 out for an afternoon shooting under challenging conditions.
We're counting down our top 10 most popular sample galleries of 2017. At the #9 spot we have the Fujifilm GFX 50S, a medium-format camera that took CP+ 2017 by storm.
Instagram is testing a new feature that lets you follow hashtags in addition to people, making it possible to keep track of your favorite #landscapes or #portraits without leaving your home feed.
Despite the gigantic volume of second hand film bodies in existence, it seems there is still a demand for new 35mm SLRs with a retro feel. The latest is a remake of the Ihagee Elbaflex from the 1960s, but with a Nikon F mount.
The Polaroid Insta-Share Moto Mod straps an instant printer directly to your Moto Z smartphone, so you can print your photos as soon as you've captured them.
The Mitakon Speedmaster 135mm F1.4 lens is being relaunched in 7 different mounts, including: Sony A, Sony E, Canon EF, Nikon F, Fujifilm G, Pentax K, and Leica L. Got an extra three grand lying around?
In January, Kodak announced it would bring back the beloved slide film Ektachrome. The timeline has been pushed back a bit, but Kodak says you can expect to purchase Ektachrome again in 2018.
Instagram popularity is threatening some of the most beautiful landscapes in the US, as hordes of 'nature lovers' trample over the same spots over and over again in search of the same exact shot.
You’d have to be pretty brave to immerse your $50K RED cinema camera underwater. But if you've got the guts, Gates just released a new housing you can be pretty sure won't wreck your unbelievably expensive toy.
Adobe has released a 'Lightroom Downloader' app for Windows 10 and macOS High Sierra that allows you to download all of your images from the Adobe Cloud, all at once.
After releasing a popular 4K action cam and an affordable mirrorless M43 camera, Chinese camera maker YI is diving into yet another market: 360° VR. Meet the YI 360 VR: a powerful little two-lens camera that can shoot and stream in 4K.