Microsoft introduces hyperlapse algorithm to fix shaky first-person videos
Microsoft's Research division in Redmond, Washington has published material detailing a method for turning shaky first-person camera footage into a stabilized hyperlapse video. Hyperlapsing is a technique used in multimedia to string together a collection of photographs or video frames in order to produce a cinematic experience; the methodology is also more commonly known as a stop-motion time-lapse.
Microsoft researchers, Johannes Kopf, Michael Cohen, and Richard Szeliski, all noted that first-person video cameras could capture interesting footage during activities such as 'rock climbing or bicycling', but can be 'dead boring' to watch at normal speeds.
The three researchers found that simply speeding up the video by a factor of 10 (also known as subsampling), did not produce the smooth result they wanted, but instead an extremely shaky video where every movement was amplified. When the researchers attempted to, instead, stabilize the video, they found that they simply didn't have enough information to do so.
The algorithm they've developed uses a 3-step process to produce exceptionally stable videos that play back in a single fluid camera sweep. First researchers reconstruct the scene by creating a 3D model of the world based on similar structures detected within each frame. Next, they proceed to plan a camera path through the world and create 3D point-clouds from overlapping frames. Lastly, the dense depth maps are stitched together, color changes are made, and the video is rendered for viewing.
The resulting video, seen in the demo below, is quite impressive. As of now, the team does not have a release date, but mentions that those who are interested should stay tuned as they 'are working hard on making [their] hyperlapse algorithm available as a Windows app' - Note that the word app most likely hints at a Windows 8 application and not legacy desktop software (sorry Windows 7 users).
For more information, you can visit the official research page for technical papers and supplemental material.
Michael Archambault is a contributing writer for DPReview.
Aug 26, 2016
Aug 2, 2016
Sep 19, 2016
Sep 19, 2016
- Canon EOS M58.8%
- Panasonic G85/G803.3%
- Panasonic FZ2500/FZ20001.9%
- Panasonic LX10/LX151.2%
- Panasonic GH5 development3.6%
- Sony a99 II15.9%
- Nikon KeyMission 170 and 801.0%
- Fujifilm GFX 50S development28.3%
- Olympus E-M1 II development18.7%
- Olympus E-PL80.1%
- Olympus 25mm F1.2 Pro1.5%
- Olympus 12-100mm F4 IS Pro1.9%
- Olympus 30mm F3.5 Macro0.1%
- Sigma 85mm F1.4 Art3.6%
- Sigma 12-24mm F4 Art2.6%
- Sigma 500mm F4 DG OS HSM Sport2.4%
- YI M12.2%
- GoPro Hero50.8%
- GoPro Karma drone2.2%
|Sunflower Field by GrannyMeg|
from An impressionist piece
|Flag from Staten Island Ferry by wam7|
|Windswept juniper by Kreber|
from Wind power
|SAND SCULPTURE by duskman|
from Landscape - Black and White #4