Is there any player stabilization in computers?

[Vesku]

Many new cameras has real time electronic video stabilization like Sony Active Steady Shot. If the tiny processor in camera can do it why there is no stab systems in ultra powerful video cards or computer players. Is it a computer power issue or is there no interest of real time stab for playing videos?

Current stabilization programs like Mercalli are very slow. How can any camera do it in real time?

 

[ourmanflint]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

 

[Vesku]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

Some cameras has indeed accelerometer for artificial horizon. My GH4 and GH has it too and even the video exif file tells what are the x, y and z coordinates during video startup.

If the cameras electronic stab uses that info I can understand it is possible to stabilize by moving the frame without analysing the video stream.

 

[coolowski]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

That's not needed for stabilisation. Maybe it could make digital stabilisation during recording better, but for stabilisation in post you will "just" have to look and compare the previous and upcoming frames of the video to stabilize it. Of course thats also complicated but as it can be done in video editing tools, there is no reason why a video player shouldn't be able to do it.

But I don't know any player that does.

 

[coolowski]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

Some cameras has indeed accelerometer for artificial horizon. My GH4 and GH has it too and even the video exif file tells what are the x, y and z coordinates during video startup.

If the cameras electronic stab uses that info I can understand it is possible to stabilize by moving the frame without analysing the video stream.

I'm not a video expert. But I would be surprised if accelerometer data is written to the video files during recording. Do you have more info on that topic ?

 

[Vesku]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

Some cameras has indeed accelerometer for artificial horizon. My GH4 and GH has it too and even the video exif file tells what are the x, y and z coordinates during video startup.

If the cameras electronic stab uses that info I can understand it is possible to stabilize by moving the frame without analysing the video stream.

I'm not a video expert. But I would be surprised if accelerometer data is written to the video files during recording. Do you have more info on that topic ?

Here is part of GH3 video exif file. Exiftool program can show very much information of GH3 or GH4 video. Accelerometer info is written when the video started but the camera knows the values all the time and could stabilize the video with that information. I think that Sony and G7 and GX8 are doing that but only for fullhd. Moving 4k frame is probably too hard job for camera processor.

If the camera could write all that info to video file (like timecode) it would be easy to make real time player post stabilization (with cropping).

 

[ourmanflint]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

Some cameras has indeed accelerometer for artificial horizon. My GH4 and GH has it too and even the video exif file tells what are the x, y and z coordinates during video startup.

If the cameras electronic stab uses that info I can understand it is possible to stabilize by moving the frame without analysing the video stream.

I'm not a video expert. But I would be surprised if accelerometer data is written to the video files during recording. Do you have more info on that topic ?

Here is part of GH3 video exif file. Exiftool program can show very much information of GH3 or GH4 video. Accelerometer info is written when the video started but the camera knows the values all the time and could stabilize the video with that information. I think that Sony and G7 and GX8 are doing that but only for fullhd. Moving 4k frame is probably too hard job for camera processor.

If the camera could write all that info to video file (like timecode) it would be easy to make real time player post stabilization (with cropping).

If this data is written on a per frame basis, then yes I'm sure it could be possible to read it and adjust video based on those readings.

 

[ourmanflint]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

That's not needed for stabilisation. Maybe it could make digital stabilisation during recording better, but for stabilisation in post you will "just" have to look and compare the previous and upcoming frames of the video to stabilize it. Of course thats also complicated but as it can be done in video editing tools, there is no reason why a video player shouldn't be able to do it.

But I don't know any player that does.

That's what Mercalli and others try to do, but it just doesn't work very well

 

[coolowski]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

Some cameras has indeed accelerometer for artificial horizon. My GH4 and GH has it too and even the video exif file tells what are the x, y and z coordinates during video startup.

If the cameras electronic stab uses that info I can understand it is possible to stabilize by moving the frame without analysing the video stream.

I'm not a video expert. But I would be surprised if accelerometer data is written to the video files during recording. Do you have more info on that topic ?

Here is part of GH3 video exif file. Exiftool program can show very much information of GH3 or GH4 video. Accelerometer info is written when the video started but the camera knows the values all the time and could stabilize the video with that information. I think that Sony and G7 and GX8 are doing that but only for fullhd. Moving 4k frame is probably too hard job for camera processor.

If the camera could write all that info to video file (like timecode) it would be easy to make real time player post stabilization (with cropping).

If this data is written on a per frame basis, then yes I'm sure it could be possible to read it and adjust video based on those readings.

Is it recorded for every frame ? Is that part of some standard ?

 

[Vesku]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

Some cameras has indeed accelerometer for artificial horizon. My GH4 and GH has it too and even the video exif file tells what are the x, y and z coordinates during video startup.

If the cameras electronic stab uses that info I can understand it is possible to stabilize by moving the frame without analysing the video stream.

I'm not a video expert. But I would be surprised if accelerometer data is written to the video files during recording. Do you have more info on that topic ?

Here is part of GH3 video exif file. Exiftool program can show very much information of GH3 or GH4 video. Accelerometer info is written when the video started but the camera knows the values all the time and could stabilize the video with that information. I think that Sony and G7 and GX8 are doing that but only for fullhd. Moving 4k frame is probably too hard job for camera processor.

If the camera could write all that info to video file (like timecode) it would be easy to make real time player post stabilization (with cropping).

If this data is written on a per frame basis, then yes I'm sure it could be possible to read it and adjust video based on those readings.

Is it recorded for every frame ?

No.

Is that part of some standard ?

This is just the exif info inside the video file and the values are saved when the video starts.

 

[coolowski]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

That's not needed for stabilisation. Maybe it could make digital stabilisation during recording better, but for stabilisation in post you will "just" have to look and compare the previous and upcoming frames of the video to stabilize it. Of course thats also complicated but as it can be done in video editing tools, there is no reason why a video player shouldn't be able to do it.

But I don't know any player that does.

That's what Mercalli and others try to do, but it just doesn't work very well

It depends how much you use it in my opinion. If you overdo it then yes, you can spot it on the edges of the frame, or you will have to crop a lot from the video.

If you have gyro data you will still have to crop and move the video frame and/or "guess" how the image area outside the frame looked. Maybe you will need less processing power if you have gyro data, and you stabilsation will work more consistently in scenes with lot's of movements on the frame - besides the camera movement itself.

 

[Vesku]

Unless a camera records gravimetric or gyroscopic data to the file, this would be impossible, so no doubt why it has never been done.

That's not needed for stabilisation. Maybe it could make digital stabilisation during recording better, but for stabilisation in post you will "just" have to look and compare the previous and upcoming frames of the video to stabilize it. Of course thats also complicated but as it can be done in video editing tools, there is no reason why a video player shouldn't be able to do it.

But I don't know any player that does.

That's what Mercalli and others try to do, but it just doesn't work very well

It depends how much you use it in my opinion. If you overdo it then yes, you can spot it on the edges of the frame, or you will have to crop a lot from the video.

If you have gyro data you will still have to crop and move the video frame and/or "guess" how the image area outside the frame looked. Maybe you will need less processing power if you have gyro data, and you stabilsation will work more consistently in scenes with lot's of movements on the frame - besides the camera movement itself.

The camera gyro data and the final image shake are hard to combine because normally there is also objective OIS in image. That is the reason why Panasonic must make FW updates for their lenses for Dual stabilization (OIS+IBIS).

 

[nikanth]

Video editors do a good job. Even youtube does a good job.

But with 1 caveat: When we stabilize in post(or during play back), the video will be stabilized, but if there was motion blur, due to camera movement, the frames won't be as sharp as, if we had stabilization during recording.