iPhone video enhanced by rolling shutter effect

http://www.engadget.com/2011/07/18/want-to-write-for-engadget-were-hiring-in-tokyo-japan/

Btw -- I found this interesting article for the author of this piece of news.

Want to write for Engadget? We're hiring in Tokyo, Japan!

Jul 19, 2011permalink

mr_ewok

dpreview really gets boring. that´s it.

don´t know what those "news" shall bring to photographers.

Jul 19, 2011permalink

Leafvein

Rock on DPReview. Its a camera, its artistic, it belongs here. How is this not inspiring?

Jul 19, 2011permalink

AshMills

Not hugely relevant to news of photography. Interesting however.

www.AshMills.com

Jul 18, 2011permalink

jmmgarza

Enjoyed the "rolling effect" youtube videos. Ninety nine percent of the DSLR videos that I produce won't be subject to "obvious" rolling shutter effect.

On the subject of photography news... I understand that your site is devoted to consumer photography. You print the usual (suspect) press releases, offer excellent analysis of products and tag them with links (make money) to vendors.

This is your niche. Yes, I would love to see diverse articles relevant to photographers (high-end printers, studio lighting, and such), but that would require a larger staff to write, edit and manage this enterprise. As a writer and photographer with a journalism degree and practical experience I know this costs a lot of money. Yes, you can do this on the cheap with interns and self-promoters, but again, that isn't quality journalism. Yes, I understand why DPReview does (only) what they do.

Jul 18, 2011permalink

AbrasiveReducer

I guess this is interesting in an "RIT" kind of way (meaning a science experiment that results in images.) As for photo news, buried in this month's Pop Photo is a paragraph saying that PMA is dead for good--not rescheduled; not renamed; not folded into CES--just gone. This might seem insignificant to the general public but it pretty much spells out the state of the photo industry; digital cameras are just electronic gizmos and therefore should be sold like laptops or iPhones.

Jul 18, 2011permalink

wavrydr

I think this site needs to find a new editor if they plan to be a news outlet for camera tech. Dpreview has an unmatched database and comparison shopping guide, but their news reporting is lackluster at best. They consistently miss or simply do not report on significant news in the world cameras and camera technology. Instead of wasting time on fluff pieces like this they should actually do some research and write about news worthy articles. For example, the camera industry is moving towards mirror-less SLR cameras. Why not use all the camera brain power they can conjure up and write a unique piece on that idea. I recently read an article about a company making a camera that will allow you choose the focus point in the photo after the photo is taken.

Bottom line, this is great site, but the news here is a waste of time really. They rarely update it and when they do it's nothing special that you couldn't find by reading gizmodo or any of the other tech blogs.

Jul 18, 2011permalink

ClickBoom

I enjoyed this fluff

Jul 18, 2011permalink

Before the Amazon purchase, DPReview actually did camera reviews and did not post silly articles about phones with cameras (especially Apple products). However, it appears that it is now trying to compete directly with engadget, gizmodo, etc.

This article is not something I would have ever expected on a "pro" site like DPR. It's sad that my worst fears after the Amazon purchase are coming true. :(

It'd be nice if more REVIEWS of cameras and lenses were posted. Maybe a few less "previews", which seem to have taken over.

I find that I visit this site less and less (it used to be a permanent tab in my browser), due to the above.

Jul 19, 2011permalink

Pat Cullinan Jr

Dear DPReview,

I offer the following criticisms in a constructive sense. Please do not take them amiss.

First, this item doesn't belong on the home page with the camera news, but not for the reason you might imagine. The reason is that it lends a touch of unprofessionalism to the entire operation.

Secondly, the sample photos offered for this or that camera include pictures of young men in saloons. This also lends a touch of unprofessionalism, only a more serious one in this case. In any case, a blazer or a cardigan would do much to relieve the negative effect. It's all about image.

I reply on DPReview for the very best in review and news, and I sincerely thank you for all your efforts. You have been a major help to me in my photographic life.

Kindest regards,

Patrick Cullinan, Jr.

Jul 18, 2011permalink

willbfree

Is there a Poll function to survey the question of whether the above is, or is not, tongue-in-cheek?

Jul 19, 2011permalink

shnsea

Color blotch is correct. See this detailed explanation:
http://blog.alexbeutel.com/135/image-aliasing-of-plane-propellers-in-photos-and-video/
and for a better example:
http://www.youtube.com/watch?v=LVwmtwZLG88&feature=related

Jul 18, 2011permalink

Trevor G

Sorry guys, but this looks like a massive con job.

1) IF the electronic shutter in an iPhone functioned in such a way that it would resolve the vibrations of a guitar string, it could only resolve one such string, because each string has a different frequency.

It might be able to resolve a particular harmonic frequency common to all strings, but I have serious doubts that that would be possible, too.

2) When the phone is placed inside the guitar the fingers, strings the bearded guy and the background are all out of focus - when the music starts the strings, the fingers and the background are all amazingly sharp. That's amazing DOF, if nothing else!

3) Check the light along the edges of the strings pre-music, with the way the light no longer "surrounds" the strings with-music.

4) The skin colour of the fingers is clearly visible when inserting the phone and switching it on, but they suddenly become stylised, sharp, black and colourless once the music is played.

Jul 18, 2011permalink

Trevor G

5) The light across the edge of the sound hole remarkably stays the same in both instances, even though the light elsewhere changes dramatically.

Jul 18, 2011permalink

Ansel Spear

The reason the skin colour is visible at the outset is because light is falling on the hand. When playing, they're in the shadow.

The rolling shutter is not resolving harmonic frequency, it's simply doing its job - and filming. It would be quite odd if a camera couldn't film a 100 meter sprint because all runners were moving at a different speed.

Jul 18, 2011permalink

astromac

Trevor G seems to belong to the same category of "skeptics" as those who don't believe NASA actually went to the moon.
Another example of disbelief based on lack of knowledge and/or understanding would be if you thought that photo-finish photographs must be fakes, because the runners cannot have such weird arms or legs.

Jul 18, 2011permalink

inevitable crafts studio

nasa DID went to the moon but not ON the moon, that was filmed by stanley kubrick as we all know :)

Jul 20, 2011permalink

inevitable crafts studio

boring times for photographic news i guess hehe

Jul 17, 2011permalink

Russell Dawkins

This begs the question - what do you and others easily bored, like patcam7122 below, *not* find boring? Why do you bother commenting - to prove your lofty standards?

Jul 17, 2011permalink

nosnoop

Russell: Maybe you should re-read that two postings again. Neither of the posters claimed that *this* particular new item is boring. They merely speculate that it must have been a slow news day with nothing much to report; and that the dpreview editors need to include this marginally related item as "news".

IMHO, I also find this "news" item out of place in dpreview's "News Update". Just click through news, and glance through the last 100 or so news headlines, and you would know what I mean.

Jul 17, 2011permalink

Fredella

iPhone that elegantly demonstrates the 'rolling shutter' effect. It occurs because its CMOS sensor captures video one line at a time, so there's an increasing lag as it scans down the frame.

Jul 18, 2011permalink

mjkerpan

The Iphone may have a better-than-average camera, but it's clearly still not very good for fast-motion video. Still, it's always nice to see somebody taking a technical flaw and using it to create interesting art. I love the "waveform" guitar strings!

Jul 17, 2011permalink

Nemesis2001

It's a subsampling, so video aliasing effects occurs. It's clear from the guitar video, every string has a different vibration frequency. The real vibration frequency of the higher than the acquisition capability of the device, so the effect of aliasing is to show a perceived frequency that is 'scaled down' in respect of the original one, so scaled that is possible to see it clearly. Nice :)

Jul 17, 2011permalink

Lutz - Luigi Gallerani

All bad camera, like webcams, have this problem, nothing special in my opinion.

Another nice effect is to shoot a CRT screen with fast shutter speed (any camera can do this) and see only a small portion of the image in the screen, the rest is black.

It is the classical STROBOSCOPE problem....

Jul 16, 2011permalink

patcam7122

Must have been a really boring news day in the photo world to even consider posting this "information"; never mind all the people who found it necessary to argue about what it all meant. Just another example of the Facebook-Twitter syndrome, I guess.

Jul 16, 2011permalink

vedat aslan

on canon camera it occurs when shutter speed is faster than 1/4000 second. not because of frame rate. at high sutter speed camera can show you the string's vibration. but on iphone perhaps it is about a problem. because rotor blades change while rotating the iphone. i know that rolling shutter occurs while shifting the camera fastly. is there anyone that can explain the rolling shutter effect in detail?

Jul 16, 2011permalink

Lilianna

Cool effect, however ALL camera phones will do the same thing, this is not an Apple Innovation.

Jul 16, 2011permalink

CCDs with electronic shutter can't do it

Jul 16, 2011permalink

http://www.youtube.com/watch?v=YGcAGaOUs9w

Sorry about that. Getting obsessed with proving everyone wrong here. You're right, almost all camera phones have uses CMOS sensors

Jul 16, 2011permalink

Ansel Spear

It's a CMOS shutter phenomenon, nothing to do with Apple. per se.

Jul 18, 2011permalink

DigitalDon

Awesome camera position/capture. As a musician, I've often wished I could climb inside my instrument (generally, after making a mistake)! Great illustration.

Jul 16, 2011permalink

itsastickup

Not quite understanding why this is an 'enhancement' except perhaps using the most pure and virtuous marketing logic.

Jul 16, 2011permalink

liin

super cool

Jul 16, 2011permalink

Peter G

There are science demos of similar that don't even need cameras:

While this was shot on camera, the point of this one is you see it real time, in person without a camera frame rate interacting with the frequency of the sine waves on the strings, the strobe effect of the background does a similar thing.

While rolling shutter may have played a small part. The biggest part that lets you see the waves in the first place if frame rate interaction effect.

Jul 16, 2011permalink

Haha, what you showed is essentially a demonstration of a rolling shutter! If the string were instead illuminated by a stroboscope, you'd only see a slowly moving slightly bent string

Jul 16, 2011permalink

RichardBalonglong

This is interesting, and an artistic advantage on a disadvantage of a digital video. =)

Jul 16, 2011permalink

Kiril Karaatanasov

ok this is misleading the cool effect of having sine is not due to rolling shutter at all.

On may blame rolling shutter for the distorted sine in the lowest string, though I think the cause is again in how different frequencies combine to produce something not seen.

Jul 16, 2011permalink

Please see Color Blotch's comment below. the effect indeed appears due to the rolling shutter of the CMOS sensor (in combination with very short exposure time)

Jul 16, 2011permalink

Color Blotch's comment is wrong, see my reply to him

Jul 16, 2011permalink

Please see my reply to yours.

Jul 16, 2011permalink

Here's what the string looks like wo the rolling shutter effect. She shape is nowhere near what you see in the iphone movie.

Jul 16, 2011permalink

Sorry, heres the link: http://www.youtube.com/watch?v=wSQ9wr32v1k&feature=related

Jul 16, 2011permalink

Man, i should get back to work...
http://xkcd.com/386/

Jul 16, 2011permalink

Kiril Karaatanasov

You are showing high speed video of a string....there is no way to see frequency interference effects with high speed video.....this is becoming very unproductive discussion

Jul 17, 2011permalink

Kiril Karaatanasov

You are showing high speed video of a string....there is no way to see frequency interference effects with high speed video.....this is becoming very unproductive discussion

Jul 17, 2011permalink

Ok, I'll try to be clear. The wavy shapes of the strings are due to the rolling shutter and not their real shapes. The real shape of a vibrating guitar string can be seen in the vid I posted. I'm not sure what "cool effect" you're referring to in your original post but what I found striking in the vid was how the rolling shutter effect was elegantly used to show the time evolution of the strings. This can be seen in every separate frame and is not dependent on the framerate of the cam or the oscillating freq of the string.

Jul 17, 2011permalink

itsastickup

It's not news because it's been known for a long time and was visible when the very first 5DMKII vids came out.

Jul 16, 2011permalink

photohounds

Not exactly news all right, but fun, nonetheless. First noticed with the first focal plane shutter cameras of about 90 years ago.

That effect is probably WHY cartoonists drew the wheels of a racing car sloping forward.

Example here: http://en.wikipedia.org/wiki/Automobilwerk_Eisenach

Jul 16, 2011permalink

AbrasiveReducer

There's a famous photo by Lartigue of a bicycle that every photo student knows (or should) with the elongated wheels. To me, the real "news" is how many people find the quality of cell phone cameras more than adequate.

Jul 18, 2011permalink

role_of_72

This 'effect' is funny. :)

The other funny thing is if this was discovered in some other product it'd be a serious engineering mistake. But since it is in the iPhone this is fun and a killer feature.:D Apple has always been good in marketing.

Jul 16, 2011permalink

Enginel

Every focal-plane shutter camera has this 'mistake'. In first Leicas, it took about 1/25 sec for curtain to travel across frame

Jul 16, 2011permalink

role_of_72

Yes, I know about the effect in cameras but there are differences between the two cases we talked about:

- the article is about _video_ recording, you mentiones _still_images_

- the effect is caused by the reading of data out of the CMOS _sensor_, the leicas (and other cameras) has it because of the _shutter_.

These two things make them really different from each other.
And I said that it is _fun_ and would like to add that this is _nothing_serious_ since it is in a mobile phone not in a professional camera (I don't know much about them anyway..).

Jul 16, 2011permalink

kishork

this is news because for many like me this is news... and its nice to know..

Jul 16, 2011permalink

ponvenkat

Great idea of justkylevids using iphone and excellent imagination to use videography for teaching the frequency to students. Plane propeller shot by yanksoccer117 is also excellent

Jul 16, 2011permalink

keithwwalker

I have a similar effect with my GF1, complements of Taiwan's bullet train:
http://vimeo.com/7533628

Jul 16, 2011permalink

straylightrun

How is this news?

Jul 16, 2011permalink

pannumon

I find it (surprisingly) annoying that this is labeled as 'misc news'. I had no problems at all if it was labeled as 'misc' or 'on other sites'.

There could be a setting where users could define/priorize which kinds of stories are shown in the front page. Then nobody should complain.

Anyway, the effect is nice.

Jul 16, 2011permalink

D1N0

Because the rolling shutter bug turns out te be a feature ;). Typical for Apple ofcourse.

Jul 16, 2011permalink

Aleo Veuliah

Amazing the first one

Jul 16, 2011permalink

BPJosh

The top video is awesome!

Jul 16, 2011permalink

BPJosh

The top video is awesome!

Jul 16, 2011permalink

Patco

You can say that again!

Jul 16, 2011permalink

Thomtek5

<table style="width:auto;"><tr><td><a href="https://picasaweb.google.com/lh/photo/z_eB82xqDKgTeIzcD8KGXA?feat=embedwebsite"><img src="https://lh4.googleusercontent.com/-uulKClW0RQ8/TFuSr7oVOMI/AAAAAAAACd4/MH5Tdhq7X8Y/s144/IMG_0001.JPG" height="108" width="144" /></a></td></tr><tr><td style="font-family:arial,sans-serif; font-size:11px; text-align:right">From <a href="https://picasaweb.google.com/ThomTek5/20100803?authuser=0&feat=embedwebsite">2010-08-03</a></td></tr></table>
That explains the odd effect i got with this pic.

Jul 16, 2011permalink

Jogger

DPR is becoming a site for Apple fanboys. How come you dont cover Android or other platforms. Its all freaking apple all the time.

Jul 15, 2011permalink

Richard Butler

We'd have posted this if it'd been shot on an Android phone, too. It just so happens that it wasn't.

Jul 16, 2011permalink

IMHO "news" like this should not be posted on a site like DPR, regardless of the _phone_ it came from. I thought this was a reputable Photography Review site.

Come on guys, please do some real _reviews_!!! This is truly lame. :(

Jul 19, 2011permalink

bodziu

Thanks for this news, I can feel the new dp spirit;-) More like this please! Now when you are in the fancy part of the world Gizmodo guys could drop you an interesting story and I am sure that both sites could benefit;)
Probably a few years ago mobile cameras and apps were not 'serious enough' to be mentioned here and maybe it was the reason that the dp home page did not even need refreshing as day after day the same bloody articles appeared (though in most cases interesting).

dp forums are updated by an average user of main camera brands at least every 10 minutes and for the mainstream brands it's every minute I suppose. Therefore I personally concluded that you guys must be simply lazy... or due to the outdated site architecture, new content publishing process was such a pain in the neck that your admin needed a few days to recover from this experience.

Jul 15, 2011permalink

bodziu

In my opinion such 'light' news or interesting photography related (fair enough - in most cases useless) facts can co-exist with 'professional' camera news, reviews (which included priceless burst mode sounds in mp3) or guides like the HDR one.

I am sure that articles like this are a move in a good direction. At least in my case, waiting for a new review or more 'serious' article will no longer be like some painful experience of reading the same article about bloody FW update for camera I never hold in my hand, again and again...
Saying that, I'll contradict myself now admitting that I am quite disappointed with the number of news about movies in general. This is a bloody PHOTOGRAPHY site!
Yes, movie mode is in almost every camera (my has even bloody dedicated button which cant be disabled and I keep pressing it by accident) but you guys excel in *photography* and leave it like that... please!

Jul 15, 2011permalink

Richard Butler

In which case I suspect I will continue to delight and infuriate you in equal measure over the coming months.

Jul 15, 2011permalink

I imagine that as a result you'll gain some of the gizmodo crowd, lose the photography crowd. :(

Jul 19, 2011permalink

bodziu

I don't think it's something dp should worry about. Where would the crowd go instead?
But agree to some extent, some people like the things the way they are and have always been, any change will bring an element of 'panic' ;-)
I can see it from some 'pro' photographers reaction on the camera's design changes, mainly in mirror-less segment where lack of dedicated ISO button, not mentioning EVF is simply too much ;-)

Jul 20, 2011permalink

Color Blotch

No kind of " interaction between the vibration frequency of the strings and the frequency of the video capture" can produce such asymmetrical effects on strings. Regardless of capture frequency, any single stopped frame shot by a camera that captures the image as a whole represents the actual shape that string has at that particular moment. A camera without rolling shutter effect would have captured strings as slightly curved lines. No kind of complex "oscilloscope-like" shapes actually run through strings, those are capturing effects caused by the fact that upper lines of the image represent different moment of time than the lower ones.

Jul 15, 2011permalink

Michal59

Ditto.

Jul 15, 2011permalink

random78

Thats a good point. I think you are right.

Jul 16, 2011permalink

Jul 16, 2011permalink

The strings actually move in that "asymetrical" way. Strings and any other resonating object vibrate in many harmonic frequencies at the same time, and the actual shape of the string at any given time is the result of the addition of all those harmonics, resulting in the shapes you see. That's what's called timbre, and is what makes a guitar, a flute a trumpet and a violin sound different even if they are playing the same note, what is called the harmonic content.

The iphone video's effect has nothing to do with the rolling shutter, but on the actual capture of the string's shape at any given time, and the shape moving left or right is the effect of the phase difference between the string's vibration and the camera's frame rate, you would see the same effect if you lighted the strings with a stroboscopic light with the same frequency and burst duration of the camera.

Jul 16, 2011permalink

http://youtu.be/ahAMEnOC2KU
http://youtu.be/D3UG6lOaxnM
http://youtu.be/J6fBmO0MCaw
http://youtu.be/J6fBmO0MCaw

There are many videos on youtube where you can see the waveshape of guitar and other instruments:

Jul 16, 2011permalink

http://140.117.166.1/eehome/ISCOM2005/SubmitPaper/UploadPapers/ISCON05_00159.pdf

What you see on the oscilloscope screen is not the shape of the string at a time instant but rather the time evolution of the position of the string (which gives rise to teh sound wave). The effect of the rolling shutter is similar to the oscilloscope: what you see is the time evolution of the position of the string during the exposure of each frame.

There's also the stroboscopic effect: is causes the string to appear stationary if the oscillation frequency is a multiple of the framerate and slowly moving if its close to a multiple.

Jul 16, 2011permalink

Color Blotch

@luxvenator
I suggest you to make a simple experiment: stretch out your arm, keep it straight, then start waving it in the air, smoothly, 1 complete cycle a second. If you also take a piece of ferromagnetic material in your hand and put a coil under it you can actually pick the signal of that motion with an oscilloscope. This signal will obviously be a 1 Hz sine wave. Now a question: do you think your arm shapes as a sine wave when you do all the above? If no, why do you think a guitar string should do that. If yes, you better see a physician soon.

Jul 16, 2011permalink

jsandjs

Jul 17, 2011permalink