The Nokia OZO is a state of the art VR camera.

Virtual reality, or VR, has the potential to redefine the way we interact with images, including still images, movies, and other forms of visual storytelling. It’s already being adopted by major news organizations to take you deeper into stories, Hollywood studios that want to generate more immersive entertainment, and content creators who want to share experiences that don’t work as effectively on a flat screen.

VR is still at a stage where it’s mostly of interest to early adopters, but it’s an exciting time to get involved with this new medium. In particular, it's great time for photographers and filmmakers to start thinking about VR as this technology will likely impact the way we share our work, tell stories, and even remain competitive in business over the next several years.

Timing is everything

My first VR experience came many years ago when a technology incubator next to the molecular biology lab where I worked asked for volunteers to test a new 'human interface technology.' I found myself standing in a room full of computers, wearing a large headset with wires hanging out, and with something that looked like a hockey glove on my hand. A nerdy grad student was on hand to guide me through a virtual world.

The graphics in this world consisted of nothing more than rooms full of poorly shaded spheres, cubes, and cylinders. There was no illusion of reality, but I could navigate through doors and wander around. I later discovered that the grad student was actually from the psychology department and that I was, for all intents and purposes, a lab rat trying to find my cheese in a virtual maze. The grad student never revealed whether I did a better job of navigating the maze than the real rat, but the VR experience stuck in my mind. My gut told me it had potential.

"I was, for all intents and purposes, a lab rat trying to find my cheese in a virtual maze..."

As Mark Banas’ recent article discusses, and as my own ersatz rat experience confirms, VR has been around for a while and has even enjoyed some success, particularly in the gaming world. However, the technology behind VR may finally be sophisticated enough to give it a fighting chance of being useful to a wider audience, particularly photographers and filmmakers. When I discuss VR in this article I’ll be specifically referring to VR in this context - for photographers, filmmakers, and also visual storytellers.

I’m not a hard core computer gamer or a rabid VR enthusiast; it’s likely that some of you reading this article know a lot more about VR than I do. However, I suspect I’m fairly representative of the typical photographer/filmmaker who’s followed VR from afar with a healthy bit of skepticism, waiting for someone to make a convincing argument that VR is relevant to me.

VR has enjoyed some success in the gaming world, but as a visual storyteller I've been waiting for someone to demonstrate how VR is relevant to me.

That's not to say that I haven’t experimented with VR, it’s just that until recently it never seemed terribly compelling to me as a content creator. Almost every VR experience I tried boiled down the same basic formula:

  1. Videographer places a VR camera in an iconic location and captures video from a single spot.
  2. Viewer puts on a headset and watches video until he or she gets bored.

At this point it seems like I’ve (virtually) stood around a lot of places: the pyramids of Egypt, next to the Eiffel Tower, Machu Picchu… you get the idea. But the key words are ‘stood around’. The experience can be interesting at first, but after about 30 seconds you’ve spun in a circle, looked up and down, and pretty much seen all there is to see.

But that’s not what you do when you go to one of these places, in real life. You want to explore, to learn something, to understand the story of the people or the place that you're visiting.

Viewing an iconic place, such as Machu Picchu, using VR can be interesting. However, unless you show your audience something unique, help them understand the place, or immerse them in a compelling experience, they will quickly lose interest.

Virtual Experiences

For VR to gain any type of traction it needs to go beyond this ‘stand there and look around’ model - and, fortunately, it has. This was particularly noticeable at the NAB trade show in April where VR technology appeared to be everywhere. There was even a Virtual and Augmented Reality Pavilion that served as a hub for numerous VR companies, including makers of capture devices, display systems, and even content creators.

My personal VR epiphany occurred at a technology showcase run by Kaleidoscope VR, a VR studio. In a roped off area dozens of people sat in chairs spread across the floor, each engrossed in some virtual world. What set the experience apart from most other VR demos I’ve seen was that the focus was on putting viewers into immersive stories and experiences.

Visitors trying virtual reality at the Kaleidoscope VR showcase.

‘Content is King’ may be one of the most overused phrases in modern media, but it keeps getting recycled because it’s fundamentally true. Lack of good content is why VR always seemed dull or gimmicky to me in the past, but my experience at the VR Showcase proved that with the right content VR can be incredibly compelling.

The first ‘film’ I selected was a VR experience called ‘Notes on Blindness: Into Darkness.’ Based on the audio diaries of a man named John Hull, who recorded hours of observations about how he learned to ‘see’ the world through sound after losing his sight in 1983, ‘Notes on Blindness’ isn’t, strictly speaking, an actual film. (It is, after all, an effort to help the viewer understand what it’s like to be blind.) Instead, it uses audio and 3D animations that mimic the real world.

Each scene begins mostly in darkness, accompanied by Hull’s narration of where he is and what he’s hearing. As different sounds enter the space, he describes them and indicates directionality, using phrases like “Behind my right shoulder I hear a car starting,” or “To my left I hear somebody running,” in a way that prompts you to move your head around to look. In essence, he’s directing you even if you don’t realize it. After a while you discover that Hull is able to draw a mental picture of what’s around him based on subtle cues such as the different sounds raindrops make when hitting objects, like a window or a teacup. As he speaks, scenes are gradually revealed in a manner reminiscent of The Matrix, but also rely on your imagination to complete the mental image.

I hope I never experience real blindness, however for the first time in my life I feel like I might have a very basic understanding of what it’s like for a blind person to try to ‘see’ the world using their other senses. The experience was more powerful than I anticipated.

The trailer for ‘Notes on Blindness’ (above) will give you a rough idea of what I’m trying to describe here. The VR experience will be available for download on June 30 if you want to try it yourself.

I also viewed ‘Witness 360: 7/7,’ a VR film that follows the experience of Jacqui Putnam, a commuter on the London Tube during the terrorist bombings of July 7, 2005. Shot documentary style, you see the places Jacqui went that day, including riding on the Tube itself, and hear her vivid descriptions of what happened. When she mentions something like “The person sitting next to me,” you turn and, sure enough, there’s a person sitting next to you that roughly matches her description.

The experience was more tense than I expected. I knew what was going to happen, and yet as I stood there on the train next to everybody else - real people who just happened to be on the Tube - I kept thinking to myself 'These people are about to die.’ The fact that I could look around and feel immersed in the situation, able to see the things Jacqui was describing, generated a visceral reaction that I’m not used to feeling while watching a documentary. It felt personal.

Despite very different subjects and creative approaches, both these VR experiences had one critical thing in common: neither one would have worked as effectively on a flat screen. They depended on a VR environment to achieve their impact.

By now you're probably asking how still photography fits into the VR world. Quite nicely, it turns out. Of course, the obvious applications are things like real estate photography, where 360º views can be critically important to attracting eyeballs. The real estate industry has been finding ways of doing this for years already, and new tools will only make the experience better and smoother. But it's the creative possibilities that are really interesting.

One thing photography has always been good at is closing distance, i.e. taking you to a faraway place you may not be able to visit in person. It's the reason we know what most of the world looks like despite never having been to most of it. VR has the potential to take this a step further. In the same way that color photography allowed us to see places differently than we could in black and white, VR will allow us to see places in an immersive way that we can't experience with a two dimensional picture. I'm not suggesting the VR is better than a still photo any more than I would suggest that a color photo is better than a black and white one. My point is that they are different, and each allows us to experience the world in a way the others don't.

Nice kitty. Imagine using a VR camera to put your viewer right into the middle of a pride of lions.

Photo: Jeff Keller

The key to VR still photography will be figuring out how to leverage the strengths of the medium. For example, most people enjoy a great landscape or wildlife photo. If you show me a beautiful Serengeti landscape with a lion in it I'll probably love the photo. However, if you show me that same landscape in VR it might not be as compelling since I can't see it all at once. However, if you let me stand right in the middle of a pride of lions eating a wildebeest you'll get my attention, because that's something I haven't experienced in a normal photo.

What all of these examples highlight is how important it will be for artists to take new and different approaches to capturing, editing, and presenting their work. It's an open canvas, and one that's still largely undefined.

VR Requires New Grammar

As Oscar-winning cinematographer Emmanuel Lubezki told us a couple months ago, the grammar and language of VR have yet to be written. This is true in a literal sense. Words like 'framing' and 'panning' simply don’t apply to VR. New words are needed, and nobody has agreed on what those words are yet. The one thing they do agree on is that VR will require different approaches appropriate to the medium.

This can be seen in the films described above, particularly ‘Witness.’ For example, the conventional documentary formula is to intercut interview footage with b-roll, but that never happens in ‘Witness.’ The convention works in flat films because you can lock the viewer into a rectangular frame and demand their attention. But what happens when the viewer has the freedom to look anywhere they want? Maybe they will get distracted by a picture hanging on the wall, or something happening outside a window. ‘Witness’ solves this by relying entirely on voiceover while featuring a few location shots of Jacqui Putnam throughout the film. This is just one example of where traditional filmmaking techniques don’t translate easily to VR, and there are many others.

It isn’t the first time content creators have faced this challenge. In the early days of television, studios often tried to repackage shows made for radio into TV, such as American soap operas. Daytime soap operas on radio were aimed at homemakers who could listen while working around the house. Studio executives had reservations about whether soap operas would even work on TV since they would require the homemaker to actually watch a screen.

Early soap operas were produced for radio; when TV came along producers had to figure out how to take advantage of the new medium.

By Photo by G. Nelidoff, Chicago, for CBS/Columbia Broadcasting Company. (Library of Congress) [Public domain], via Wikimedia Commons

Some production elements from radio didn’t translate well to TV. For example, producers had to re-think product placement and advertisements in shows - the very reason for the existence of soap operas in the first place - because having an actress pick up a box of laundry detergent and talk about its virtues in the middle of a scene just didn’t seem believable on TV. It took a few years before the industry perfected the formula.

The reason I point this out is because we’re still in the early days of VR. It’s easy to look at VR as it exists now and think of it as a gimmick, a tool for gamers, or a toy for tech nerds. And that’s OK - people thought similar things about TV at one point, but once content creators figured out how to effectively use the medium there was no turning back. I suspect the same will be true of VR: once the language of VR is fully developed, and hardware for consuming content becomes more convenient (it will), there’s a lot of opportunity to do creative things that may not work on a flat screen.