Primer: What is VR, and why should photographers care?
1 VR explainer
|VR was everywhere at NAB, and at CES this year.|
Virtual reality is an immersive experience that involves multiple senses, and, most importantly, responds to the intentional interaction of the viewer. From the earliest days of synchronized film and sound playback, the illusion of being in a different place or time, and generating an emotional response to the experience, has been the goal of most modern communication and entertainment mediums.
In VR, this illusion is referred to as 'presence,' where not only the sights and sounds (and other sensory input) are believable, but the ‘show' itself reacts to the participant's actions in a plausible way.
It isn't hard to imagine how different the experience of browsing through a gallery of images can be when they are not just thumbnails on a tight grid, but rather 'virtually' hung by the artist in a spacious VR room that mimics a physical gallery space. VR video adds the active immersion of being in the middle of a busy plaza, or riding inside a rally car during a nighttime ice race. The opportunities to share even simple, daily events become less about what was in the frame at the time, and more about what the whole location felt like.
VR differs from flat, 2D photos by requiring at least a seamless 360-degree view, and eventually full freedom of 3D motion.
First, let's get some semantics out of the way. 'Virtual reality,' or VR, has generally been applied to 3D computer-generated graphics. There are some who say that anything that starts with a camera pointed at the real world is not VR. This ignores some of the history of VR (see below), as well as the coincidence that interactive panoramic images and videos on the web are displayed as textures on the inside of a 3D cube (or sphere, in some cases). There are also ways to create realistic 3D data from photographs, and from spherical panoramas in particular, both of which currently offer greater realism than 3D graphics created without the aid of photography.
While we could separate photography from 3D graphics by dogmatically referring to 360 x 180-degree images as 'spherical panoramas,' and try to demarcate 2D/3D hybrid technologies as 'not photography,' this would be unfair. Therefore, this article will still refer to VR as both an immersive experience, and something that a camera can capture.
This primer will touch on the various technologies and companies involved in VR, but the underlying theme is on how conventional photography and cinematography influence VR, and how VR will influenced them in return.
History of VR
|(Clockwise from upper left) Sensorama, Battlezone, Virtuality arcade, USAF virtual cockpit, UIC CAVE, Telepresence HMD.|
The term 'virtual reality' was originally coined (in French) by Antonin Artaud in his 1938 essays on the nature of theatrical performances, so it's rather fitting that the first functional VR experience, Sensorama, was conceived and patented (in 1957) by cinematographer Morton Heilig. In 1961, Heilig also patented a head-mounted, stereoscopic display system. While these inventions relied on pre-recorded films with very limited interaction, they introduced the concept of a viewer being immersed in a different environment; including the sights, sounds, smells and even windspeed of the environment being represented.
Though the entirely analog Sensorama never really took off, the concept of immersion was a core aim for early computer-generated 3D graphics. Most pioneering modern VR development was focused on military and aerospace training, where it is much safer, easier, and ultimately cheaper, to teach someone how to react to difficult situations in a virtual environment. The first 3D VR displays showed only glowing wireframes against a black screen (a la Battlezone), while the physical surroundings mimicked a real cockpit or driver's seat, complete with hydraulics to pitch the cabin during the experience.
In the 1980's and early 90's, the increasing visual fidelity of real-time computer graphics (driven both by industrial and entertainment uses) promised more realistic virtual environments, and the first wave of hype for consumer VR built up, entering popular culture with arcade entertainment like the Virtuality systems, and creative works like Neuromancer and The Lawnmower Man.
Once this wave of hype broke on the shores of limited computing power, minimal content, and vaporware consumer displays (anyone remember SegaVR?), the relevant technology continued to advance in a consistent, but much quieter, fashion. Real-time 3D computer graphics progressed from plasticky representations on expensive workstations, to the increasing visual realism of PC and console games. In 1994, Apple introduced QuickTime VR as a very simple, portable way to display panoramic content with the freedom to look around, and this extension of QuickTime quickly became known for real estate 'virtual tours' and other early forms of photography-based VR on a computer.
This content requires HTML5 with CSS3 3D Transforms or WebGL.
|HTML5 static 360 VR sample - click this link for the VR headset version. (Made with Pano2VR)|
In 2003, Linden Labs created Second Life, an entirely virtual 'social world' in which users could interact using human-looking avatars within an entirely synthetic, and user expandable, 3D world. Connecting people via the internet was not new, nor did Second Life initially support VR headsets with stereoscopic rendering, but this remains a good example of a successful shared 'virtual reality', in the original theatrical sense.
The 2007 introduction of Google Street View democratized the idea of spherical panoramic imagery (360 x 180 degrees of coverage) to immerse a viewer in various locations in the real world. This blending of photographic content with geographic data has broadened consumer acceptance of photographic VR, while the 2014 introduction of Google Cardboard (an inexpensive way to turn a modern smartphone into a VR headset) allows this vast amount of panoramic data to be viewed in a more natural, immersive way.
The new hype of modern VR
Recent advancements in consumer electronics have reinvigorated virtual reality and given it new vigor, as well as inspiring new generations of researchers, entrepreneurs, and content creators. The ever-increasing computing power and screen resolutions of smartphones, combined with their built-in gyroscopes and accelerometers (useful for head tracking), have made these ubiquitous devices almost ideal for repurposing as a viewer for VR games, images, and video.
Combining a phone with the simple mechanics of a Google Cardboard-type viewer, VR photos, apps and games (as well as New York Times articles) means that VR content can be appreciated by a wider audience.
|Google Cardboard - a $15 immersive display for anyone to try out.|
Prior to Cardboard, most attempts at making a smartphone into a viewing platform were limited to stereographic toys, without enough software and hardware polish to make it a good experience. Samsung changed this by partnering with Oculus to produce the (currently $99) Gear VR headset, which is more than just a pair of lenses and a phone holder. Gear VR has its own accelerometers and gyroscope, as well as a USB connected control-pad, while Oculus provides a content store and software to enhance the experience. All of this pushes accessibility up from the bottom.
The same technology from smartphones has driven down the component cost of higher-end systems for virtual reality and augmented reality (AR), leading to consumer-level, dedicated, head-mounted displays like the Oculus Rift and HTC Vive, and extensions to game consoles like Playstation VR. While the initial adoption of these systems may be mainly with hard-core gamers and technophiles, the experiences and content being developed for these systems can be more ambitious and immersive, which in turn will draw more users to the hardware. The VR ecosystem is spreading rapidly, and spherical VR photos and videos are frequently the first experience most consumers will have.
Follow the money
Recent years have seen explosive growth in terms of business investments into VR, from the display systems (Facebook buying Oculus for $2 billion in 2014), to content creation (Nikon and Samsung have recently announced consumer 360 cameras, and Ricoh is on v.3 of theirs), while various VR startups raised over $658 million in funding just in the past year. The established games industry has already spent millions of dollars preparing for the 3D VR gaming revolution, which many analysts now say is no longer an 'if' proposition, but rather a 'when.'
Consulting and auditing firm Deloitte has predicted that the VR market (for content and devices) will hit $1 billion in sales during 2016 alone. Meanwhile, the games and VR consulting firm Digi-Capital goes even further to say that by 2020, the virtual reality and augmented reality markets will be worth around $120 billion. These market predictions are not based on advances in research labs and high-end applications, but rather from the groundswell of video game and mobile technology, along with increasingly diverse content.
As Alexandre Jenny, the Senior Director of Immersive Media at GoPro, puts it; "We are no longer wondering 'will VR change the world,' we are in the stage of 'how will VR change the world?' VR is certainly the best way to give someone an immersive experience, and that fact is really disruptive in many industries."
Aside from research and purely artistic uses of VR (both of which have a long and fruitful history), there are numerous commercial applications for virtual reality, and many more are being developed as the tech progresses. Below are just a few examples.
Apple has updated its professional video editing app Final Cut Pro X to version 10.4.6. The update brings full 64-bit support, a new feature that helps convert older formats and much more.
Tonight's episode of NBC's Tonight Show, hosted by Jimmy Fallon, was filmed entirely on Samsung's flagship smartphone the Galaxy S10+.
Camera Bits has released the long-awaited update to its photo ingestion software in the form of Photo Mechanic 6.
SmugMug Films has shared its latest film, Streets in Mind, which takes a look at the life and work of London-based street photographer Alan Schaller.
We were in Japan earlier this month for the annual CP+ show in Yokohama, where we sat down with senior executives from several camera and lens manufacturers, among them Nikon.
Sony has released firmware version 5.0 for its flagship mirrorless camera, the a9. The update brings AI-driven autofocus modes, an improved menu structure and other updates.
Night Sight, Portrait Mode and (surprisingly) wide-angle selfie mode are features that we're currently loving about the Pixel 3's camera.
The Auschwitz Museum has asked visitors to be more respectful after an upsurge of pictures posted on social media showing people posing on the train tracks that lead to the main gate.
This week Chris and Jordan take the new Leica Q2 for a spin, and while most of us in the Northern Hemisphere are welcoming spring, they head even farther north than usual to visit ice castles. Because #Canada.
Harvard is facing a lawsuit over profiting from 19th century daguerreotypes that captured the portrait of a slave and his daughter on a South Carolina plantation.
From the detailed textures in rural landscapes to the incredible lighting inside futuristic buildings, the photorealism of Unreal Engine 4 is blurring the lines between fiction and reality...you know...aside from the spaceship.
Facebook has sent out emails to affected users requesting they change their passwords following a discovery that over 20K Facebook employees had access to 600 million passwords.
We've added Panasonic's new Lumix S1 and S1R full-frame mirrorless cameras to three of our buying guides. If you're looking for a quick summary of each model, then have a read.
YouTube channel Photoshop Cafe has shared a video detailing ten tips and tricks you can do to both fix and speed up Photoshop when it's running slow and sluggish.
It's not going to be the banger of the year, but it'll get a few laughs.
DJI has confirmed its drones won't be affected by the GPS 2019 week rollover.
Dogfish Head Craft Brewery has teamed up with Kodak to release a beer that's capable of doubling as a film developer.
The Diana Instant Square is a retro-inspired camera with manual controls that's fun to shoot in good light, but largely unpredictable in its operation.
Residents of a Paris street plagued by Instagrammers, selfie takers and music video crews are asking the city government for a weekend and evening ban to give them some peace.
The adapter plugs into the Osmo Pocket's USB Type-C port and features a 3.5mm TRS jack to plug in various external microphones.
Checkout allows Instagram users to select products for purchase and make payments directly in the app.
GauGAN as it's known, can create photorealistic images from basic drawings using the power of artificial intelligence.
The EOS RP is Canon's latest full-frame mirrorless camera, with diminutive dimensions and a diminutive price. Find out how it stacks up and get our thoughts in our early review.
Montana judge Dana L. Christensen has ruled the Republican National Committee did not infringe upon the copyright of photographer Erika Peterman after they took a photo from a Democratic candidate's Facebook page without permission and altered it to use in a derogatory promotional mailer.
Nikon has launched updates for three of its programs to address various bugs and glitches that could cause crashes and unwanted results.
LEE Filters has launched the LEE100, its next-generation filter holder that improves the design and looks in all the right places.
With the arrival of some much-needed sunshine and final production firmware for the Panasonic S1, we've been able to get outside and really start putting the camera through its paces.
Importing, culling and tagging photos is about to get a whole lot faster and look a whole lot better with the impending arrival of Photo Mechanic 6.
On its own, the FTZ adapter retails for $250 and when bundled it dropped the cost to just $150. Now, Nikon is offering it for free with all Z6, Z7 purchases in the United States.
Profoto said it spoke with Godox back at Photokina 2018 and continues to contact Godox in an effort to stop it from marketing its V1 light.