Primer: What is VR, and why should photographers care?
1 VR explainer
|VR was everywhere at NAB, and at CES this year.|
Virtual reality is an immersive experience that involves multiple senses, and, most importantly, responds to the intentional interaction of the viewer. From the earliest days of synchronized film and sound playback, the illusion of being in a different place or time, and generating an emotional response to the experience, has been the goal of most modern communication and entertainment mediums.
In VR, this illusion is referred to as 'presence,' where not only the sights and sounds (and other sensory input) are believable, but the ‘show' itself reacts to the participant's actions in a plausible way.
It isn't hard to imagine how different the experience of browsing through a gallery of images can be when they are not just thumbnails on a tight grid, but rather 'virtually' hung by the artist in a spacious VR room that mimics a physical gallery space. VR video adds the active immersion of being in the middle of a busy plaza, or riding inside a rally car during a nighttime ice race. The opportunities to share even simple, daily events become less about what was in the frame at the time, and more about what the whole location felt like.
VR differs from flat, 2D photos by requiring at least a seamless 360-degree view, and eventually full freedom of 3D motion.
First, let's get some semantics out of the way. 'Virtual reality,' or VR, has generally been applied to 3D computer-generated graphics. There are some who say that anything that starts with a camera pointed at the real world is not VR. This ignores some of the history of VR (see below), as well as the coincidence that interactive panoramic images and videos on the web are displayed as textures on the inside of a 3D cube (or sphere, in some cases). There are also ways to create realistic 3D data from photographs, and from spherical panoramas in particular, both of which currently offer greater realism than 3D graphics created without the aid of photography.
While we could separate photography from 3D graphics by dogmatically referring to 360 x 180-degree images as 'spherical panoramas,' and try to demarcate 2D/3D hybrid technologies as 'not photography,' this would be unfair. Therefore, this article will still refer to VR as both an immersive experience, and something that a camera can capture.
This primer will touch on the various technologies and companies involved in VR, but the underlying theme is on how conventional photography and cinematography influence VR, and how VR will influenced them in return.
History of VR
|(Clockwise from upper left) Sensorama, Battlezone, Virtuality arcade, USAF virtual cockpit, UIC CAVE, Telepresence HMD.|
The term 'virtual reality' was originally coined (in French) by Antonin Artaud in his 1938 essays on the nature of theatrical performances, so it's rather fitting that the first functional VR experience, Sensorama, was conceived and patented (in 1957) by cinematographer Morton Heilig. In 1961, Heilig also patented a head-mounted, stereoscopic display system. While these inventions relied on pre-recorded films with very limited interaction, they introduced the concept of a viewer being immersed in a different environment; including the sights, sounds, smells and even windspeed of the environment being represented.
Though the entirely analog Sensorama never really took off, the concept of immersion was a core aim for early computer-generated 3D graphics. Most pioneering modern VR development was focused on military and aerospace training, where it is much safer, easier, and ultimately cheaper, to teach someone how to react to difficult situations in a virtual environment. The first 3D VR displays showed only glowing wireframes against a black screen (a la Battlezone), while the physical surroundings mimicked a real cockpit or driver's seat, complete with hydraulics to pitch the cabin during the experience.
In the 1980's and early 90's, the increasing visual fidelity of real-time computer graphics (driven both by industrial and entertainment uses) promised more realistic virtual environments, and the first wave of hype for consumer VR built up, entering popular culture with arcade entertainment like the Virtuality systems, and creative works like Neuromancer and The Lawnmower Man.
Once this wave of hype broke on the shores of limited computing power, minimal content, and vaporware consumer displays (anyone remember SegaVR?), the relevant technology continued to advance in a consistent, but much quieter, fashion. Real-time 3D computer graphics progressed from plasticky representations on expensive workstations, to the increasing visual realism of PC and console games. In 1994, Apple introduced QuickTime VR as a very simple, portable way to display panoramic content with the freedom to look around, and this extension of QuickTime quickly became known for real estate 'virtual tours' and other early forms of photography-based VR on a computer.
This content requires HTML5 with CSS3 3D Transforms or WebGL.
|HTML5 static 360 VR sample - click this link for the VR headset version. (Made with Pano2VR)|
In 2003, Linden Labs created Second Life, an entirely virtual 'social world' in which users could interact using human-looking avatars within an entirely synthetic, and user expandable, 3D world. Connecting people via the internet was not new, nor did Second Life initially support VR headsets with stereoscopic rendering, but this remains a good example of a successful shared 'virtual reality', in the original theatrical sense.
The 2007 introduction of Google Street View democratized the idea of spherical panoramic imagery (360 x 180 degrees of coverage) to immerse a viewer in various locations in the real world. This blending of photographic content with geographic data has broadened consumer acceptance of photographic VR, while the 2014 introduction of Google Cardboard (an inexpensive way to turn a modern smartphone into a VR headset) allows this vast amount of panoramic data to be viewed in a more natural, immersive way.
The new hype of modern VR
Recent advancements in consumer electronics have reinvigorated virtual reality and given it new vigor, as well as inspiring new generations of researchers, entrepreneurs, and content creators. The ever-increasing computing power and screen resolutions of smartphones, combined with their built-in gyroscopes and accelerometers (useful for head tracking), have made these ubiquitous devices almost ideal for repurposing as a viewer for VR games, images, and video.
Combining a phone with the simple mechanics of a Google Cardboard-type viewer, VR photos, apps and games (as well as New York Times articles) means that VR content can be appreciated by a wider audience.
|Google Cardboard - a $15 immersive display for anyone to try out.|
Prior to Cardboard, most attempts at making a smartphone into a viewing platform were limited to stereographic toys, without enough software and hardware polish to make it a good experience. Samsung changed this by partnering with Oculus to produce the (currently $99) Gear VR headset, which is more than just a pair of lenses and a phone holder. Gear VR has its own accelerometers and gyroscope, as well as a USB connected control-pad, while Oculus provides a content store and software to enhance the experience. All of this pushes accessibility up from the bottom.
The same technology from smartphones has driven down the component cost of higher-end systems for virtual reality and augmented reality (AR), leading to consumer-level, dedicated, head-mounted displays like the Oculus Rift and HTC Vive, and extensions to game consoles like Playstation VR. While the initial adoption of these systems may be mainly with hard-core gamers and technophiles, the experiences and content being developed for these systems can be more ambitious and immersive, which in turn will draw more users to the hardware. The VR ecosystem is spreading rapidly, and spherical VR photos and videos are frequently the first experience most consumers will have.
Follow the money
Recent years have seen explosive growth in terms of business investments into VR, from the display systems (Facebook buying Oculus for $2 billion in 2014), to content creation (Nikon and Samsung have recently announced consumer 360 cameras, and Ricoh is on v.3 of theirs), while various VR startups raised over $658 million in funding just in the past year. The established games industry has already spent millions of dollars preparing for the 3D VR gaming revolution, which many analysts now say is no longer an 'if' proposition, but rather a 'when.'
Consulting and auditing firm Deloitte has predicted that the VR market (for content and devices) will hit $1 billion in sales during 2016 alone. Meanwhile, the games and VR consulting firm Digi-Capital goes even further to say that by 2020, the virtual reality and augmented reality markets will be worth around $120 billion. These market predictions are not based on advances in research labs and high-end applications, but rather from the groundswell of video game and mobile technology, along with increasingly diverse content.
As Alexandre Jenny, the Senior Director of Immersive Media at GoPro, puts it; "We are no longer wondering 'will VR change the world,' we are in the stage of 'how will VR change the world?' VR is certainly the best way to give someone an immersive experience, and that fact is really disruptive in many industries."
Aside from research and purely artistic uses of VR (both of which have a long and fruitful history), there are numerous commercial applications for virtual reality, and many more are being developed as the tech progresses. Below are just a few examples.
Jun 27, 2017
Jun 26, 2017
Jun 26, 2017
Jun 23, 2017
|scrum break away by al booth|
from Sport competition
|Chinese Acrobat by lim yau tong|
|Parking Deck by Olaf R|
from Your City - Parking Garage
|Communication Tech by alberto_b|
|With & without by OBellini|
from Empty - Full
When one of his friends got a filter stuck on his $1,700 Canon EF 24-70mm F2.8L, former MythBuster Adam Savage removed it using an unlikely, terrifying tool: a band saw.
The New Yorker asked Magnum's famed photographers, in town for the agency's 70th anniversary, to go out and capture 'the fleeting beauty of New York City's golden hour.' This is what they shot.
Roger Cicala is a difficult man to impress, but he's been waxing lyrical over at Lensrentals about Sony's new 12-24mm wide zoom.
Glassware is one of the most challenging subjects to photograph, especially against a white background. This tutorial shows you how to do it with hardly any gear.
Handevision is now shipping its all-metal Iberit 90mm F2.4 short telephoto lens for Leica M-mount 35mm and full-frame cameras.
Isocell comprises four sub-brands: Bright, Fast, Slim and Dual which are tailored to specific mobile device market demands.
The new store will be located at the Fotografiska center for contemporary photography in Stockhom, Sweden and carry the full range of Hasselblad products.
A recent vacation gave Richard a chance to think about the needs of travel photography – and how our reviews might recognize the perfect travel camera.
Need more evidence that 2017 is the year analog begins its comeback? Well, welcome another new film stock to the world.
The winners of the 10th annual iPhone Photography Awards have been announced, and they're striking.
If you were disappointed by reports that the Sony a9 struggles with adapted Canon glass, you might be able to take some comfort from Metabones' latest update.
Blackmagic Design has dropped the prices of its Video Assist external monitor/recorders for a limited time. Prices of the SD card-based recorders will be reduced in all markets, while supplies last.
Instagram has started testing a new feature called 'favorites' that enables users to share photos with only certain people. Only a small number of users have access to the feature at this time, though it may roll out to everyone in the future.
Lensbaby has announced the Velvet 85 F1.8 for interchangeable lens cameras. The lens is available in Canon, Nikon, Sony E, Sony A, Pentax K, Samsung NX, Fuji X and Micro 4/3 mounts.
It's the end of an era. Parent company Micron has announced that they are discontinuing the Lexar retail brand. This includes 'memory cards, USB flash drives, readers, and storage drives.'
Youthful trainspotter turned adult photographer, John Sanderson has traveled across the United States, documenting the country's railroads. But you won't find any trains in his pictures.
Sony's new CMOS sensor is backside-illuminated and offers an all-pixel global reset function which should drastically reduce rolling shutter effect when panning.
Shoulderpod has converted its offerings into a lego-like modular system by offering all individual parts of existing products separately, allowing users to build exactly the rig they need for a specific project or simply replace a damaged part.
Photographer Felix AAA has spent the past ten years touring the world with a variety of musicians, capturing behind the scenes shots and portraits. He talks about some of his favorite images on the FujiFilm Blog.
A roll of film discovered in an Argus C2 from an Oregon Goodwill turned out to contain some incredible images – and has been re-united with the original owner's family.
Nikon's 28mm F1.4E ED appears to roundly complete the company's updated lineup of fast, professional prime lenses. We've already seen some initial images from a Nikon ambassador, but we've worked through a gallery of our own, with a lens of our own over the past week. Take a look.
Google is holding a competition that could see your Pixel photos gracing millions of screens.
Nikon's 100th birthday party continues worldwide as a distributor in Italy organized a one-of-a-kind feat: assembling the world's largest 'human camera' from over a thousand volunteers.
Ricoh has dropped the price of its Theta SC 360 spherical camera by to $199, a reduction of roughly $50. The camera features two 12MP sensors and can record Full HD video in addition to stills.
Photojournalist Pete Souza served as the presidential photographer for both Ronald Reagan and Barack Obama. In an interview with fellow photographer Marcia Nighswander, he discusses several of his most noteworthy images.
Photographer Michael Wolf has been documenting the crowded conditions of Tokyo's subway trains since the 1990s. The photos have gone viral regularly in the years since he started the project, and he just published the final edition in the series.
The just-launched OnePlus 5 is getting a minor update that should improve camera function.
A Belgian camera shop is showing off an extremely rare, limited 'Rex Edition' Nikon D500. The cosmetic alterations were provided by a customer's German Shepherd Rex, who got ahold of the camera within a day of its purchase.
Adobe says that many of its users have been relying on SkyBox for VR editing and it therefore made sense to make the plug-ins available to all subscribers through Creative Cloud.
The Pictar grip provides a number of customizable physical controls for your iPhone camera, but at its price point we would like to see better materials and build quality.