DPReview.com is closing April 10th - Find out more

Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Started Oct 21, 2019 | Questions
Nerazz New Member • Posts: 7
Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Hello,

As the title suggests is there any way that we can achieve this and then watch the converted photos in my HTC vive headset ?

Note that I don't want to convert the 2d photo into only 3d photo but I want to convert it into immersive VR180 photo like you feel you are in the scene  ( I mean the same as when you pause a VR180 video ).

Thank you in advance!

ANSWER:
This question has not been answered yet.
Brian F Flint
Brian F Flint Regular Member • Posts: 184
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

I am not certain about what you mean.

Here is a stereo photo adjusted to be suitable for viewing using a VR headset. Normally the image would be on a smart phone screen which is placed in the VR headset.

https://www.flickr.com/photos/26973646@N05/34549942442/in/dateposted-public/

 Brian F Flint's gear list:Brian F Flint's gear list
Panasonic Lumix DMC-ZS60 Sony RX10 III Canon MP-E 65mm f/2.5 1-5x Macro
OP Nerazz New Member • Posts: 7
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Sorry if did not explain my question clear enough.

What I meant is that I want to convert a 2D photo into a 3D VR180 immersive photo ( that should look like exactly the same as the 2 examples I mentioned below ) so that I can view it in any VR headset (in my case I have HTC vive pro headset).

Note that the stereo photo that you mentioned in your reply is indeed a 3d photo and I can view it in a VR headset but this is not what I am looking for since it is not immersive as VR180 photos which you move your head up/down and right/left ( look at the 2 examples bellow to see what I mean)

Example 1:

Here is an example of a 3D photo that you can view in VeeR VR App if you have a VR headset https://veer.tv/photos/stereoscopic-vr180-jenny-leong-opera-house-289767 .

All what you have to do is

1- just bookmark the 3d photo in the link above.

2- then open VeeR VR App in you PC

3- put your VR headset on

4- log in into your VeeR account then go the bookmarks section then you can find the bookmarked photo there

5- Then you can view the 3D photo.

Example 2:

Here is also another example of how the 3D photos should look like

https://www.youtube.com/watch?v=bFIUgLEGN44

you can open the youtube link in the YouTube VR app .

Thank you for your reply.

Gerry Siegel
Gerry Siegel Veteran Member • Posts: 3,244
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Nerazz wrote:

Sorry if did not explain my question clear enough.

What I meant is that I want to convert a 2D photo into a 3D VR180 immersive photo ( that should look like exactly the same as the 2 examples I mentioned below ) so that I can view it in any VR headset (in my case I have HTC vive pro headset).

Note that the stereo photo that you mentioned in your reply is indeed a 3d photo and I can view it in a VR headset but this is not what I am looking for since it is not immersive as VR180 photos which you move your head up/down and right/left ( look at the 2 examples bellow to see what I mean)

Example 1:

Here is an example of a 3D photo that you can view in VeeR VR App if you have a VR headset https://veer.tv/photos/stereoscopic-vr180-jenny-leong-opera-house-289767 .

All what you have to do is

1- just bookmark the 3d photo in the link above.

2- then open VeeR VR App in you PC

3- put your VR headset on

4- log in into your VeeR account then go the bookmarks section then you can find the bookmarked photo there

5- Then you can view the 3D photo.

Example 2:

Here is also another example of how the 3D photos should look like

https://www.youtube.com/watch?v=bFIUgLEGN44

you can open the youtube link in the YouTube VR app .

Thank you for your reply.

We are probably not speaking in the same language.  3-D as you use it is a wide wide image that is made wide in the taking of the shot.  There are cameras that can do this.  And add on tools for panorama photography.   In that definition, my reply is that No, I know of know way to convert a standard field of vision photo to one where it can be viewed in a super wide format with the devices we have for that purpose.

But be not dissuaded.  Look up panorama photography and stereo panorama shooting and you will find users who make such wide field images and the gear needed.

Stereoscopic two eyed 3-D is a definite medium of its own,  This forum concentrates on such.  It can be in any format and can be viewed in multiple devices. Conversion of flat images to streoscopic can be achieved in cinema.  I think it is a step too far for non pros.  And not worth it IMO.

So, I may still not be reading your query right or getting to what you like to achieve.  But I think so.  Good luck in your research.   I have not had the chance to try VR headsets.  Hear they are stunning.

 Gerry Siegel's gear list:Gerry Siegel's gear list
Panasonic ZS100 Panasonic Lumix DMC-GX7 Olympus E-M1 Panasonic Lumix DMC-GX8 Panasonic Lumix DC-G9 +4 more
OP Nerazz New Member • Posts: 7
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

@Gerry Siegel Thank you for your reply!

Yes I think you should try VR headsets they are great. Then you need to see the 2 examples I mentioned in my previous reply and examine them your self so that you can understand what I mean when I said " Is there a way to convert 2d images into 3d VR180 stereoscopic immersive images?" Theses 2 examples show you 3d VR180 immersive images exactly what I want to convert to from 2 flat images.

Thank you again and if there is a discord or any other mean so that I can join and discuss this topic and other similar topics please let me know I will appreciate it?

Brian F Flint
Brian F Flint Regular Member • Posts: 184
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Here is another example of something which is still not what you have asked about, but maybe a bit closer.

This clip was made from a 360 degree 2d panoramic image. The clip has a pseudo 3d effect.  Use red/cyan 3d glasses to view this anaglyph image.

https://www.flickr.com/photos/26973646@N05/33184844815/in/dateposted-public/

 Brian F Flint's gear list:Brian F Flint's gear list
Panasonic Lumix DMC-ZS60 Sony RX10 III Canon MP-E 65mm f/2.5 1-5x Macro
OP Nerazz New Member • Posts: 7
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

I don't have a red/cyan 3d glass to view this anaglyph image unforunitly and I don't know how to view it in my HTC Vive pro headset.

The thing is I have some old and new pictures and I want to convert them into immersive 3d VR 180 stereoscopic like exactly what I showed you in the 2 examples

Example 1

1-https://veer.tv/photos/stereoscopic-vr180-jenny-leong-opera-house-289767 .

Example 2

2-https://www.youtube.com/watch?v=bFIUgLEGN44

Please refer to my reply to know how to view these 2 examples.

Thank you for your cooperation.

Brian F Flint
Brian F Flint Regular Member • Posts: 184
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

I found this on flickr

https://www.flickr.com/photos/bormic/48718311427/in/pool-anaglyph/

A 360 degree pano which can be viewed from different angles by moving the mouse.

You have to zoom in first. To get the 3d effect you have to view using red-cyan glasses.

 Brian F Flint's gear list:Brian F Flint's gear list
Panasonic Lumix DMC-ZS60 Sony RX10 III Canon MP-E 65mm f/2.5 1-5x Macro
OP Nerazz New Member • Posts: 7
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Thank you

This is cool but its not what I am looking for if you misunderstood my query please let me know so that I can try to explain it in a different way because it is very important to me to find the answer to my query I have been searching for long time to find the answer and I have not found it yet if you know someone is expertise so that I contact him in person I would appreciate it .

Gerry Siegel
Gerry Siegel Veteran Member • Posts: 3,244
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Nerazz wrote:

Thank you

This is cool but its not what I am looking for if you misunderstood my query please let me know so that I can try to explain it in a different way because it is very important to me to find the answer to my query I have been searching for long time to find the answer and I have not found it yet if you know someone is expertise so that I contact him in person I would appreciate it .

Well, what if, just if, the answer is no.  Not by ordinary users.  Sometimes I find that I seek the impractical for my abilities as a non industrial user.   I have been into stereoscopy for ages and keep up with new techniques.  From cinerama to anamorphic.

How about the makers of the VR headset.  And are there forums for users.  Our reach must exceed or grasp, that too is true. Sometimes.  Aloha.

 Gerry Siegel's gear list:Gerry Siegel's gear list
Panasonic ZS100 Panasonic Lumix DMC-GX7 Olympus E-M1 Panasonic Lumix DMC-GX8 Panasonic Lumix DC-G9 +4 more
OP Nerazz New Member • Posts: 7
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Gerry Siegel wrote:

Nerazz wrote:

Thank you

This is cool but its not what I am looking for if you misunderstood my query please let me know so that I can try to explain it in a different way because it is very important to me to find the answer to my query I have been searching for long time to find the answer and I have not found it yet if you know someone is expertise so that I contact him in person I would appreciate it .

Well, what if, just if, the answer is no. Not by ordinary users. Sometimes I find that I seek the impractical for my abilities as a non industrial user. I have been into stereoscopy for ages and keep up with new techniques. From cinerama to anamorphic.

How about the makers of the VR headset. And are there forums for users. Our reach must exceed or grasp, that too is true. Sometimes. Aloha.

Thank you for your reply

But the reason I am optimistic and keep looking for a solution because:

Facebook ,in 2018 and this year, talks about something similar but I don't know if it is still out there or not.

you can check the following links:

https://www.engadget.com/2018/05/01/facebook-vr-memories/

https://gadgets.ndtv.com/apps/news/facebook-f8-3d-photos-to-virtual-reality-vr-1846189

Brian F Flint
Brian F Flint Regular Member • Posts: 184
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Facebook has a clever feature for making 2d photos appear 3d

https://facebook360.fb.com/2018/10/11/3d-photos-now-rolling-out-on-facebook-and-in-vr/

 Brian F Flint's gear list:Brian F Flint's gear list
Panasonic Lumix DMC-ZS60 Sony RX10 III Canon MP-E 65mm f/2.5 1-5x Macro
3D Gunner Senior Member • Posts: 1,031
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Yes, this is possible from technical point of view.
1. Take your 2D pictures and convert them in 3D pictures (for good quality, you need a specialist to perform multi-layer mapping 3D conversion).
2. Each image for the corespondent eye must be inserted in a 360* panorama format (black background, and the image will occupy only a surface with the corespondent FOV).
3. Each pair for 3D images will be inserted in a 360* panorama 3D format (with dedicated software), which can be seen in a VR 3D device with proper software.
4. If your pictures are not panoramic, panorama formats for VR with limited FOV can be used and in final you will have something VR 3D in which the head movement is limited at 180* (by example).
5. Instead of a black background, a pre-rendered 3D background can be used, for a more spectacular effect (something like a 3D cinema room, and your picture will be placed on the screen of this cinema...

OP Nerazz New Member • Posts: 7
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Thank you @3D Gunner

This looks little bit advanced but I will try my best to do these steps and see what happens I wish there is one dedicated software can do all or most of these steps.

Thank you for your reply.

3D Gunner Senior Member • Posts: 1,031
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

The only serious challenge is to convert 2D images in good quality 3D images. The task is better to be done with real 3D pairs.
- To insert your images in a black background for 360* VR pano is also very simple (images with smaller FOV than 180* must be properly distorted before insertion and must be placed exactly in the center of background).
- Then, you need a proper player to see your 360*/180* images located on your computer, with your VR device.

How to watch videos/photos on the HTC Vive and Vive Pro

- For others to see your images as in your link (veer.tv/photos/vr180), special metadata must be attached to images before placed on internet!

3D Gunner Senior Member • Posts: 1,031
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

So, I made a small demo for you.
- The 360* 3D VR background was downloaded from internet (I supose is free for demo).
- The inserted picture is mine (with the insect under magnifying glass).
- On a 3D TV can be seen with GoProVRPlayer (with proper settings for input and output), by example.
- On a smartphone VR device (smartphone with tracking sensors + HMD) can be seen with VR Media Player - 360° Viewer (with proper settings).
- The picture is a simple .jpg file, without dedicated exif attached, so is not automatically detected as a 3D 360* VR file. The viewers/players must be manually settled to see the image in 3D 360* VR environment!
- Other VR devices may need an other VR player!

Enjoy!

OlivierDel New Member • Posts: 1
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Hi,

I understood your need because I have the same
I capture 2 images by placing 2 Iphones side by side
When I merge them in photo software, I can see them in 3D with a Google Cardboard
But it does not work in 3D with my Oculus Quest 2

Have you found a solution?

Thank you

Brian F Flint
Brian F Flint Regular Member • Posts: 184
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

The link below is for a side by side parallel-view stereo image, scaled in size to make it suitable for viewing on VR headset. I bought a Zeiss VR One headset to view my side by side stereo images on a smartphone. I wanted to see what my 3d side by side images would look like using the headset as a stereo viewer. The first thing I found was the images for left and right were far too large. My smart phone is a Sony Xperia Z5 premium and the display is 121 x 68mm in size. The centre of the two images need to be spaced apart by a distance slighty greater than the spacing of my eyes. I found the optimum distance to be 68mm. Also for best effect the images are better if they have some barrel type distortion applied as the lenses in the headset stretch the corners outwards to give a more immersive effect. This stereo image shown here is about right for my Xperia Z5 premium smartphone in the 'Zeiss VR One' headset. Notice how small the images are compared with the area of the display ( shown by a white line). Only about 30% of the pixels in the display are used, the rest are wasted.

https://www.flickr.com/photos/26973646@N05/34370957872/in/dateposted-public/

 Brian F Flint's gear list:Brian F Flint's gear list
Panasonic Lumix DMC-ZS60 Sony RX10 III Canon MP-E 65mm f/2.5 1-5x Macro
3D Gunner Senior Member • Posts: 1,031
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Hi Brian!

Specification for ZEISS VR ONE Plus say: Supported wide range of interpupillary distance (IPD) - 53 ~ 77 mm (this means 68mm is included)

So, something is wrong. Your images should be viewed without spacing.
I know you make very good 3D photos, so the problem is about how to assemble the images so that you can observe them comfortably.

If you want to use the entire screen area (or a larger part) in the VR device, may need a different approach to how to capture and mount the images for the 3D pair.
For viewing standard 3/2 format pairs, a lot of available screen is wasted.
First question: Why no increase the size of pictures until cover the entire width of the screen?

I propose to open a separate thread where we can discuss / develop these aspects.

rossii New Member • Posts: 1
Re: Converting 2d flat photo into immersive 3d VR 180 steroscopic (with depth) photo

Yes and no. No you can't create a 180 degree picture from a photo because it would look like a fish bowl and wouldn't have enough resolution to stretch it without making it look terrible. Unless the photo is panorama. But what you can do instead is convert a 2d photo into a 3d photo and you can use AI to generate Depth Maps. The Depth Maps are like a separate png file you have which looks similar to the original photo, but its colour pallet is black and white. The white would represent close up and black would be far away, then different grades of grey to represent the depth of objects in between. You could use a tool like StereoPhoto Maker (SPM) to do this. There are other projects on github doing similar things that might get even better results. You can stick to the software UI, or dive in deeper by learning how to run python scripts and install the plugins, or maybe Google Collab scripts could be easier, which is a Cloud based script workbook that people have written, to run their code and do the conversions. There are some on there that can do this. But this picture in VR will not feel like you are there, it will be like looking at a photo up close in vr, but if you move your head you will see the different objects move in a way that gives the illusion of depth. They don't move a massive amount but enough to make it look cool.

Once you have a depth map you can create a SBS (side by side) image using the 2d image + the depth map converter. Then just save it as jpg, load up the image in a photo viewer VR program, switch it to side by side and you are good to go. If you switch to 180 you will realize that it looks terrible, flat should work ok though.

"I think" there are some new age mobile phones that have cameras that can generate depth maps. Another alternative, if the photo is of a person, you could cut them out and paste them into a pre-existing 180 degree scene. Maybe go to the same place in google maps and save the 360 photo of this place and put the person in. lol

Keyboard shortcuts:
FForum MMy threads