Using Quest Passthrough with MRTK3

[thisisvaze]

How to develop apps with passthrough on a Quest device using MRTK3?

[thisisvaze]

I was able to use the passthrough mode on a Quest device as suggested by @Zee2.

1. Add both MRTK3 and Oculus Integration SDK to your Unity project.
2. In the scene use MRTK XR Rig and add these scripts: OVR Manager and OVR Passthrough layer.
3. The only issue was that the MRTK XR Rig's Main camera sets the background black when initiated, so I added this to Update() on a script with the following code to change the background color to clear.
   Camera.main.backgroundColor = new Color(0f,0f,0f,0f);

Tested and worked in the Unity play mode, not sure if it works when the app is deployed.
Can't wait to get official support for the passthrough but this should do for prototyping until then!

[Zee2]

Hey @trzy, known issue with the current handconstraint script. Refactor to a standalone handmenu script is happening here: #10852

[Zee2]

(current handconstraint script has no fallback when no joints are available.)

[keveleigh]

The only issue was that the MRTK XR Rig's Main camera sets the background black when initiated

Huh, I can't seem to find the component that's doing that and have been unable to repro...we have a script called CameraSettingsManager which allows for specifying your camera settings across transparent and opaque devices, but it's not on the MRTK XR Rig prefab by default and can also be customized in the inspector. The rig's camera appears to be Color.clear by default. Please let me know if I'm missing anything so I can help streamline this path!

[thisisvaze]

@keveleigh You can add this script Camera.main.backgroundColor = new Color(0f,0f,0f,0f); in your script on Update() method and it should override the previous default settings.

[LocalJoost]

@thisisvaze this does not seem to work when deployed. Would you mind sharing your OVR Passthrough Layer script setting? If I set it to Overlay it kinda works, but I have to set the opacity to 0.3 so it's all kind of hazy. If I set it to Underlay I basically don't see any background.