Augmented / Mixed / Virtual Reality

AVPro Video has a number of features useful for XR experiences.

360 and 180 Formats

Three popular spatial mapping formats are supported:

  • Equirectangular 360
  • Equirectanuglar 180
  • Cubemap 3:2 (also known as Facebook Cubemap)

These layouts can be set as a hint on the MediaPlayer via the Inspector, or via scripting:

// Set the video layout mapping hint on the MediaPlayer
mediaPlayer.VideoLayoutMapping = VideoMapping.EquiRectangular180;

Displaying

Equirectangular videos can be played on a sphere, or assigned to a Skybox material.

The ApplyToMesh component can be used to render a video to a sphere with the user camera at the center of the sphere. See the 360 Sphere Demo for an example of this.

Or a Skybox component with ApplyToMaterial component can be used to render a video to the skybox. See the Display Components Demo for an example of this.

High Resolution Video

360 / 180 VR videos typically require high resolutions. See the High Resolution Video section.

3D Stereo Video

See the 3D Stereo Video section.

180 Video

180 video works similarly to 360 video, but with some differences:

  • Make sure to set the spatial mapping format to Equirectangular 180 either in the Visual section of the MediaPlayer component in the Inspector, or via scripting.
  • If the 180 video displayed (eg using ApplyToMesh component) on a sphere then it will be mirrored front and back. Instead a material with the AVProVideo/VR/InsideSphere Unlit Transparent(stereo+color+fog+alpha) shader can be applied to the sphere and this will only render the video to the front half of the sphere, and feather the edges to transparency. The amount of feathering can be controlled in the material using the Edge Feather property.

Spatial Audio

See the 360 Audio section.

VR / AR / MR / XR Headsets Supported

Android

  • Oculus Rift Go
  • Oculus Gear VR
  • Oculus Quest
  • Oculus Quest 2
  • HTC Vive Focus
  • HTC Vive Focus Plus
  • HTC Vive Focus 3
  • Gear VR
  • Google Cardboard
  • Google Daydream
  • Pico Goblin
  • Pico G2 4K
  • Pico Neo 2
  • Pico Neo 3
  • Lenovo Mirage Solo

Windows Desktop

  • HTC Vive
  • HTC Vive Pro
  • HTC Vive Cosmos
  • Valve Index
  • Oculus Rift
  • Oculus Rift S
  • StarVR

Windows UWP

  • Microsoft Hololens
  • Microsoft Hololens 2
  • Samsung Odyssey
  • Asus
  • HP
  • Acer
  • Lenovo Explorer
  • Dell Visor