What is MV-HEVC used for Apple Vision Pro Stereoscopic experiences?
MV-HEVC stands for Multiview High Efficiency Video Coding. It's an extension of the standard High Efficiency Video Coding (HEVC) that allows for the encoding of multiple views, or perspectives, of a scene within a single video stream. This is particularly useful for 3D video, where two perspectives (one for each eye) are required to create a stereoscopic effect, giving the illusion of depth.
The MV-HEVC approach to 3D video involves encoding two slightly different views of the same scene (left and right) into a single video frame. This process involves a technique called "2D Plus Delta," where the differences (or delta) between the left and right images are determined and encoded. This allows 2D decoders to use the base 2D view (usually the left eye view), while 3D decoders can calculate and present both views to the corresponding eyes.
This multiview approach offers efficiency benefits, as it exploits the high degree of similarity between the different views of a scene, reducing the amount of data required to represent the additional views.
Which camcorder is capable of supporting MV-HEVC or 2D Plus Delta? Currently, there are no other camcorders compatible with MV-HEVC, apart from the Apple Vision Pro itself. Starting in November 2023, you can now capture Spatial Video for the Apple Glasses headset using iPhone 15 Pro or iPhone 15 Pro Max with iOS 17.2, enabling content production directly from this device
An MV-HEVC sample stream (that can be tested on Vision Pro) can be found here:
https://developer.apple.com/streaming/examples/
Learn more in the dedicated WWDC session, with also the new REQ-VIDEO-LAYOUT HLS tag to handle 3d stereoscopic videos
The MV-HEVC approach to 3D video involves encoding two slightly different views of the same scene (left and right) into a single video frame. This process involves a technique called "2D Plus Delta," where the differences (or delta) between the left and right images are determined and encoded. This allows 2D decoders to use the base 2D view (usually the left eye view), while 3D decoders can calculate and present both views to the corresponding eyes.
This multiview approach offers efficiency benefits, as it exploits the high degree of similarity between the different views of a scene, reducing the amount of data required to represent the additional views.
Which camcorder is capable of supporting MV-HEVC or 2D Plus Delta? Currently, there are no other camcorders compatible with MV-HEVC, apart from the Apple Vision Pro itself. Starting in November 2023, you can now capture Spatial Video for the Apple Glasses headset using iPhone 15 Pro or iPhone 15 Pro Max with iOS 17.2, enabling content production directly from this device
An MV-HEVC sample stream (that can be tested on Vision Pro) can be found here:
https://developer.apple.com/streaming/examples/
Learn more in the dedicated WWDC session, with also the new REQ-VIDEO-LAYOUT HLS tag to handle 3d stereoscopic videos
Video streaming definitions
From the blog
How to Shoot Spatial Videos for Apple Vision Pro?IPhone 15 Pro's AV1 Decoding: A Streaming Revolution
HEVC: The Promise of a Future That Never Came
