Mobile Metaverse Media

Description

Mobile Metaverse Media is a term introduced in 3GPP Release 19 to describe the types of media that are communicated or enabled using the 5G system within the context of the mobile metaverse. It encompasses a broad range of media formats, including traditional audio and video, extended reality (XR) media (which includes haptic media), and data from which media can be constructed, such as point clouds. This definition is intentionally broad to accommodate the diverse and evolving nature of immersive media. The term is defined in 3GPP specifications 22.156 and 22.856, which outline the service requirements and architecture for mobile metaverse services.

The inclusion of 'data from which media can be constructed' is significant because it acknowledges that some media are not directly rendered but are used as input to generate other media. For example, a point cloud is a set of data points in space that can be used to reconstruct a 3D object or environment. This data can be transmitted over the 5G system and then processed at the receiver to generate XR media. This flexibility allows for more efficient transmission and adaptation to network conditions. The 5G system must support the transport of these various media types with appropriate quality of service (QoS) and synchronization.

How it works: Mobile Metaverse Media is transported over the 5G system using various protocols and mechanisms. For real-time media, such as audio and video, the 5G system may use QoS flows to ensure timely delivery. For XR media, which may include multiple streams (e.g., video, depth, haptic), synchronization is crucial. The 5G system provides mechanisms for time synchronization and QoS management. Haptic media, which conveys touch sensations, requires extremely low latency and high reliability, often necessitating edge computing to minimize round-trip time. Point cloud data, which can be large, may be compressed and transmitted efficiently, possibly using edge computing for processing.

The 5G system's architecture supports Mobile Metaverse Media through the 5G core network (5GC) and the radio access network (NG-RAN). The 5GC manages session and QoS, while the NG-RAN provides the wireless link. The media may be hosted on a mobile metaverse server, which can be located at the edge or in the cloud. The 5G system ensures that the media is delivered with the required performance, leveraging features like network slicing to isolate traffic and edge computing to reduce latency. The 3GPP specifications define the requirements for these media types, including bandwidth, latency, and reliability.

Mobile Metaverse Media is fundamental to the mobile metaverse experience. Without the ability to transport these diverse media types efficiently and reliably, immersive applications would not be possible. The term's broad definition allows for future media types to be included as technology evolves. It also emphasizes that the 5G system is not just a pipe but an enabler of media processing and adaptation. For instance, the 5G system may support media adaptation based on network conditions, ensuring a consistent user experience.

In summary, Mobile Metaverse Media encompasses all media types that are communicated or enabled by the 5G system for mobile metaverse services. It includes audio, video, XR (including haptic) media, and constructible data like point clouds. The 5G system provides the necessary transport and QoS mechanisms to support these media, enabling immersive and interactive experiences.

Purpose & Motivation

Mobile Metaverse Media exists to define the scope of media types that the 5G system must support for mobile metaverse services. Prior to this definition, media types were often considered separately, leading to fragmented requirements. By grouping them under a single term, 3GPP can address common requirements and ensure that the 5G system is capable of handling the diverse media involved in immersive experiences. This is particularly important for haptic media and point clouds, which are not traditional media types and may have unique transport requirements.

The motivation for defining Mobile Metaverse Media is to provide clarity and consistency in specifications. It allows developers and operators to understand what media types are expected to be supported and to design their systems accordingly. It also facilitates interoperability by providing a common vocabulary. The inclusion of 'data from which media can be constructed' is forward-looking, acknowledging that future media may be generated from raw data rather than transmitted directly. This flexibility is essential for the evolving nature of the metaverse.

Historically, 3GPP has defined media types for specific services, such as IMS multimedia telephony and 5G media streaming. However, the mobile metaverse requires a more integrated approach. Mobile Metaverse Media builds on these earlier definitions but expands them to include XR and haptic media, as well as constructible data. It represents a maturation of 3GPP's media handling capabilities, aligning with the industry's move towards immersive experiences.