Physically-Based Rendering

Description

Physically-Based Rendering (PBR) within the 3GPP context refers to a set of advanced computer graphics techniques standardized to support high-quality, immersive Extended Reality (XR) services over mobile networks. Unlike traditional rendering methods that use approximations and artistic adjustments, PBR algorithms simulate the physical properties of materials and the real-world interaction of light with those surfaces. This involves complex calculations for light reflection, refraction, absorption, and scattering based on bidirectional reflectance distribution functions (BRDFs) and other physical models. The goal is to produce visuals that are consistent under various lighting conditions, thereby achieving a high degree of photorealism essential for convincing AR and VR environments.

In the architecture of an XR service delivery system, PBR processing can be distributed between the user equipment (UE), such as an XR headset, and edge or cloud servers. The 3GPP specifications, particularly in TS 26.928 and TS 26.998, study the implications of such rendering on the network. The rendering engine, whether local or remote, uses PBR shaders and texture maps (albedo, normal, roughness, metallic) to compute the final pixel color for each frame. This computation is computationally intensive and directly influences the bitrate, latency, and frame rate requirements for the media stream transmitted over the 5G system.

The role of PBR in the network is multifaceted. It defines a key characteristic of the traffic generated by next-generation XR applications. Network functions, including the 5G Core (5GC) and the Radio Access Network (RAN), must be aware of the stringent QoS demands of PBR-rendered content, such as ultra-low latency for interactive feedback and high bandwidth for detailed texture streaming. 3GPP studies model this traffic to design appropriate network slicing, edge computing (MEC) offloading strategies, and radio resource management policies that can efficiently deliver such demanding services while maintaining user Quality of Experience (QoE).

Purpose & Motivation

The standardization of Physically-Based Rendering techniques in 3GPP was motivated by the rise of immersive Extended Reality services as a key use case for 5G and beyond networks. Previous mobile graphics and streaming services, like traditional video, relied on simpler rendering models that did not require the same level of physical accuracy or interactivity. These older approaches were insufficient for creating believable virtual worlds where visual consistency and realism are paramount for user immersion and comfort, especially in professional training, social interaction, and entertainment applications.

PBR addresses the problem of visual inconsistency found in older, ad-hoc rendering methods. By basing calculations on physical laws, it ensures that materials look correct under any lighting environment, which is critical for AR applications that blend digital objects with the real world. From a network perspective, understanding PBR is essential because it creates a new class of traffic with predictable but demanding patterns. The 3GPP's work on PBR, starting in Release 15 with studies on XR, aims to characterize this traffic to solve network planning and optimization challenges. It helps define the necessary QoS parameters, such as packet delay budget and guaranteed bit rate, to support real-time, interactive, high-fidelity graphics streaming, which was not a primary concern for pre-5G multimedia services.

Key Features

• Simulates real-world light interaction using physical models like BRDFs and energy conservation
• Utilizes material property maps (albedo, roughness, metallic, normal) for accurate surface representation
• Ensures visual consistency of objects across different lighting environments
• Generates computationally intensive workloads impacting UE and network edge processing
• Defines stringent traffic models for network QoS planning in XR applications
• Enables high-fidelity, photorealistic graphics for immersive AR/VR experiences

Evolution Across Releases

Defining Specifications