Higher Frame Rates

Description

Higher Frame Rates (HFR) in 3GPP standards define the capability to encode, transmit, and render video content at elevated frame rates, typically 60 frames per second (fps) or higher, compared to traditional rates of 24-30 fps. Technically, HFR involves modifications across the media delivery chain: content creation with high-speed cameras, efficient video coding, robust network transport, and capable display devices. 3GPP specifications, particularly in the context of Enhanced Mobile Broadband (eMBB) and media streaming, address codec support (e.g., in HEVC/H.265 and later VVC/H.266), container formats, and streaming protocols to accommodate HFR. The increased frame rate reduces motion blur and judder, resulting in a more lifelike and immersive viewing experience, especially for content with rapid movement.

From an architectural perspective, HFR impacts several network and device components. On the encoding side, codecs must efficiently compress the additional temporal information without excessive bitrate increase, often leveraging advanced motion prediction and compression tools. 3GPP defines profiles and levels within codec specifications that support HFR. For transport, streaming protocols like Dynamic Adaptive Streaming over HTTP (DASH) or HTTP Live Streaming (HLS) are extended to signal HFR capabilities and allow adaptive switching between different frame rate representations based on network conditions and device capabilities. The UE's media engine must decode and render the high frame rate video, requiring sufficient processing power and display refresh rate compatibility.

HFR's role in mobile networks is to enable premium media services that leverage the high bandwidth and low latency of 4G LTE and 5G NR. It is a key enabler for applications like ultra-high-definition live sports broadcasting, cloud gaming, and augmented/virtual reality, where fluid motion is critical for realism and user comfort. 3GPP's work ensures interoperability between content providers, network operators, and device manufacturers, facilitating widespread adoption. The specifications also consider trade-offs, such as the increased bitrate demands of HFR, and provide mechanisms for efficient delivery, including quality adaptation and network-aware streaming.

Purpose & Motivation

Higher Frame Rates were standardized to meet the growing consumer demand for superior video quality and more immersive media experiences on mobile devices. Traditional frame rates, while adequate for many types of content, exhibit noticeable motion blur and stuttering during fast-paced scenes, which degrades the viewing experience for sports, action movies, and interactive applications. HFR addresses these limitations by capturing and displaying more frames per second, resulting in smoother motion and greater temporal resolution.

The push for HFR in 3GPP was driven by the evolution of display technologies (e.g., 120Hz smartphone screens) and the increasing capabilities of mobile networks, particularly with 5G's enhanced mobile broadband. Prior to standardization, proprietary solutions and fragmentation hindered consistent delivery across different networks and devices. 3GPP's involvement, starting in Release 14, provided a unified framework for HFR within mobile streaming ecosystems, ensuring that high-frame-rate content can be efficiently encoded, dynamically adapted, and reliably delivered over varying network conditions. This solves the problem of delivering cinema-quality motion fluidity to handheld devices, unlocking new revenue streams for operators and content providers through premium service tiers.

Key Features

• Support for video frame rates of 60 fps, 100 fps, 120 fps, and beyond
• Integration with advanced video codecs like HEVC and VVC for efficient compression
• Signaling in adaptive streaming protocols (e.g., DASH, HLS) for HFR representations
• Enhanced motion portrayal with reduced blur and judder for fast-action content
• Compatibility with high-refresh-rate displays on mobile devices
• Network-aware adaptation to balance bitrate, latency, and quality for HFR streams

Evolution Across Releases

Defining Specifications