DeferredArtificial Intelligence (AI)/Machine Learning (ML) for NR air interface
R1-2503044
AI/ML beam prediction accuracy metric definition remains unresolved
In 5G and future 6G, AI/ML models in the phone (UE-side) can predict the best downlink transmit beams for the network. To check if these predictions are accurate, the network needs a performance monitoring method. One method, called 'UE-assisted performance monitoring' (Type 1, Option 2), has the phone calculate and report a prediction accuracy metric. The core debate is how to define this 'accuracy' metric.
A group of companies, including OPPO, Xiaomi, Spreadtrum, Huawei, ZTE, and Lenovo, proposed a definition (Proposal 1.1a). Under this proposal, a prediction is counted as correct if at least one of the Top M measured beams from a monitoring resource set is among the Top-K beams predicted by the AI model. The value of M (1, 2, 3, or 4) would be configured by the network.
Other companies, led by Qualcomm and Google, opposed this definition. They argued that accuracy should be based on a signal strength threshold (X dB) relative to the best measured beam, not just on ranking (Top M). Ericsson presented simulation data showing that in 20% of cases in an urban macro scenario, the 4th strongest beam could be more than 4 dB worse than the best beam, which a ranking-only metric would miss.
Huawei presented complementary data showing the gap between the best and the M-th best beam: for M=4, the gap is 4.94 dB at the 80th percentile. The meeting did not make a decision on the metric definition. The proposal was noted but not approved, meaning the discussion will continue at the next meeting.
The RAN1#120-bis meeting record records a partial agreement on this point: "At least one of the Top M beam(s) of the resource set(s) for monitoring is among Top-K predicted beam(s) of Set A (e.g., linked to at least one of the Top-K predicted beam(s) of Set A based on certain rule or signalling)"
| Accuracy defined by Top M ranking (M configured by network) | Accuracy should include an RSRP threshold (X dB) for performance guarantee |
|---|
| OPPO · Xiaomi · Spreadtrum · Huawei · ZTE · Lenovo · CMCC · Fujitsu · NEC · ETRI · LG · Sharp · vivo · TCL · Fraunhofer · HONOR · Futurewei17 companies | Qualcomm · Google · Ericsson3 companies |
Why it matters
The lack of agreement delays the finalization of a key performance indicator for AI-based beam management. This leaves the exact mechanism for phones to self-report their prediction accuracy undefined, which could impact how operators validate and trust AI-driven beamforming in their networks.