Kpi Reference PDF
Kpi Reference PDF
Kpi Reference PDF
V100R005C00
KPI Reference
Issue Draft A
Date 2012-06-29
and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd.
All other trademarks and trade names mentioned in this document are the property of their respective
holders.
Notice
The purchased products, services and features are stipulated by the contract made between Huawei and
the customer. All or part of the products, services and features described in this document may not be
within the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements,
information, and recommendations in this document are provided "AS IS" without warranties, guarantees or
representations of any kind, either express or implied.
The information in this document is subject to change without notice. Every effort has been made in the
preparation of this document to ensure accuracy of the contents, but all statements, information, and
recommendations in this document do not constitute a warranty of any kind, express or implied.
Intended Audience
This document is intended for:
Network planners
Network administrators
Network operators
Change History
Draft A (2012-06-29)
This is the draft release.
Contents
5 Mobility KPIs..............................................................................................................................5-1
5.1 Intra-frequency Handover Out Success Rate ................................................................................................ 5-1
5.1.1 Description ........................................................................................................................................... 5-1
5.1.2 Definition ............................................................................................................................................. 5-3
5.2 Inter-frequency Handover Out Success Rate................................................................................................. 5-3
10 References................................................................................................................................10-1
11 Counter List .............................................................................................................................11-1
Figures
Figure 3-1 Measurement point for RRC connection setup ................................................................................. 3-2
Figure 3-2 Measurement point for MME-initiated ERAB setup ........................................................................ 3-4
Figure 3-3 Measurement point for UE-triggered ERAB setup ........................................................................... 3-4
Figure 4-1 Abnormal ERAB release................................................................................................................... 4-2
Figure 5-1 Scenario for Intra-frequency Intra-eNB HO ..................................................................................... 5-2
Figure 5-2 Scenario A for intra-frequency inter-eNodeB HO ............................................................................ 5-2
Tables
Table 5-6 Inter-RAT handover out success rate (LTE to GSM) ........................................................................ 5-10
Table 6-1 Service DL average throughput .......................................................................................................... 6-2
Table 6-2 Service UL average throughput .......................................................................................................... 6-3
Table 6-3 Cell DL average throughput ............................................................................................................... 6-4
Table 6-4 Cell UL average throughput ............................................................................................................... 6-4
Table 6-5 Cell DL maximum throughput ............................................................................................................ 6-5
Table 6-6 Cell UL maximum throughput ............................................................................................................ 6-6
Table 7-1 RB utilizing rate ................................................................................................................................. 7-2
Table 7-2 Average CPU load .............................................................................................................................. 7-2
Table 8-1 Radio network unavailability rate ....................................................................................................... 8-1
Table 9-1 Radio bearers ...................................................................................................................................... 9-2
Table 9-2 DL traffic volume ............................................................................................................................... 9-3
1 Overview
With the initial target of downlink peak data rate reaching above 100 Mbit/s, the
next-generation Long Term Evolution (LTE) system is developed to meet the increasing
demands on higher data rate due to fast expansion of multimedia applications. For a new
wireless system like the LTE, a set of Key Performance Indicators (KPIs) are defined for the
evaluation of system performance, in particular the performance of the evolved Radio Access
Network (eRAN). The comparison between the LTE and the legacy systems such as UMTS or
CDMA2000 system is also specified in this document.
This document specifies a set of eRAN KPIs to evaluate the performance of the LTE system.
Some counters necessary for the KPI calculation are also described in details. Given that the
LTE is a new system, the KPIs in this document are drafted ones and subject to change. KPIs
should be updated according to the experiences of commercial network management and
radio network optimization.
The KPIs in this document are classified into categories based on the measurement targets:
accessibility, retainability, mobility, service integrity, utilization, availability, and traffic KPIs.
This document is organized as follows: firstly we briefly describe the KPI specification
template. Then detailed specifications of each KPI are described in terms of the
aforementioned seven categories. Finally we provide definitions of relevant counters in
Chapter 11 Counter List.
According to the template, the KPI is defined in terms of the following items. Each KPI has
several sub-clauses.
KPI name (clause header)
It is a descriptive name of the KPI.
Descriptions
It provides a brief overview of the KPI.
Measurement scope
It specifies the KPI monitoring scope. In general, the measurement is made in terms of
cells. The KPI value reflects the performance in a cell or a cluster. The associated
counters can be obtained from cell statistics. In this document, cluster indicates a group
of cells selected by user.
Formula
It is used to calculate the KPI. Generally the formula consists of several counters that are
specified in other sub-clauses.
Associated counters
It contains counters used in the formula. Chapter 11 Counter List provides the counter
descriptions.
3 Accessibility KPIs
Accessibility KPIs are used to measure the probability whether services requested by a user
can be accessed within specified tolerances in the given operating conditions. The service
provided by the E-UTRAN is defined as EPS/ERABs. Radio Resource Control (RRC)
connection and System Architecture Evolution (ERAB) setup are the main procedures for
accessibility KPIs. The accessibility KPIs can be calculated per cell or cluster. The KPIs at the
cluster level are calculated by aggregating all cell counters of the same cluster.
3.1.2 Definition
The RRC setup success rate (service) KPI is defined in Table 3-1. Note that the number of
RRC connection setup attempts (service) and the successful RRC connection setup times
(service) is collected based on the descriptions in Section 3.1.1 .
3.2.2 Definition
The RRC setup success rate (signaling) KPI is defined in Table 3-2. Note that the RRC
connection setup attempts (signaling) and the successful RRC connection setup counters
(signaling) are collected based on the descriptions in Section 3.2.1 .
3.3.2 Definition
The ERAB setup success rate (VoIP) KPI is defined in Table 3-3. Note that the ERAB setup
attempts (VoIP) and the successful ERAB setup counters (VoIP) are collected based on the
descriptions in Section 3.3.1 .
3.4.2 Definition
The ERAB setup success rate (All) KPI is defined in Table 3-4. The ERAB setup attempts
(All) and the successful ERAB setup counters (All) are collected based on the descriptions in
Section 3.4.1 .
3.5.2 Definition
The call setup success rate KPI is defined in Table 3-5. The KPI is calculated base on
multiplying the KPI of RRC Setup Success Rate (Service) and the KPI of ERAB Setup
Success Rate (All). For these two KPIs, can refer to section 3.1 and section 3.4 .
4 Retainability KPIs
Retainability KPIs are used to evaluate the network capability to retain services requested by
a user for a desired duration once the user is connected to the services. These counters can be
calculated per cell or per cluster. The KPIs at the cluster level can be calculated by
aggregating all the cell counters. Retainability KPIs are important in evaluating whether the
system can maintain the service quality at certain level.
As shown in Figure 4-1, the abnormal ERAB release counter is incremented when the
eNodeB sends an E-RAB Release Indication to the MME or receives an UE Context Release
Command message from the MME and the release causes are not Normal Release, User
Inactivity, Partial Handover, or Handover triggered. If the message contains several ERAB ID
IEs (in the ERAB to Be Release List IE), the counter will be incremented for each individual
ERAB.
For the eNodeB-initiated abnormal ERAB release, the eNodeB knows whether it is a normal
or abnormal ERAB release.
4.1.2 Definition
The call drop rate (VoIP) is defined in Table 4-1.
4.2.2 Definition
Service drop rate (All) is defined in Table 4-2.
5 Mobility KPIs
Mobility KPIs are used to evaluate the performance of E-UTRAN mobility, which is critical
to the customer experience. Several categories of mobility KPIs are defined based on the
following handover types: intra-frequency, inter-frequency, and inter-Radio Access
Technology (RAT).
Two scenarios are available for the inter-eNodeB HO, as shown Figure 5-2 and Figure 5-3.
The HO attempts are collected at point B. When the Source-eNodeB (S-eNodeB) sends an
RRCConnectionReconfiguration message to the UE, it decides to perform an inter-eNodeB
HO. In this KPI, the source and target cells of the handover are at the same frequency. The
number of inter-eNodeB intra-frequency HO attempts is measured at the source cell.
The number of inter-eNodeB intra frequency success HOs is collected at point C as shown in
Figure 5-2 and Figure 5-3. During a handover with the source and target cells at the same
frequency, the number of successful inter-eNodeB intra-frequency HOs is measured in the
source cell when the S-eNodeB receives a UE Context Release message from the
Target-eNodeB (T-eNodeB) or a UE Context Release Command message from the MME,
indicating that the UE access to the T-eNodeB is successful.
5.1.2 Definition
The intra-frequency handover out success rate is defined in Table 5-1. Note that the HO
attempts and the successful HO counters are collected based on the descriptions in Section
5.1.1 .
Formula IntraFreqHOOutSucces s
IntraFreqHOOut _ SR 100%
IntraFreqHOOutAttemp t
5.2.1 Description
This KPI can be used to evaluate the inter-frequency handover out success rate in a cell or a
cluster. Note that the measurement points for the associated counters are the same as those for
the intra-frequency HO scenario described in 5.1.1 . The target LTE cell operates at the
frequency different from that of the source LTE cell, which is the only difference.
As shown in Figure 5-1, if the source and target cells at different frequencies are controlled by
the same eNodeB, the eNodeB counts the number of intra-eNodeB inter-frequency HO
attempts at point B and the successful intra-eNodeB inter-frequency HOs at point C in the
source cell. As shown in Figure 5-2, if the handover source and target cells are at different
frequencies, the eNodeB counts the number of inter-eNodeB inter-frequency HO attempts at
point B and the successful intra-eNodeB inter-frequency HOs at point C in the source cell.
5.2.2 Definition
The inter-frequency handover out success rate is defined in Table 5-2. Note that the HO
attempts and the successful HO counters are collected based on the descriptions in Section
5.2.1 .
Formula InterFreqHOOutSucces s
InterFreqHOOut _ SR 100%
InterFreqHOOutAttemp t
Two scenarios are available for the inter-eNodeB HO, as shown in Figure 5-5 and Figure 5-6.
The HO attempts are collected at point B in the target cell when the T-eNodeB sends a
Handover Request Acknowledge message to the S-eNodeB or the MME. The number of
successful inter-eNodeB HOs is measured in the target cell at point C when the T-eNodeB
receives an RRCConnectionReconfigurationComplete message from the UE.
5.3.2 Definition
The Handover in success rate is defined in Table 5-3. Note that the HO attempts and the
successful HO counters are collected based on the descriptions in Section 5.3.1 .
Formula HOInSucces s
HOIn _ SR 100%
HOInAttemp t
counters (number of inter-RAT HO from LTE to CDMA attempts and number of successful
inter-RAT HOs) are collected.
As shown in Figure 5-7, the measurement for inter-RAT HO from LTE to CDMA attempt is
collected at point B where the eNodeB sends a MobilityFromEUTRACommand message to
the UE and decides to perform a handover to the CDMA system. The measurement of
successful inter-RAT HO (from LTE to CDMA) is performed at point C where the UE sends a
UE Context Release Command message to the eNodeB through the MME after accessing the
CDMA system.
5.4.2 Definition
The inter-RAT handover out success rate (from LTE to CDMA) is defined in Table 5-4. Note
that the inter-RAT HO attempts (from LTE to CDMA) and the successful inter-RAT HO (from
LTE to CDMA) counters are collected based on the descriptions in Section 5.4.1 .
5.5.2 Definition
The inter-RAT Handover out success rate (LTE to WCDMA) is defined in Table 5-5. Note
that the inter-RAT HO attempts (from LTE to WCDMA) and the successful inter-RAT HO
(from LTE to WCDMA) counters are collected based on the descriptions in Section 5.5.1 .
(number of inter-RAT HO (from LTE to GSM) attempts and number of successful inter-RAT
HOs) are collected.
As shown in Figure 5-8, the measurement for inter-RAT HO (LTE to GSM) attempt is
collected at point B where the eNodeB sends a MobilityFromEUTRACommand message to
the UE and decides to perform the handover to the GSM system. The measurement of
successful inter-RAT HO (from LTE to GSM) is performed at point C where the UE sends a
UE Context Release Command message to the eNodeB through the MME after accessing the
GSM system.
5.6.2 Definition
The inter-RAT Handover out success rate KPI (LTE to GSM) is defined in Table 5-6. Note
that the inter-RAT HO attempts (from LTE to GSM) and the successful inter-RAT HO (LTE to
GSM) counters are collected based on the descriptions in Section 5.6.1 .
The service integrity KPIs indicate the E-UTRAN impacts on the service quality provided to
the end-user. The service integrity KPIs can be calculated per cell or per cluster. The KPIs at
the cluster level can be calculated by aggregating all the cell counters.
6.1.2 Definition
The service downlink average throughput is defined in Table 6-1 and can refer to Reference
[6] . There are nine different sub-KPIs for each QCI. The formulas for each KPI are mapped
to corresponding counters.
Unit kbit/s
6.2.2 Definition
The service uplink average throughput is defined in Table 6-2. There are nine sub-KPIs for
each QCI. The formula for each KPI is mapped to its corresponding counter.
Unit kbit/s
6.3.2 Definition
The cell downlink average throughput is defined in Table 6-3, and is calculated based on all of
the data which are transferred at downlink and the time used to transfer. The formula is
mapped to corresponding counters.
Unit kbit/s
6.4.2 Definition
The cell uplink average throughput is defined in Table 6-4, and is calculated based n all of the
data which are transferred at uplink and the time used to transfer. The formula is mapped to
corresponding counters.
Formula CellULTrafficVolume
CellULAveT hp
CellULTransferTime
Unit kbit/s
6.5.2 Definition
The cell downlink maximum throughput is defined in Table 6-5, and is calculated based on
maximum value of traffic volume which are transferred at each second. The formula is
mapped to corresponding counters.
Formula CellDLMaxTrafficVolumeforEach1s(bit )
CellDLMaxThp
1000(ms)
Unit kbit/s
6.6.2 Definition
The cell uplink maximum throughput is defined in Table 6-6, and is calculated based on
maximum value of traffic volume which are transferred at each second. The formula is
mapped to corresponding counters.
Unit kbit/s
7 Utilization KPIs
Utilization KPIs are used to evaluate the capability to meet the traffic demand and other
characteristics in specific internal conditions.
7.1.2 Definition
The UL and DL RB utilizing rate KPIs are defined in Table 7-1. These two KPIs are
calculated by dividing the total number of used RBs by the number of available RBs.
Formula RB _ Used DL
RB _ URDL 100%
RB _ Available DL
RB _ UsedUL
RB _ URUL 100%
RB _ Available UL
NOTE
The RB_AvailableDL and RB_AvailableUL are fixed values, which can be
calculated through the system bandwidth.
7.2.2 Definition
The average CPU load is defined in Table 7-2. The CPU load is calculated by averaging the
CPU usage ratio in the measurement period.
Measurement CPU
Scope
Formula MeanCPUUtility
8 Availability KPIs
Availability is the percentage of time that a cell is available. A cell is available when the
eNodeB can provide EPS bearer services. Availability can be measured at the cell level for a
variety of hardware/software faults.
8.1.2 Definition
The radio network unavailability rate is defined in Table 8-1. This KPI is calculated based on
the time of all cell service unavailability on the radio network (cluster).
Formula CellUnavailTime
RAN _ Unavail _ Rate Cluster
100%
TheTotalNu mberOfCellsInCluster *{SP} * 60
NOTE
The "SP" indicates the report period of counters in minute.
9 Traffic KPIs
Traffic KPIs are used to measure the traffic volume on the LTE Radio Access Network (RAN).
Based on traffic types, the traffic KPIs are classified into the following categories: radio
bearers, downlink traffic volume, and uplink traffic volume.
9.1.2 Definition
The radio bearer KPIs are defined in Table 9-1, including ten different sub-KPIs. The
formulas for each KPI are mapped to corresponding counters.
Formula RadioBearers
RadioBearers _ QCI _ 1
RadioBearers _ QCI _ 2
RadioBearers _ QCI _ 3
RadioBearers _ QCI _ 4
RadioBearers _ QCI _ 5
RadioBearers _ QCI _ 6
RadioBearers _ QCI _ 7
RadioBearers _ QCI _ 8
RadioBearers _ QCI _ 9
9.2.2 Definition
The downlink traffic volume KPIs are defined in Table 9-2, including ten sub-KPIs . The
formulas for each KPI are mapped to corresponding counters.
Formula DLTrafficVolume
DLTrafficVolume_ QCI _ 1
DLTrafficVolume_ QCI _ 2
DLTrafficVolume_ QCI _ 3
DLTrafficVolume_ QCI _ 4
DLTrafficVolume_ QCI _ 5
DLTrafficVolume_ QCI _ 6
DLTrafficVolume_ QCI _ 7
DLTrafficVolume_ QCI _ 8
DLTrafficVolume_ QCI _ 9
Associated See Chapter 11 Counter List.
Counters
Unit Bit
9.3.2 Definition
The uplink traffic volume KPIs are defined in Table 9-3, including ten sub-KPIs. The
formulas for each KPI are mapped to corresponding counters.
Formula ULTrafficVolume
ULTrafficVolume_ QCI _ 1
ULTrafficVolume_ QCI _ 2
ULTrafficVolume_ QCI _ 3
ULTrafficVolume_ QCI _ 4
ULTrafficVolume_ QCI _ 5
ULTrafficVolume_ QCI _ 6
ULTrafficVolume_ QCI _ 7
ULTrafficVolume_ QCI _ 8
ULTrafficVolume_ QCI _ 9
Associated See Chapter 11 Counter List.
Counters
Unit Bit
9.4.2 Definition
The average user number is defined in Table 9-4. The formula is mapped to corresponding
counters.
Formula AveUserNumber
Associated See Chapter 11 Counter List.
Counters
9.5.2 Definition
The maximum user number is defined in Table 9-5Table 9-4. The formula is mapped to
corresponding counters.
Formula MaxUserNumber
Associated See Chapter 11 Counter List.
Counters
10 References
[1] 3rd Generation Partnership Project (3GPP), "Evolved Universal Terrestrial Radio Access
(E-UTRA), Radio Resource Control (RRC); Protocol Specification, (Release 8)", TS36.331
v8.3.0, September 2008.
[2] 3rd Generation Partnership Project (3GPP), "Evolved Universal Terrestrial Radio Access
(E-UTRA) and Evolved Universal Terrestrial Radio Access Network (E-UTRAN); Overall
description; Stage 2 (Release 8)", TS36.300 v8.6.0, September 2008.
[3] 3rd Generation Partnership Project (3GPP), "Evolved Universal Terrestrial Radio Access
(E-UTRA) and Evolved Universal Terrestrial Radio Access Network (E-UTRAN); S1
Application Protocol (S1AP) (Release 8)", TS36.413 v8.3.0, September 2008.
[4] 3rd Generation Partnership Project (3GPP), "Technical Specification Group Services and
System Aspects; General Packet Radio Service (GPRS) enhancements for Evolved Universal
Terrestrial Radio Access Network (E-UTRAN) access (Release 8)", TS23.401 v8.4.0,
December 2008.
[5] 3rd Generation Partnership Project (3GPP), "Technical Specification Group Services and
System Aspects: Policy and charging control architecture (Release 8)", TS23.203 v8.3.1,
September 2008.
[6] eNodeB Performance Counter Reference.
11 Counter List
Table 11-1 provides a counter list including all counters relevant to the KPI calculation. In
each KPI specification, one or several parameters are used to calculate the KPI as shown in
the KPI formula. Each parameter is mapped to a counter. For details on each counter, see the
Reference [6].
Note that only QCI 1 is for VoIP service (conversational voice). According to Table6.1.7 in
Reference [5], QCI 7 can also be assigned to non-conversational voice. In this document, QCI
7 is not considered as the VoIP service in the KPI calculation.
VoIPERABRelease L.E-RAB.AbnormRel.QCI.1 +
L.E-RAB.NormRel.QCI.1
Service Drop Rate ERABAbnromalRele L.E-RAB.AbnormRel
(ALL) ase
ERABRelease L.E-RAB.AbnormRel +
L.E-RAB.NormRel
Intra-frequency IntraFreqHOOutAtte L.HHO.IntraeNB.IntraFreq.ExecAttOut
Handover Out Success mpt +
Rate L.HHO.IntereNB.IntraFreq.ExecAttOut
IntraFreqHOOutSucc L.HHO.IntraeNB.IntraFreq.ExecSuccO
ess ut +
L.HHO.IntereNB.IntraFreq.ExecSuccO
ut
Inter-frequency InterFreqHOOutAtte L.HHO.IntraeNB.InterFreq.ExecAttOut
Handover Out Success mpt +
Rate L.HHO.IntereNB.InterFreq.ExecAttOut
InterFreqHOOutSucc L.HHO.IntraeNB.InterFreq.ExecSuccO
ess ut +
L.HHO.IntereNB.InterFreq.ExecSuccO
ut
Handover In Success HOInAttempt L.HHO.IntraeNB.ExecAttIn +
Rate L.HHO.IntereNB.ExecAttIn
HOInSuccess L.HHO.IntraeNB.ExecSuccIn +
L.HHO.IntereNB.ExecSuccIn
Inter-RAT Handover IRATHO_L2C_Atte L.IRATHO.E2C.ExecAttOut
Out Success Rate (LTE mpt
to CDMA)
IRATHO_L2C_Succ L.IRATHO.E2C.ExecSuccOut
ess
Inter-RAT Handover IRATHO_L2W_Atte L.IRATHO.E2W.ExecAttOut
Out Success Rate (LTE mpt
to WCDMA)
IRATHO_L2W_Suc L.IRATHO.E2W.ExecSuccOut
cess
Inter-RAT Handover IRATHO_L2G_Atte L.IRATHO.E2G.ExecAttOut
Out Success Rate (LTE mpt
to GSM)
IRATHO_L2G_Succ L.IRATHO.E2G.ExecSuccOut
ess
Service DL Average DLAverageThroughp L.Thrp.bits.DL.QCI.1 /
Throughput ut_QCI_n L.Thrp.Time.DL.QCI.1
L.Thrp.bits.DL.QCI.2 /
L.Thrp.Time.DL.QCI.2
L.Thrp.bits.DL.QCI.3 /
L.Thrp.Time.DL.QCI.3
L.Thrp.bits.DL.QCI.4 /
L.Thrp.Time.DL.QCI.4
L.Thrp.bits.DL.QCI.5 /
L.Thrp.Time.DL.QCI.5
L.Thrp.bits.DL.QCI.6 /
L.Thrp.Time.DL.QCI.6
L.Thrp.bits.DL.QCI.7 /
L.Thrp.Time.DL.QCI.7
L.Thrp.bits.DL.QCI.8 /
L.Thrp.Time.DL.QCI.8
L.Thrp.bits.DL.QCI.9 /
L.Thrp.Time.DL.QCI.9
Service UL Average ULAverageThroughp L.Thrp.bits.UL.QCI.1 /
Throughput ut_QCI_n L.Thrp.Time.UL.QCI.1
L.Thrp.bits.UL.QCI.2 /
L.Thrp.Time.UL.QCI.2
L.Thrp.bits.UL.QCI.3 /
L.Thrp.Time.UL.QCI.3
L.Thrp.bits.UL.QCI.4 /
L.Thrp.Time.UL.QCI.4
L.Thrp.bits.UL.QCI.5 /
L.Thrp.Time.UL.QCI.5
L.Thrp.bits.UL.QCI.6 /
L.Thrp.Time.UL.QCI.6
L.Thrp.bits.UL.QCI.7 /
L.Thrp.Time.UL.QCI.7
L.Thrp.bits.UL.QCI.8 /
L.Thrp.Time.UL.QCI.8
L.Thrp.bits.UL.QCI.9 /
L.Thrp.Time.UL.QCI.9
CellDLAveThp CellDLTrafficVolum L.Thrp.bits.DL
e
CellDLTransferTime L.Thrp.Time.Cell.DL * 1000