LTE Network Performance KPIs

&

Validation

Volker Hoehn, VF-TSO– Access-Design

1 Confidentiality level: C2
27 August 2014
LTE Network Performance KPIs
Understand
KPIs LTE Network
- Network KPIs and their structure

LTE Accessability Understand

KPIs - Estimation of LTE Accessability KPIs

LTE Retainability Understand

KPIs - Estimation of LTE Retainability KPIs

Understand
LTE Integrity KPIs
- Estimation of LTE Integrity KPIs

LTE Mobiliy & Understand

eNodeB/ Network - Estimation of LTE Mobility/eNode B, Cell &
Performance KPIs Network Performance KPIs

2 Confidentiality level: C2
27 August 2014
 KPIs KPIs LTE Network
LTE Network

Retainability Performance
Accessability Integrity, Mobility
eNodeB, Network

End to end service

Packet loss rate eNode B, cell
(Voice, Data) E-RAB dropped
correlates with
establishment rate call rate availability
E2E-KPI "Frame
(LTE only)
Error Rate"
Network
End to End service Averaged availability
(Voice, Data) throughput
LTE Service
establishment rate per LTE cell
Normal
-CSFB: redirection to (cell capacity)
Release rate
3G and 2G are
triggered for voice Averaged
call attempts) Throughput
per used LTE
Minutes between Resource Block
RRC setup
drops in RRC
success rate
connected state PESQ- LQ
(Perceptual
E-RAB establishment Evaluation
success rate of Speech
Quality –
Listening
LTE Service request Quality)
failure rate
Handover
3 Confidentiality level: C2 success rate
27 August 2014
Measured by counters in the eNode B – vendor specific

4 Confidentiality level: C2
27 August 2014
 KPIs KPIs LTE Network
LTE Network Targets

Accessability Retainability

End to end service

(Voice, Data)
establishment rate > 99% E-RAB dropped
<1%
call rate
(LTE only)

End to End service

(Voice, Data)
establishment rate > 99% LTE Service
-CSFB: redirection to Normal > 98%
3G and 2G are Release rate
triggered for voice
call attempts)

RRC setup Minutes between

success rate > 99,5% drops in RRC ≥ 300min
connected state

E-RAB establishment
success rate > 99,5%

LTE Service request

failure rate < 0,3%

5 Confidentiality level: C2
27 August 2014
 KPIs KPIs LTE Network
LTE Network Targets

Integrity, Mobility Performance

eNodeB, Network

Packet loss rate

≤1% eNode B, cell
correlates with
availability 99,99%
E2E-KPI "Frame
Error Rate"
Network
Averaged 99,95%
availability
throughput
per LTE cell See table!
(cell capacity) DL Throughput per RB vs SINR
800

Averaged 700
Throughput ≥ 0,5Mbps 600
per used LTE

Throughput(kbps)
Resource Block 500

400
PESQ- LQ
(Perceptual 300
Evaluation
See table! 200
of Speech
100
Quality –
Listening 0
Quality) -5.0 0.0 5.0 10.0 15.0 20.0 25.0 30.0
SINR

Handover
6 success rate > 98 %
Confidentiality level: C2
27 August 2014
 Cluster Analysis

Examples from the LTE800 VF-DE Network

7 Confidentiality level: C2
27 August 2014
 Ericsson B Cluster within Regional Branch “South West”

Thrp DL [kbit/s] Thrp UL [kbit/s] Avg User Drb [#] Avg User Ue [#]
35,000 7.0

30,000 6.0

25,000 5.0

20,000 4.0

15,000 3.0

10,000 2.0

5,000 1.0

0 0.0

ƒ PRB (Physical Resource Block) measures not available in current release L11A
ƒ Number of user calculation not based on TTI but on second samples on user sessions!
ƒ Note: Cell throughput take only used TTI time periods [1ms] into account!
8 Confidentiality level: C2
27 August 2014
 Ericsson B Cluster within Regional Branch “South West” / Daily Profiles
Average of P619dl_new Average of P619ul_new Average of Avg_UsersDrb Average of Avg_UsersUe
20,000 1

18,000 0.9

16,000 0.8

14,000 0.7

Number of Users [#]

Throughput [kbit/s]

12,000 0.6

10,000 0.5

8,000 0.4

6,000 0.3

4,000 0.2

2,000 0.1

0 0
00:00 01:00 02:00 03:00 04:00 05:00 06:00 07:00 08:00 09:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00 17:00 18:00 19:00 20:00 21:00 22:00 23:00

ƒ Throughput and User daily profile as an average across all 29 cluster cells

9 Confidentiality level: C2
27 August 2014
Example: Daily Profiles Æ Peak throughput and number of users across a cluster
Max of P619dl_new Max of P619ul_new Max of Avg_UsersDrb Max of Avg_UsersUe
70,000 25

60,000

20

50,000

Number of Users [#]

Throughput [kbit/s]

15
40,000

30,000
10

20,000

10,000

0 0
00:00 01:00 02:00 03:00 04:00 05:00 06:00 07:00 08:00 09:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00 17:00 18:00 19:00 20:00 21:00 22:00 23:00

ƒ Indicates that: E2E performance can be provided

ƒ Indicates that Transport capacity fits
ƒ Daily user profile indicate busy hours

10 Confidentiality level: C2
27 August 2014
Example: LTE User perceived throughput vs. LTE Utilisation

The lower perceived throughput

in case of low LTE utilisation
is caused by the User Service Profle!

Capacity

Issue!

11 Confidentiality level: C2
27 August 2014
 Traffic volume per hour/ number of data TTIs
LTE DL Throughput cdf VF-D2 Avg2 per week on different days (busy hour)
(two largest averaged figures across 8 days)

12 Confidentiality level: C2
27 August 2014
LTE DL Throughput VF-D2; all cells with Avg2 value

13 Confidentiality level: C2
27 August 2014
LTE UL Throughput cdf VF-D2

14 Confidentiality level: C2
27 August 2014
LTE UL Throughput VF-D2; all cells with Avg2 value

15 Confidentiality level: C2
27 August 2014
QoS in LTE: Standardized QCI characteristics
QCI Resourc Priority Packet Packet Example Services
e Type Delay Error
Budget Loss
(NOTE Rate
1) (NOTE 2
)
1 2 100 ms 10-2 Conversational Voice
(NOTE 3)
2 4 150 ms 10-3 Conversational Video (Live Streaming)
(NOTE 3) GBR
3 3 50 ms 10-3 Real Time Gaming
(NOTE 3)
4 5 300 ms 10-6 Non-Conversational Video (Buffered
(NOTE 3) Streaming)
5 1 100 ms 10-6 IMS Signalling
(NOTE 3)
6 Video (Buffered Streaming)
(NOTE 4) 6 300 ms 10-6 TCP-based (e.g., www, e-mail, chat, ftp,
p2p file sharing, progressive video, etc.)
7 Non- Voice,
(NOTE 3) GBR 7 100 ms 10-3 Video (Live Streaming)
Interactive Gaming
8
(NOTE 5) 8 Video (Buffered Streaming)
300 ms 10-6 TCP-based (e.g., www, e-mail, chat, ftp,
p2p file
9 9 sharing, progressive video, etc.)
(NOTE 6)

16 Confidentiality level: C2
27 August 2014
 NOTE 1: A delay of 20 ms for the delay between a PCRF and a radio base station should be
subtracted from a given PDB to derive the packet delay budget that applies to the radio interface.
This delay is the average between the case where the PCRF is located "close" to the radio base
station (roughly 10 ms) and the case where the PCRF is located "far" from the radio base station,
e.g. in case of roaming with home routed traffic (the one-way packet delay between Europe and
the US west coast is roughly 50 ms). The average takes into account that roaming is a less
typical scenario. It is expected that subtracting this average delay of 20 ms from a given PDB will
lead to desired end-to-end performance in most typical cases. Also, note that the PDB defines an
upper bound. Actual packet delays - in particular for GBR traffic - should typically be lower than
the PDB specified for a QCI as long as the UE has sufficient radio channel quality.
NOTE 2: The rate of non congestion related packet losses that may occur between a radio base
station and a PCRF should be regarded to be negligible. A PELR value specified for a
standardized QCI therefore applies completely to the radio interface between a UE and radio
base station.
NOTE 3: This QCI is typically associated with an operator controlled service, i.e., a service where the
SDF aggregate's uplink / downlink packet filters are known at the point in time when the SDF
aggregate is authorized. In case of E-UTRAN this is the point in time when a corresponding
dedicated EPS bearer is established / modified.
NOTE 4: If the network supports Multimedia Priority Services (MPS) then this QCI could be used for
the prioritization of non real-time data (i.e. most typically TCP-based services/applications) of
MPS subscribers.
NOTE 5: This QCI could be used for a dedicated "premium bearer" (e.g. associated with premium
content) for any subscriber / subscriber group. Also in this case, the SDF aggregate's uplink /
downlink packet filters are known at the point in time when the SDF aggregate is authorized.
Alternatively, this QCI could be used for the default bearer of a UE/PDN for "premium
subscribers".
NOTE 6: This QCI is typically used for the default bearer of a UE/PDN for non privileged subscribers.
Note that AMBR can be used as a "tool" to provide subscriber differentiation between subscriber
groups connected to the same PDN with the same QCI on the default bearer.

17 Confidentiality level: C2
27 August 2014
 KPIs/PIs in use!

18 Confidentiality level: C2
27 August 2014
ANNEX

19 Confidentiality level: C2
27 August 2014
 LTE Accessability KPIs
Details:
KPI Object to Meausure Way to Grade of
measure Service
LTE Accessibility KPIs

End to End Measure the ratio of successfully Counters

service (Voice, established service E-RAB divided by >99%
Data) total attempts to establish the EPS
establishment bearer in the signalling phase (default
rate +dedicated)
LTE only
End to End [Calculate this by multiply the RRC Counters >99%
service (Voice, setup success rate by the E-RAB
Data) establishment success rate
establishment
rate
-CSFB:
redirection to 3G
and 2G are
triggered for voice
call attempts)
RRC setup Measure the ratio of successfully Counters >99.5%
success rate established RRCs divided by the RRC
establishment attempts
E-RAB Measure the ratio of successfully Counters >99,5%
establishment established E-RABs divided by the E-
success rate RAB establishment attempts
LTE Service Ratio of failed EPS establishments Counters < 0.3 %
Request Failure related to all EPS
Rate establishments.(default bearer)

20 Confidentiality level: C2
27 August 2014
 Details: LTE Retainability KPIs

KPI Object to Meausure Way to Grade of

measure Service
LTE Retainability KPIs

E- RAB dropped Ratio of dropped calls to the total Counters < 1%

call rate established calls

LTE Service Ratio between the number of normal Counters > 98 %

Normal Release EPS Bearer release and the number
Rate of all established service sessions
(Normal Release and Detach)]

Minutes between Counters ≥ 300 minutes

Divide the sum of the minutes all calls
drops in RRC
are in RRC connected state by the
connected state
number of drops..

21 Confidentiality level: C2
27 August 2014
 KPI Object to Meausure Way to Grade of
measure Service
LTE Integrity KPIs
LTE Integrity KPIs
Packet loss rate Number of transmitted packets – ≤ 1%
(PLR) number of received packets/ number of Counters
transmitted packets * 100 [%] at
MAC layer
The cell capacity for a given system Counters BW; 2x
Averaged 5MHz:
bandwidth can then be calculated by
throughput per ≥ 8 Mbps
multiplying the number of resource
LTE cell (cell
block that can be used for user traffic
capacity) BW:
(i.e. total resource blocks – resource
blocks used for signalling) times the 2x10MHz
“Average throughput per used resource ≥ 16 Mbps
block”.
BW;
2x15MHz:
≥ 24 Mbps

BW:
2x20MHz:
≥ 30Mbps

Averaged The traffic volume of a cell divided by Counters ≥ 0.5 Mbps

Throughput per the number of resource blocks that have
used LTE been actually used in the monitoring
Resource Block period.
By doing so the average capacity per
resource block can be calculated.

PESQ- LQ Measures the PESQ voice quality on a 95 % of all Minimum

(Perceptual predefined route in a defined area on a measurement criteria:
Evaluation of regular basis values have to Voice
Speech Quality – fulfill the quality
Listening Quality) average >3.8 MOS;
criteria, 99.5% Average
of the criteria:
measurements Voice
have to fulfill measureme
the Minimum nts have to
criteria fulfill
> 4 MOS

22 Confidentiality level: C2
27 August 2014
 Details: LTE Mobiliy KPIs

KPI Object to Meausure Way to Grade of

measure Service
LTE Mobility KPIs

LTE Intra-. Measure the successful execute Counters > 98%

Frequency handover attempts to the total number
Handover (HO) of HO attempts
success rate
LTE Inter-. Measure the successful execute Counters > 98%
Frequency handover attempts to the total number
Handover (HO) of HO attempts
success rate
Inter.-RAT Measure the successful execute Counters > 98%
Handover (HO) handover attempts to the total number
success rate of HO attempts

23 Confidentiality level: C2
27 August 2014
 LTE eNodeB/ Network
Details: Performance KPIs

KPI Object to Meausure Way to Grade of

measure Service
eNode B Performance KPIs

eNodeB Percentage of time the eNodeB is Counters 99.99%

availability available
Availability = (1 – (total downtime per
month/total time in month)) x 100%

Overall Network Performance

Network This provides a measure of the Counters 99.95%

availability proportion of time that the network is
available to its
Subscribers.
It is the sum up of the minutes of normal
operation of all eNode Bs divided by the
number of eNode Bs multiplied with the
minutes in the monitoring period.

24 Confidentiality level: C2
27 August 2014
25 Confidentiality level: C2
27 August 2014