Field KPIs & Validation

Volker Hoehn,
Michael Lorenz,
VF-TSO-Access / Design Standard and Tools

1 LTE Field KPIs & Validation C2 - confidential

27 August 2014
Background

KPIs defined in
NGMN Trials

2 LTE Field KPIs & Validation C2 - confidential

27 August 2014
Example: Network

KPI name: Network Non-Accessibility

Definition:
The Network Non-Accessibility is the probability that the user cannot perform a successful selection and registration on the desired PLMN (manual selection mode,
automatic selection mode with a defined desired PLMN).

Measurement method:
The NNA is measured during service testing (e.g. web browsing, file transfer etc.) or by means of dedicated tests.

Calculation:
Proportion of unsuccessful selection and registration attempts to all selection and registration attempts.

Please refer to ETSI TS 102 250-2 v1.7.1 for information on the technical trigger points.

In case the radio conditions are degraded, the number of samples should be at least 40.

KPI target:
≤1%

3 LTE Field KPIs & Validation C2 - confidential

27 August 2014
Example: FTP Session Failure Ratio

KPI name : FTP Session Failure Ratio (Uplink and Downlink)

Definition:
The FTP Session Failure Ratio denotes the probability that a customer cannot successfully complete a FTP session, which includes establishing an IP connection to
the server and transferring content.

Measurement method:
A binary file is downloaded from or uploaded to a FTP server.

Calculation:
The FTP Session Failure Ratio is the proportion of uncompleted sessions and sessions that were started successfully.

Start trigger: TCP SYN.

Stop trigger (download): Reception of the last data packet containing content.
Stop trigger (upload): Reception of the final acknowledgement for the last data packet containing content sent.

In case the radio conditions are degraded, the number of samples should be at least 40.

KPI target:
≤2%

4 LTE Field KPIs & Validation C2 - confidential

27 August 2014
KPI Structure

LTE
Field KPIs

Network
End-to-End
Performance

5 LTE Field KPIs & Validation C2 - confidential

27 August 2014
LTE Field KPIs - Overview
End-to-End
• Network Non-Accessibility (NNA)
• Ping Round Trip Time
• Mean User Data Rate FTP (UL /
DL)
• FTP Session Failure Ratio
• HTTP Session Failure Ratio
• HTTP Session Time
• FTP Service Non-Accessibility
• Voice Service Non-Accessibility
• Voice Call Setup Time
• Voice Speech Quality (MOS)
• Voice Cut-Off Call Ratio (CoCr)
• Voice Call Success Ratio
6 LTE Field KPIs & Validation
27 August 2014
Network Performance
• Transition Time
• Packet Loss Ratio (UL / DL)
• Jitter (UL / DL)
• Handover Failure Ratio
• Handover Interruption Time on U-
Plane (UL / DL)
• Handover Interruption Time on
MAC Layer (UL / DL)
• Throughput Variation during HO
(UL / DL)
• VoIP Calls / cell / MHz
• EPS Bearer Activation Failure
Ratio
• EPS Bearer Activation Time
• Maximum Over the Air Pathloss
(OTA)
C2 - confidential
End-to-End KPIs and Target Values

Accessibility Integrity Retainability

Network Non- Ping Round Trip FTP Session <1 % (Stat.)

Accessibility <1% < 20 mec
(NNA)
Time Failure Ratio < 3% (Mob.)

LTE FDD 2x2 MIMO (DL), 1x2 (16QAM) (UL) in Mbps

FTP Service Mean User Average

DL

Average
UL

Voice Cut-Off
< 1.5 %
Bandwidth
Peak Cell Edge Peak Cell Edge

<2%
in MHz Unloaded/ Unloaded/

Data Rate FTP

100%loaded 100%loaded

Non- 5

10
30

60
10 / 8

20 / 15
1

1
10

20
4/3

10 / 8
0.5

0.5
Call Ratio
Accessibility (UL / DL) 20 120 40 / 30 1 40 20 / 16 0.5

(CoCr)

Voice Service HTTP Session < 6 sec

Non- < 1.5 % Time
Accessibility

Voice Call
PESQ, Perceptual Evaluation
< 6 sec
Setup Time of Speech Quality

POLQA:Perceptual Objective
Voice Speech Listening
Quality (MOS) >4
Quality Assessment

Voice Call
Success Ratio > 99%

7 LTE Field KPIs & Validation C2 - confidential

27 August 2014
Mean User Data Rate [Mbps] Target Values

LTE FDD 2x2 MIMO (DL), 1x2 (16QAM) (UL) in Mbps

DL UL

Average Average
Bandwidth
Peak Cell Edge Peak Cell Edge
in MHz Unloaded/ Unloaded/
100%loaded 100%loaded

5 30 10 / 8 1 10 4/3 0.5

10 60 20 / 15 1 20 10 / 8 0.5

20 120 40 / 30 1 40 20 / 16 0.5

8 LTE Field KPIs & Validation C2 - confidential

27 August 2014
Network KPIs and Target Values

Accessibility Integrity Mobility

EPS Bearer <1 % (Stat.) Handover Failure

Activation Failure Transition Time < 100 mec Ratio
< 2%
Ratio < 3% (Mob.)

Handover
EPS Bearer < 400 msec Packet Loss Ratio < 2% Interruption Time
Activation Time (UL / DL) on U-Plane (UL / < 70 msec
DL)

Handover
Jitter (UL / DL) < 50 msec Interruption Time < 20 mec
on MAC Layer
(UL / DL)

Throughput
Variation during < 40%
HO (UL / DL)

>44 VoiP calls /

Cell / MHz with
VoIP calls / cell / 100% load in
MHz neighbour cells

9 LTE Field KPIs & Validation C2 - confidential

27 August 2014
Measurement Concept for LTE
Acceptance Procedure (VF DE)

LTE Measurement
Concept

10 LTE Field Measurement Tools C2 - confidential

27 August 2014
11 LTE Field Measurement Tools C2 - confidential
27 August 2014