Documente Academic
Documente Profesional
Documente Cultură
SwissQual License AG
Allmendweg 8 CH-4528 Zuchwil Switzerland
t +41 32 686 65 65 f +41 32 686 65 66 e info@swissqual.com
www.swissqual.com
No part of this publication may be copied, distributed, transmitted, transcribed, stored in a retrieval system, or translated
into any human or computer language without the prior written permission of SwissQual AG.
Confidential materials.
All information in this document is regarded as commercial valuable, protected and privileged intellectual property, and is
provided under the terms of existing Non-Disclosure Agreements or as commercial-in-confidence material.
When you refer to a SwissQual technology or product, you must acknowledge the respective text or logo trademark
somewhere in your text.
SwissQual, Seven.Five, SQuad, QualiPoc, NetQual, VQuad, Diversity as well as the following logos are
registered trademarks of SwissQual AG.
Diversity Explorer, Diversity Ranger, Diversity Unattended, NiNA+, NiNA, NQAgent, NQComm, NQDI,
NQTM, NQView, NQWeb, QPControl, QPView, QualiPoc Freerider, QualiPoc iQ, QualiPoc Mobile,
QualiPoc Static, QualiWatch-M, QualiWatch-S, SystemInspector, TestManager, VMon, VQuad-HD are
trademarks of SwissQual AG.
SwissQual acknowledges the following trademarks for company names and products:
Adobe, Adobe Acrobat, and Adobe Postscript are trademarks of Adobe Systems Incorporated.
Intel, Intel Itanium, Intel Pentium, and Intel Xeon are trademarks or registered trademarks of Intel Corporation.
Microsoft, Microsoft Windows, Microsoft Windows NT, and Windows Vista are either registered trademarks or
trademarks of Microsoft Corporation in the United States and/or other countries U.S.
Contents
1 Introduction .......................................................................................................................................... 1
Overview of a Measurement Cycle........................................................................................................ 1
Reference Documentation ..................................................................................................................... 3
ii
Contents |
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
iii
Contents |
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Figures
Figure 1-1 Overview of the idle times and pauses in a measurement cycle ..................................................... 1
Figure 1-2 NDIS post connect delay in NQDI. ................................................................................................... 2
Figure 2-1 Ping Test - Basic Function ............................................................................................................... 4
Figure 2-2 Ping Test - NQDI Result Analysis Window ...................................................................................... 5
Figure 3-1 Ping Trace Test - Basic Function ..................................................................................................... 6
Figure 3-2 Ping Trace Test - NQDI Result Analysis Window ............................................................................ 7
Figure 4-1 FTP Test - Basic Function ................................................................................................................ 8
Figure 4-2 FTP Test - NQDI Result Analysis Window..................................................................................... 10
Figure 5-1 Test HTTP Browser Test - Basic Function.................................................................................. 11
Figure 5-2 HTTP Browser Test - NQDI Result Analysis Window .................................................................... 12
Figure 6-1 Test HTTP Transfer Test - Basic Function ................................................................................. 13
Figure 6-2 HTTP Transfer Test - NQDI Result Analysis Window.................................................................... 14
Figure 7-1 Overview of a Capacity test ........................................................................................................... 15
Figure 7-2 Results of Capacity test ................................................................................................................. 17
Figure 8-1 UDP Downlink Test Basic Function ............................................................................................ 18
Figure 8-2 UDP Downlink Test - NQDI Result Analysis Window .................................................................... 19
Figure 9-1 UDP Plus Test Basic Function .................................................................................................... 20
Figure 9-2 UDP Plus Test - NQDI Result Analysis Window ............................................................................ 22
Figure 10-1 Email Send Test Basic Function ............................................................................................... 23
Figure 10-2 Email Send Test - NQDI Result Analysis Window ....................................................................... 24
iv
Contents |
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Tables
Table 2-1 Timing of actions during a Ping Test ................................................................................................. 4
Table 2-2 Ping Test - Result Analysis ............................................................................................................... 5
Table 3-1 Ping Trace Test - Result Analysis ..................................................................................................... 6
Table 4-1 Timing of actions during an FTP Test ............................................................................................... 8
Table 4-2 FTP Test - Result Analysis ................................................................................................................ 9
Table 5-1 HTTP Browser Test - Result Analysis ............................................................................................. 11
Table 6-1 Timing of actions during an HTTP Transfer Test ............................................................................ 13
Table 6-2 HTTP Transfer Test - Result Analysis ............................................................................................. 13
v
Contents |
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
vi
Contents |
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
1 Introduction
This document describes the Data and Messaging tests available with the Diversity Measurement Units,
SwissQuals Subscriber Experience Management system for audio, data, messaging and video quality.
Each test is handled in a separate chapter, consisting of a description of the test flow and the result analysis.
Analysis is presented with NQDI, SwissQuals post processing application. Were necessary and appropriate,
in depth detail information is provided as well. The appendix outlines general information as well other kind of
nice to know descriptions.
Note: Please note that this document does not describe how to setup Diversity nor does it deal with
configuring the data and messaging tests. These topics are provided in document [1].
Note: If you want to modify the length of the preparation pause, see Appendix B on page 56.
pause
pause
GPRS HTTP
FTP
Attach Get or more tests that are separated by
Get pauses.
Figure 1-1 Overview of the idle times and pauses in a measurement cycle
The preparation phase typically lasts approximately 100 ms and is therefore not significant.
Important: This phase might take longer for the GPRS attach test if the test requires a preliminary
detach operation. Furthermore, Windows 7 can introduce instabilities into the test.
The duration of the clean-up phase can vary based on the type of test. The clean-up phase of the following
test types lasts is typically 1.5 seconds:
Ping
1
Chapter 1 | Introduction
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
GPRS Attach
GPRS Detach
PDP Activation
PDP Deactivation
SMS Send
SMS Receive
The clean-up phase for the following test types typically lasts 3 seconds:
HTTP Transfer
HTTP Browser
FTP, Capacity
IPERF
Ping Trace
UDP
Email
MMS send
MMS receive
Note: In the worst case, the duration of the clean-up phase might double.
The NDIS option for a task introduces an additional pause after the connection has been established. This
pause is the NDIS post connection delay and has a duration of 500 ms.
Note: Although you can change the duration of the clean-up phase and the NDIS post connect delay
with Windows registry keys, SwissQual strongly recommends that you use the default values to avoid
issues with trace recording or test success rate.
2
Chapter 1 | Introduction
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Reference Documentation
Reference Document
[1] Manual NetQual - NQView
[2] Manual NQDI - KPI Users Guide
3
Chapter 1 | Introduction
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
2 Ping Test
Basic Function
The test sends the ping (ICMP Echo Request) to the target host with the configured ICMP packet size and
waits for the configured timeout duration for a successful response. If the ICMP Echo Reply does not arrive
to the client within timeout, the ping response is considered failed.
Client Host
RTT1
Reply
ICMP Echo
Interval
ICMP Echo Re
quest
RTT2
Reply
ICMP Echo
Result Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet.
4
Chapter 2 | Ping Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Value Description
Host Name or IP address of the host
Avg. RTT [ms] Average Round Trip Time of all ICMP Echo request/response RTTs
No. of successful Pings The number of successful Pings
Packet Size [Bytes] ICMP packet size
Time Current timestamp of message
State Not used/Reserved
RTT [ms] Round Trip Time of current ping
Sequence Number Sequence number of ping for this test; starting with value 1
Msg State message: OK if successful, otherwise the appropriate error text
corresponding to the error code.
Error Code 0 if successful; otherwise the error code
5
Chapter 2 | Ping Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Basic Function
The test sends the ping (ICMP Echo Request) to the target host with the configured ICMP packet size and a
modified Time to Live (TTL) count value of 1 to the target destination. The TTL value indicates how many
Hosts (aka Hop) are being passed through, before a ICMP Time to live exceeded message occurs. If the
response message arrived within configured timeout the first Hop is considered found. The RTT value
between client and that Hop is being calculated. Now, the TTL value is increased by one and the ICMP Echo
Request is sent again. These steps are being repeated until the target destination could be reached.
Client Hop Hop Host
ICMP Echo Re
quest
(TTL=1)
RTT1
Exceeded
ICMP TTL
ICMP Echo Re
quest
(TTL=2)
ICMP Echo Re
quest
(TTL=1)
RTT2
ceeded
ICMP TTL Ex
ICMP Echo Re
quest
(TTL=3) ICMP Echo Re
quest
(TTL=2)
RTT3 ICMP Echo Re
quest
(TTL=1)
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
Table 3-1 Ping Trace Test - Result Analysis
Value Description
Time Current timestamp of the message
Hop Number of the router passed.
RTT Round Trip Time between Client and Hop
Host IP address of either the hop where the TTL exceeded or the target host responding with the
Echo Reply message.
DNS Name Not used / Reserved
6
Chapter 3 | Ping Trace Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Value Description
Status State message: OK if successful, otherwise the appropriate (ICMP) error text.
7
Chapter 3 | Ping Trace Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
4 FTP Test
Basic Function
Before a file can be transferred over FTP, a control channel connection has to be established to the FTP
server. This control channel is used to exchange FTP commands between client and server. Commands
such as user account login, directory changing and choosing the FTP operation are applied. When it comes
to a FTP GET (file download from server) or FTP PUT (file upload to the server) operation, the data channel
is being established, which then is used to transfer the raw file data.
Client FTP Server
Control Connection
Data Connection
Important: When encountering connection problems (no or closed connections) with the selected
Active/Passive mode, try using the other mode. Firewalls and NAPT may block or close connections.
The control channel remains open during file transfer in order to exchange other commands (such as
aborting the file transfer, and so on).
Note: Active mode: The server connects to the client on a port provided by the client. Passive mode: The
client connects to the server on a port provided by the server.
then, starts to send the info. Meanwhile, the software thinks that it just sent 4096 bytes in a fraction of a
second. We have mitigated the impact of this phenomenon by averaging over several seconds, but this does
not fully eliminate the impact of buffering. Besides, what we are measuring in the ftp monitor is application
throughput, and this is what we are reporting.
Note: It is possible to have application throughputs exceeding the theoretical physical limitations due to
enhanced phone and PC buffering techniques.
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
Table 4-2 FTP Test - Result Analysis
Value Description
Time Current timestamp of the message
Operation Operation, either PUT or GET
Filename Name of the file transferred or received
Throughput As long as the state is listed as In Progress, this value represents the intermediate
throughput in bytes/s, calculated as (number of bytes transferred since last message) / (time
needed).
At the end of a FTP session, the state will change to Success or Failed. In case of Success,
the throughput value contains the overall throughput calculated as: (total number of bytes
transferred) / (total time needed). In case of Failed, the overall value not calculated
FTP Host Name or IP address of the FTP host
Bytes Intermediate number of bytes transferred
Transferred
State In Progress, Success, Failed
Error State message: OK if successful, otherwise the appropriate error text corresponding to the
error code.
9
Chapter 4 | FTP Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
10
Chapter 4 | FTP Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Note: It is recommended to perform the test with basic and static content. Web pages containing active
scripting may not be supported by the applied browser instance and therefore might lead into an error
message. This will cause the test to timeout! Please disable the active Scripting functionality within
Microsofts Internet Explorer settings.
Basic Function
The test implementation uses Microsofts Internet Explorer (IE) for navigating to and downloading the web
page. On test initialization the IEs temporary file folder (cache files) is being emptied in order to prevent the
loading the page from the local file system. Also, any existing IE browser instances are being closed to avoid
noninvolved HTTP traffic. Afterwards the web page is being downloaded. Once the IE instance reports the
Navigation complete event the test is considered finished. Now, application throughput is calculated and
number of images is counted.
Web
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
Table 5-1 HTTP Browser Test - Result Analysis
Value Description
Msg Time Current timestamp when result message has been written.
Url Uniform Resource Locator
Number of Number of images within the web page.
images
Number of Number of frames within the web page
frames
Total Size Total size of web page.
Throughput Throughput = totalSize / (time between navigate and documentComplete)
Error 0 if successful; otherwise the error code
11
Chapter 5 | HTTP Browser Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
12
Chapter 5 | HTTP Browser Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Note: Use a file of sufficient size for the IP link that you want to test.
Basic Function
Web
Note: By default, you cannot upload any type of file to the HTTP server. Instead, you need to enable this
feature for the directory on the HTTP server. You can either grant universal access to the directory or
require user name and password authentication.
Results Analysis
The post processing application NQDI shows the data in the following table on the result analysis tab sheet.
Table 6-2 HTTP Transfer Test - Result Analysis
Value Description
Msg Time Time when result message is written
Host URL or IP address of the HTTP server
Operation GET (Download) or PUT (Upload) operation
Buffer Size PUT operation uses local buffer (recommended size 32 kB)
13
Chapter 6 | HTTP Transfer Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Value Description
Local file PUT operation only
name
Remote file Path and file name on the HTTP server
name
Bytes Intermediate number of bytes that have been transferred (Last Block = 0)
Transferred Final file size (Last Block = 1)
State Possible states are: In Progress, Success, Failed
Error State message is OK if the test is successful, otherwise the error text corresponding to the
error code is displayed.
Throughput As long as the state is listed as In Progress, this value represents the intermediate
throughput in bytes/s, which is calculated as (number of bytes transferred since last
message) / (time needed).
At the end of the test, the state changes to Success or Failed. If the state is Success, the
throughput value contains the overall throughput that is calculated as: (total number of
bytes transferred) / (total time needed). If the state is Failed, the overall value is not
calculated.
14
Chapter 6 | HTTP Transfer Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
7 Capacity Test
Basic Function
The test configuration requires you to define a set of HTTP URLs. The target files, which are transferred
simultaneously during the test, can reside on different servers.
Important: To avoid incomplete and aborted transfers during the duration of the test, use files that are
larger than 1 GB in size.
Start Stop
Data Transfer 1...n Data Transfer 1...n
Test Duration
Time
15
Chapter 7 | Capacity Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Result Analysis
The following table describes the Capacity test data that you can analyse in NQDI.
Table 7-1 Description of the Capacity test data
Value Description
Msg Time Time when results arrive
Host List of the URLs for simultaneous transfer
Operation GET (Download) or PUT (Upload) operation
Buffer Size Protocol for the data transfer
Local file name PUT operation uses local buffer (recommended size 32 kB)
Remote file name PUT operation only
Bytes Transferred Intermediate number of bytes that have been transferred (Last Block = 0)
Final size (Last Block = 1)
State Possible states are: In Progress, Success, Failed
Error Provides information on errors that occur during the test.
Throughput If the test state is "In Progress", this value represents the intermediate
throughput in bytes/s, which is calculated as (number of bytes transferred
since last message) / (time needed).
At the end of the test, the state changes to "Success" or "Failed". If the state
is "Success", the throughput value contains the overall throughput that has
been calculated as: (total number of bytes transferred) / (total time needed).
If the state is Failed, the overall throughput cannot be considered.
16
Chapter 7 | Capacity Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
17
Chapter 7 | Capacity Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Basic Function
Firstly, the server application is being configured. The configuration consists of application identifier
(SQUDPDL), test number, number of packets to be sent by the server, interval, packet size and bandwidth.
Once the server acknowledged the configuration, the TCP connection is terminated. Then, after a delay of
one second the server begins sending the UDP packets towards the client with a calculated time gap of
[nPackets * packetSize / bandwidth]. Note, that the time between the packets is limited to a 10-ms
timeframe. Therefore, it is not possible to specify the bandwidth for each packet size.
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
Table 8-1 UDP Downlink test - Result Analysis
Value Description
Msg Time Current timestamp of the message
Host Name or IP address of the UDP server
PacketSize Size of each packet
Bandwidth Bandwidth used to send packets
18
Chapter 8 | UDP Downlink Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Value Description
Throughput Throughput = ((packetsRX-1) * packetSize) / (tLastPacket tFirstPacket)
Packets Number of packets sent
Sent
Packets Number of packets received in time
Received
Jitter 2 x standard deviation of time between packets
Error State message: OK if successful, otherwise the appropriate error text corresponding to the
error code.
19
Chapter 8 | UDP Downlink Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Basic Function
The UDPPlus test requires a server application (squdpplus) which can communicate with the client (client
side starts test). When a test is started, the client connects to the server and configures a test session (TCP).
After successful server configuration, the client starts to send packets to the server using the pattern defined
in the chirp file. The client sends only packets up to the size of the buffer (buffer size is defined with the
Maximum capacity for send buffer parameter). If the capacity of the buffer is reached, client packet sending
is suspended until the corresponding reply packet is received (on match, packet is removed from buffer) or if
the packet in the buffer reached the timeout it is being deleted from the buffer and marked as lost.
The server receives each packet and sends it back. Packet size can be adjusted by the server if the
appropriate parameters have been set. The client logs each arriving packet and calculates the roundtrip time
(per packet) and throughput (per chirp file repetition). If the server receives no packets for a user defined
time, the server starts to send server generated packets to the client. If option is set, the client can handle
these sever generated packets as regular downlink response packets.
UDP Packet is
Server
Client
UDP Packet is
represents the RTT (H, U, B) or delay (S) of the packet. Lost packets are displayed as red dots at the sent
time by the client. Lost server originated packets are not displayed.
Table 9-1 UDP Plus Test - Result Analysis
Value Description
ReceiveTime The client receive timestamp
Type Packet type: H=RTT, U=Uplink bandwidth, B=Downlink bandwidth, S=Server originated
Number Packet sequence number
SendTime Client send timestamp
ServerTime Server send timestamp
Host UDPPlus server host address
RTT [ms] Roundtrip time for type H, U and B
Delay [ms] Transmission delay from server to client for type S
Repetition Chirp file repetition number of this packet
Error OK, if no error has occurred; error code if an error has occurred. Lost - if packet did not
reach the client within the test time
In the Statistics window, the following values are calculated from each repetition or from the whole test:
Table 9-2 UDP Plus Test - Values in Statistics Register
Value Description
Lost Packets Number of lost packets
Packet Loss [%] Percentage of lost packets
RTT Mean [ms] Mean RTT value for all type H packets
RTT Standard Standard deviation value for all type H packets
Deviation [ms]
RTT x% Value [ms] RTT value which x% of all H packets do not exceed
Uplink Bandwidth Uplink bandwidth mean value for all chirp file repetitions
Mean [kbit/s]
Uplink Bandwidth Uplink bandwidth standard deviation value for all type chirp file repetitions
Standard Deviation
[kbit/s]
Uplink Bandwidth Uplink bandwidth value x% of all chirp file repetitions do not fall below
x% Value [kbit/s]
Downlink Bandwidth Downlink bandwidth mean value for all chirp file repetitions
Mean [kbit/s]
Downlink Bandwidth Downlink bandwidth standard deviation value for all type chirp file repetitions
Standard Deviation
[kbit/s]
Downlink Bandwidth Downlink bandwidth value x% of all chirp file repetitions do not fall below
x% Value [kbit/s]
The Repetition Table shows statistics values per chirp file repetition within a test:
21
Chapter 9 | UDP Plus Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
22
Chapter 9 | UDP Plus Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Basic Function
The
Server
Client
SMTP
throughput
Port 25 calculated &
An email with or without attachment, recorded.
with a subject title is sent.
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
Table 10-1 Email Send Test - Result Analysis
Value Description
Msg Time Current timestamp of the message
SMTP Name or IP address of the SMTP server
Server
Email First part of the email address. (user)
Address
Subject Subject entered by the user.
Size Total size of the email (7bit encoded).
Connect Time to connect to SMTP server
Duration
Send Time to send email
Duration
Throughput Throughput = Size / Send Duration
Error Code OK, if no error has occurred; error code if an error has occurred.
23
Chapter 10 | Email Send Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
24
Chapter 10 | Email Send Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Important: Do not use the same Email account for different tests running at the same time because the
POP3 server cannot handle multiple connections for the same user at the same time.
Basic Function
The test client connects to the specified POP3 server and authenticates itself with username and password.
In case an Email subject line has been defined, the client goes through all messages within the mailbox and
searches for the first Email matching the subject. This search time is accounted separately. Once the
message is found the transfer begins. The time used for transfer and the Email size is then being used to
calculate the throughput value. Once the Email has been downloaded, the operation (delete Email; delete all
Emails or leave Email is performed).
The
Server
Client
SMTP
Port 25 throughput
calculated &
An email with a specific subject title recorded.
is downloaded.
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
Table 11-1 Email Receive Test - Result Analysis
Value Description
Msg Time Current timestamp of the message
POP3 Server Name or IP address of the SMTP server
Email Address First part of the email address. (user)
Subject Subject entered by the user.
Size Total size of the email (7bit encoded).
Connect Duration Time to connect to SMTP server
Search Duration Time to find message with same subject line
Receive Duration Time to retrieve email.
Message Number The message number matching the subject line (if found)
Throughput Throughput = Size / Receive Duration
Error Code OK, if no error has occurred; error code if an error has occurred.
25
Chapter 11 | Email Receive Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
26
Chapter 11 | Email Receive Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Basic Function
In a first step the device will check whether or not it is already attached to the network.
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet. The
Analysis Window displays the following:
27
Chapter 12 | GPRS Attach Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
28
Chapter 12 | GPRS Attach Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Basic Function
In a first step the device will check whether or not it is already detached to the network. If yes or in case the
state could not be determined, it will perform a GPRS detach command. If already detached, the test will
returns successful without performing any operation.
Network
be returned, if the
detach is successful.
Application attempts to detach
from GPRS network.
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
29
Chapter 13 | GPRS Detach Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
30
Chapter 13 | GPRS Detach Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Basic Function
The application will start a dialup session to the network. During this dialup session, the mobile phone will
attempt PDP context activation.
IP address is returned.
Figure 14-1 PDP Activation Test Basic Function
A successful PDP context activation will return an IP address to the mobile.
Table 14-1 Timing of actions during a PDP Activation Test
Results Analysis
The Analysis Window displays the following:
31
Chapter 14 | PDP Activation Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
32
Chapter 14 | PDP Activation Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Basic Function
The application will attempt to disconnect from the network by performing a PDP deactivation operation.
be returned, if
PDPDeactivation is
Application attempts a
successful.
PDPDeactivation.
Results Analysis
The Analysis Window display the following:
33
Chapter 15 | PDP Deactivation Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
16 WAP Test
Basic Function
The WAP test starts by connecting to the WAP gateway (redirection is handled as needed). A GET request
for the desired URL is, then, sent to the gateway. Once the response has been received, the page is being
parsed for any Picture tag (<IMG>). For each such tag found, another request is sent to retrieve the image.
The test is finished when the last request has returned.
The throughput is calculated with the size of the downloaded page and all images divided by the time
between the request of the initial page and the response (last packet) of the last image.
WSP Get
TRANS. http://wap.sbb.ch
HTTP GET
HTTP OK (+Data)
TRANS. WSP Reply
DOCUMENT
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
Table 16-1 WAP Test - Result Analysis
Value Description
Connect Duration Connecting time
Download Duration Total time of web page download duration
Throughput Calculated application throughput value
Error Code 0 if successful; otherwise the error code
34
Chapter 16 | WAP Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Value Description
URL: Uniform Resource Locator
Host Name or IP address of the host
Time out Configured timeout duration
Msg Time Current timestamp of event message
Event Message event
Name Complete file name
Size File size in [Bytes]
35
Chapter 16 | WAP Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Important: SMS Send test cannot be mixed with other data tests!
Basic Function
The message text consists of auto created identifiers and random or user defined text data which can be
used by an optional receiver for proper SMS identification. Once the SMS is constructed, it is being sent to
the configured SMSC.
Receiver
indicate success or
failure.
Application attempts to
send SMS
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
36
Chapter 17 | SMS Send Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Value Description
Send Duration Time to send the text message
End-To-End Delivery Time Duration between sending and receiving a message
(Not used in SMS send only tests)
SMS Size Number of characters within the text message
Max Send Time Timeout value for sending the message
Pause Time Sender Time between sending of two messages
Sender Number Phone number of sender
(Not used in SMS send only tests)
Receiver Number Phone number of receiver
Error Code State message: OK if successful, otherwise the appropriate error text
corresponding to the error code.
37
Chapter 17 | SMS Send Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Important: SMS Receive test cannot be mixed with other data tests! Only one test per job allowed.
Important: The incoming SMS should be computed by Diversity; otherwise the error unexpected SMS
received will occur.
Basic Function
This test just waits for a SMS indication and then gets the SMS from the mobile. This SMS will be saved and
the identifier used to identify the appropriate SMS send test.
Network
Client
Application attempts to
retrieve SMS
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
Table 18-1 SMS Receive Test - Result Analysis
Value Description
Send Duration Time to send the text message
End-To-End Delivery Time Duration between sending and receiving a message
(Not used in SMS send/receive only tests)
SMS Size Number of characters within the text message
Max Send Time Timeout value for sending the message
Pause Time Sender Time between sending of two messages
Sender Number Phone number of sender
Receiver Number Phone number of receiver
(Not used in SMS receive only tests)
Error Code State message: OK if successful, otherwise the appropriate error text
corresponding to the error code.
38
Chapter 18 | SMS Receive Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
39
Chapter 18 | SMS Receive Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Phone Configuration
For an MMS test on an Android phone, you need to manually configure an Internet and an Internet + MMS
APN on the phone. You also need to disable the Auto-retrieve function for MMS. For a description on how
to perform these actions, see the user manual for your phone.
Note: Some phone types, such as the HTC sensation, use different APN type name, for example,
default,supl instead of Internet and default,supl,mms instead of Internet + MMS.
For Nokia phones, you need to connect to the network that you want a test, send an MMS, and then
configure the phone to never download an MMS.
Note: If this option is not available, you need to configure and select an invalid Access Point on the
phone.
Important: MMS Send test cannot be mixed with other data tests! Only one test per job allowed.
Basic Function
The message text consists of auto created identifiers and random text data which can be used by an optional
receiver for proper MMS identification. Then, the multimedia content is being added to the message. When
the message object is created, a GPRS connection is established and the message is sent to the MMS
Center (MMSC). When transmission completed, the dialup connection is being disconnected.
Once the SMS is constructed, it is being sent to the configured SMSC.
Receiver
Client
Application attempts to
send MMS
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
Table 19-1 MMS Send Test - Result Analysis
Value Description
Service Access duration Duration for accessing the service
40
Chapter 19 | MMS Send Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Value Description
Transmit Duration Duration for sending the message
Overall Send Duration Overall duration
Error Code State message: OK if successful, otherwise the appropriate error text
corresponding to the error code.
41
Chapter 19 | MMS Send Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
42
Chapter 19 | MMS Send Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
43
Chapter 19 | MMS Send Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
44
Chapter 19 | MMS Send Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
TRANSMISSION STARTED Send MMS WTP Invoke (begin of MMS Send Req.)
45
Chapter 19 | MMS Send Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Important: MMS Receive test cannot be mixed with other data tests. Only one test per job allowed. The
incoming MMS should be computed by Diversity; otherwise the error unexpected SMS received will
occur.
The MMS Receive test attempts to retrieve a MMS message from the network.
Basic Function
This test, first, waits for an MMS notification indication sent via (usually two) SMS. Then, a GPRS and WAP
connection is established and the MMS retrieved from the MMS Center.
Network
Client
Application attempts to
retrieve MMS
Results Analysis
The post processing application NQDI shows the following data on the result analysis tab sheet:
Table 20-1 MMS Receive Test - Result Analysis
Value Description
Service Access duration Duration for accessing the service
Receive Duration Duration for sending the message
Overall Receive Duration Overall duration
Notification time Time between sent message (sender: transmission finished) and notification
indication on receiver side.
(Not used in MMS receive only tests)
End to end delivery time Complete time duration when starting to send message until it is fully
received by opposite site.
(Not used in MMS receive only tests)
Error Code State message: OK if successful, otherwise the appropriate error text
corresponding to the error code.
MMS Size Size of message
Max Send time Timeout to send message
Pause Time Sender State message: OK if successful, otherwise the appropriate error text
corresponding to the error code.
Sender Number Phone number of sender
46
Chapter 20 | MMS Receive Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
Value Description
Receiver Number Phone number of receiver
(Not used in MMS receive only tests)
Attachment Not used in Diversity
Gateway Gateway address and port number
Protocol Protocol used to transfer data (WSP or HTTP)
47
Chapter 20 | MMS Receive Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
48
Chapter 20 | MMS Receive Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
49
Chapter 20 | MMS Receive Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
MMS Download
50
Chapter 20 | MMS Receive Test
CONFIDENTIAL MATERIALS
Data and Messaging Tests Manual
2000 - 2013 SwissQual AG
DNS 53 53
Authentication Service 113 113
RTSP, Data 6970..6989 6970..6989
UDP Test 8010 8010 8010 8010
UDPDl Test 8021 8021 8022 8022
UDPPlus Test (T) 8023 (T) 8023 (T) 8024 (T) 8024
Legend:
P FTP-aware firewall required for passive mode
A FTP-aware firewall / NAT required for active mode
S Configurable during Server startup
T Configurable in Test configuration
Note: Not all data tests require a previous dialup. Such as GPRS and PDP Tests!
The measurement PC dials up to the Internet provider. At this point, the marker GPRS Dial is written to the
log file. This marker can be shown in the GSM Analysis window:
you will get a GPRS Connect Failed marker. This means, that the mobile is not connected to the Internet
and that the dial-up has to be repeated.
You can search for such events, if you select the GPRS Connect Failed markers in the data selection part: