Documente Academic
Documente Profesional
Documente Cultură
Various Technologies -
ONE Test System: SITE
Abbreviations
BSC Base Station Controller
BTS Base Transceiver Station DSL
CDR Call Detail Record WLAN IP
CIMD Computer Interface to Message Distribution Ethernet
GGSN Gateway GPRS Support Node
GMSC Gateway MSC
GPRS General Packed Radio Service (2.5G)
GSM Global System for Mobile Communications (2G)
HLR Home Location Register
IP Internet Protocol o rk
etw
PN
ISDN Integrated Service Digital Network
ISUP ISDN User Part I
LTE Long Term Evolution (4G)
MGW Media Gateway
MMSC MMS Center
MSC Mobile Switching Centre
PBX Private Branch Exchange
PoC Push-to-talk over Cellular
PSTN Public Switched Telephone Network
RNC Radio Network Controller
SGSN Serving GPRS Node
S
SITE
SMPP
SIGOS Integrated Test Environment
Short Message Peer to Peer
GG
SMSC Short Message Service Center
UCP Universal Computer Protocol Gn/Gp
UMTS Universal Mobile Telecommunications System (3G)
SN o
UTRAN UMTS Terrestrial Access Network SG dC
e
itch
VLR Visitor Location Register
w
ke t-S
Pac Gs
G
S1/S11 luPS
Gb
LTE e-Node B
m
Evo
l uti
on
luCS
g Ter
Lon C
RN lur
Uu
UMT lub
o rk
S tw
Node B
s Ne
s
A cce
R AN
UT BS
C
Uu
GSM BTS
Abis
s Ne
tw o rk
es
Ac c
M
GS
Um
CDR
IP g
tin
d Ra
g an
lin
Bi l
ces
e r vi
dS MM7
t an
ten
C on
Gi
SN
GG SC
MM
Gn/Gp tw o rk SMPP
Ne UCP
P
C o re Gc
CIMD
WA
d il
che Ma
wit
t-S Gd
Gr m
Gs SC
P
t for
Pl a
ce
C r vi
MS Se
S a t or
er
C Op
HLR D SC
GM
E ISUP
MS
C-S o rk
etw
erv
er/
VL N
R
re S2m
Mc MGW d Co
it che
i t Sw it ch
cu Sw
Ci r
X
PB
tw o rk
N Ne
A D
/ IS
TN
PS
B SC
tw o rk
s Ne
s
CDMA a/b
So
All trademarks and registered trademarks are the property of their respective owners.
Contents
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Company . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 World-Wide Coverage . . . . . . . . . . . . . . . . . . . . . . . . 39
Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 Use Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
USE CASES 12
The Unique Test Platform . . . . . . . . . . . . . . . . . . . . . 42
Service Quality Monitoring Hardware Components & Interfaces . . . . . . . . . . . 46
Periodic QoS Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 14 Test Tools for SITE and GlobalRoamer . . . . . . 48
On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Reporting & Alarming . . . . . . . . . . . . . . . . . . . . . . . . 50
Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
Content Testing / Handset Simulation . . . . . . . . . 18
Test Applications for SITE and GlobalRoamer. . 54
Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . 56
Roaming Testing Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Inbound Roaming Testing . . . . . . . . . . . . . . . . . . . . 20 Voice Advanced . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
Outbound Roaming Testing . . . . . . . . . . . . . . . . . . . 21 Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
SLA Testing according to GSMA (GRQ) . . . . . . . . . 22 Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . 23 Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . 24 Value Added Services . . . . . . . . . . . . . . . . . . . . . . . . . 68
International Carrier Quality Testing Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . 70
Dedicated carrier route selection . . . . . . . . . . . . . 25
5
With a customer base of more than
200 operators around the world in over 100 countries...
6
Introduction
Company
Testing is our Competence
Portfolio
SITE – Active end-to-end test system
GlobalRoamer – Managed world-wide system
Professional Services – Consulting and more
7
Introduction > Company
Keynote SIGOS
Keynote SIGOS
The Company
What we do
Keynote SIGOS provides scalable and fully
Service Quality testing and monitoring
integratable telecommunications testing
Roaming testing
solutions to service network operators
(mobile and fixed line as well as MVNOs) International Carrier Quality testing
and content providers, carriers and regulators. Revenue Assurance and Billing verification
Revenue Leakage and Fraud Detection
Our solutions and services are designed to solutions
give our customers the full picture on Qual-
Drive Service testing
ity of Service from an end-user perspective.
Fixed and IP network testing
But we do not stop there: our customers
Test creation, diagnosis and reporting
enjoy the most comprehensive range of
tools
scalable active end-to-end testing solutions
Core Network testing solutions
available on the market.
Handset simulation
Keynote SIGOS
8 www.keynote-sigos.com
Introduction > Company
SMS is introduced First commercial VoIP in its infancy GPRS / EDGE (“2.5G”)
World Wide Web website is used for the ADSL allows high-speed
(www) is born first time communication
over phone lines
Who we are
Founded in 1989 under the name of SIGOS
Systemintegration GmbH, Keynote SIGOS
brings in more than two decades of broad
experience to the telecommunications
industry, helping our customers to be even
more successful in today’s highly
competitive environment.
Keynote SIGOS is a truly international
company: bringing people from multiple
cultural backgrounds together to outstand-
ingly serve our global customer base with
Keynote SIGOS is headquartered in Germany where our solutions are being developed
what Keynote SIGOS employees all have in under highest standards. Representations on multiple continents and our strong partner
common: true passion for telecommunications! network distributed all over the world rounds up our world-wide presence.
Introduction of
SITE provides Keynote SIGOS GlobalResource Pool
test environment Launch of Billing celebrates GlobalRoamer to cover
Keynote acquires for VoIP, ADSL, Verification and its 20 Years’ ¾ of the world countries
SIGOS GmbH DSL, HSUPA Drive Service Test Anniversary LTE Test System
te SIGOS
no
y
20
Ke
RS
YEA
9
19 00
89 - 2
www.keynote-sigos.com 9
Introduction > Portfolio
The Portfolio
Steering of Fraud Detection for
Roaming National & International
Testing Traffic
International
Carrier
Testing
Outbound
Billing Testing
GlobalRoamer
Roaming
Testing for International
Traffic
World-wide
Handset Specific
QoS Testing
QoS Tools
for Diagnosis & Reporting
Fraud Detection
Revenue
Assurance
Roaming SITE
Central Unit Tool
Testing
SITE TEST SYSTEM
SIM
Multiplexer
Clients
LAN / WAN Drive Service
Testing
LU CLU WLU
LU CLU LU CLU
Managed
Services
Professional Services
Training Consulting
Services
10 www.keynote-sigos.com
The Managed Global Infrastructure and Test System
For The World-Wide Telecommunications Industry
With GlobalRoamer, Keynote SIGOS of- All that is required is a web browser and The on-demand
fers the most extensive infrastructure access to the internet. Simply log on with world-wide test
for automated telecommunication testing your password and set up your test sched- platform hosted
world-wide. We provide our customers with ules without worrying about a thing. How- by Keynote SIGOS
an extensive network of testing facilities ever, Keynote SIGOS can also provide fully
around the globe, hosted by Keynote managed test services so that all that you
SIGOS. GlobalRoamer customers can use really need to do is: look at the results.
this sophisticated testing infrastructure
through a web based user interface.
www.keynote-sigos.com 11
Versatility is key!
Keynote SIGOS
solutions in action.
12
The Use Cases
Service Quality Monitoring
> Periodic / On-Demand Testing
> Network Diagnosis
> Drive Service Testing
> Content Testing / Handset Simulation
> Benchmarking
Roaming Testing
> Inbound Roaming Testing
> Outbound Roaming Testing
> SLA Testing according to GSMA (GRQ)
> Roaming Hubbing Testing
> Roaming Steering Testing
Revenue Assurance
> Test Call/Event Generation
> CDR Comparison Testing
> Tariff Testing
> Prepaid SIM Recharging
13
Use Cases > Service Quality Monitoring
Slow setup time, service outages or unsuccessful data downloads are experienced in
every network. In order to manage daily operations standardized matrices should be
deployed by several divisions, e.g. Service Operations, Service Quality Assurance,
Network Operations, International Roaming and Revenue Assurance.
14 www.keynote-sigos.com
Use Cases > Service Quality Monitoring
On-Demand Testing
Perform reproducible ad-hoc testing!
The customer service desk keeps getting complaints about certain service scenarios like
‘BlackBerry e-mail service not reliable’, ‘basic voice calls not possible’ in certain locations,
in the home country as well as abroad. Quick action needs to be taken!
The test call can be replicated repetitively Root causes can be localised easily when
in order to check whether service has used in tandem with Keynote SIGOS’s
been re-established. integrated analysis tools.
GlobalRoamer is deployed to survey Time zone and business hours differences
specific services over roaming partners’ often make it difficult to run tests with
networks managing both post-paid and the co-operation of roaming partners.
prepaid SIMs across the different techno- GlobalRoamer offers an easy and instant
logies. The SIMs are co-located in Keynote solution to this problem.
SIGOS’ premises in Nuremberg, Germany.
“There is no time lost as we do not have to get in touch with the roaming partner. We can execute
tests via GlobalRoamer in a matter of a few minutes anywhere in the world where SIGOS has cover-
age. Before we started to use GlobalRoamer sometimes we had to wait more than 3 months for
execution of a roaming test because partners were occupied with other roaming partners’ tests.”
“The SIGOS test system helps us to manage our test SIMs efficiently as we do not have to send the
SIMs to multiple countries for roaming testing. It provides us with a fully controlled test platform.
We can perform multiple test cases easily and simultaneously.“
www.keynote-sigos.com 15
Use Cases > Service Quality Monitoring
Network Diagnosis
Model your network & find the root cause
of service outages!
Once periodic heartbeat testing for the services has been set up, very often Service
Operations is the first team to detect service outages through the results of this active
testing. But what network entity has caused the fault?
SITE proves not only to be a good reflec- elements and systems can then signifi-
tion of real customer experience but also cantly drive down time to repair.
shows up bottlenecks in the network
Service Alarm Map helps to reduce the
infrastructure via its solution Service
time for root cause identification and
Alarm Map (SAM).
supports the technical service teams with
By supervision of all relevant end-custo- additional information like error-id, trace
mer services and correlation of network details & measurement values. This impor-
events it becomes possible to both tant drill-down functionality from service
anticipate and analyze service affecting chain visualization to raw measurement
network problems. A clear and compre- values and trace information improves
hensive mapping of service problems to reaction times in the event of traffic
the performance of individual network congestion and network element failures.
“The number of customer complaints have been reduced significantly due to network
issues being identified faster by the Keynote SIGOS test system. Real-time alerts and
reports of incidents lead to faster resolution of the network issues identified. Subscribers
See your network are “not fast enough” to call our Customer Care to lodge a complaint.”
through the eyes of
your customer
MSC 4
BSC 12 SGSN 2
LocationUpdate2G GPRS_Attach2G GPRS backbone
Opera server
DL_Duration
HttpAv
INTERNET
GGSN
PDP_ContextActivation VPN Tunnel
Router
Internet
DL_Duration
HttpAv
16 www.keynote-sigos.com
Use Cases > Service Quality Monitoring
SITE has already been widely deployed for periodic QoS testing and KPI generation.
Quality of subscriber experience however is not only driven by static service use but
also by service deployment on the move. Testing during moving is an important
complementary approach in addition to stationary testing.
www.keynote-sigos.com 17
Use Cases > Service Quality Monitoring
The opportunity for mobile operators and advertisers to sell exciting new mobile
content is enormous. However, the variety of available services like MMS, Video Strea-
ming and Web Browsing may cause problems when using different handsets, since
the service platforms of the network react individually to each mobile phone type!
18 www.keynote-sigos.com
Use Cases > Service Quality Monitoring
Benchmarking
Who is the best performer?
KPIs for own network are regularly reported to senior management. But how does your
network perform compared to the competitors? Who has the best performance?
Who offers the highest quality of service (QoS)? What is the quality situation for your
international traffic?
www.keynote-sigos.com 19
Use Cases > Roaming Testing
Inbound Roaming
Provide best service to visitors in your network!
Today, subscribers expect all frequently used mobile services to work reliably everywhere
in the world. Thus, the quality and availability of services inside and outside the home
network becomes increasingly important in the battle for customers!
Inbound roaming has a big impact on your revenue and a long list of international
roaming agreements may be desireable. It comes at a cost: each and every roaming
agreement with a new roaming partner requires intense testing according to GSMA
standards. In addition, periodic roaming tests with the most important roaming part-
ners need to be performed. How can efforts be reduced?
20 www.keynote-sigos.com
Use Cases > Roaming Testing
The possiblility to travel the world quite easily is perceived as a matter of course nowadays.
Traveling subscribers take availability and proper operation of all mobile services for granted.
Outbound roaming contributes considerable revenue and therefore requires QoS assurance.
www.keynote-sigos.com 21
Use Cases > Roaming Testing
Since the traffic in outbound roaming has a big value for operator revenue, it is impor-
tant to monitor the most frequently visited roaming operators. The GSM Association has
designed the right concept: GRQ.
22 www.keynote-sigos.com
Use Cases > Roaming Testing
Open Connectivity (OC) is replacing approach and real time reporting feature.
multiple bilateral roaming relationships Roaming hubbing providers are often
between operators with a more efficient tasked to actively monitor service avai-
hub-based approach. Open Connectivity lability and service quality on all their
enables multi-lateral roaming and inter- multilateral relations.
working relationships via SMS hubbing
GlobalRoamer allows the activation and
and roaming hubbing.
testing of Roaming Hubbing customers’
Keynote SIGOS’ world-wide, on-demand SIMs. It helps them to work more effici-
test platform caters for roaming hubs. ently to improve the quality of voice, data
It enables them to perform tests of Out- and SMS services for their customers.
bound Roaming services, IREG testing for
Keynote SIGOS’ GlobalRoamer can add
Inbound Roaming, and QoS Monitoring,
value to many aspects of the Roaming
as well as GRQ testing.
Hub business model. GlobalRoamer is an
It improves operational and cost effici- ideal enhancement to hubs.
encies because of the automated test
www.keynote-sigos.com 23
Use Cases > Roaming Testing
Steering of Roaming (SoR) solutions have the VPMN but their subscribed home
been implemented by mobile operators network. Subscribers will also not be able
in order to direct their outbound roamers to benefit from the special roaming retail
to preferred VPMNs in each country. In tariffs that have been offered to them.
some cases just one preferred VPMN in By detecting anti-steering activities, high-
a country is chosen, in other cases SoR er roaming costs can be avoided.
is about managing the proportion of Operators’ primary business goal is to
revenue and traffic shares between two or streamline roaming steering mechanisms
more VPMNs. such that outbound roaming revenues are
optimized while maintaining high levels
SoR is the logical result of roaming/IOT
of end user satisfaction.
agreements which are linked to volumes
and percentages for one or more prefer-
red VPMNs. On one hand it is a significant
commercial matter to detect short- or
long-term deviations from these target VPMN A
distributions, on the other hand it is
worthwhile to test potential deterioration Outbound
Roaming
of customer experience caused by SoR.
ed!
Get the full picture of Detection of Anti-Steering of Roaming is Preferr
VPMN B HPMN
your roaming services essential as operators may lose subscri-
bers to non-preferred networks resulting
Outbound
in margin losses. Anti-steering is not only Roaming
HPMN
MSC/VLR KPIs (examples):
HLR/
Non-Preferred VPMN 1 SoR node Location Update Duration also delive-
AuC
1 MAP messages ring indication of deterioration of end
Location Updating Request
Update Location
user experience
2 Number of PMNs rejected number of
Location Updating Reject UpdateLocation.error
quad attempts or roaming not allowed
3 4x 4x rejects
4 Location Updating Reject UpdateLocation.error List of rejected PMNs non-preferred
PMNs tried
Preferred VPMN 1
5th attempt is on next VPMN; PMN after successful steering also
in this case the preferred PMN indicating successful SoR at all
9 Location Updating Request Update Location LUP mode (automatic/manual) testing
InsertSubscriberData correct behavior of SoR Server for
manual selection
InsertSubscriberData.ack
Reject Causes (i.e. Network Failure,
Location Updating Accept UpdateLocation.ack PLMN)
24 www.keynote-sigos.com
Use Cases > International Carrier Quality Testing
Setting up a call to a subscriber in a foreign country involves the choice of the relevant
international interconnection carrier. How much impact has the interconnection carrier
on QoS? Who is the best interconnection carrier partner?
There is a need for both mobile and fixed By testing international carriers with an
operators to get a global perspective on active monitoring system, you can not
interconnection service quality in order to only monitor if the right calling number
maintain high levels of QoS to subscribers. is displayed abroad but also the voice
The international interconnection quality quality and call setup time, which can be
experience is heavily influenced by the effectively measured and reported.
choice of the international carrier at the
In addition, international carrier quality
national boundary.
testing can be coupled with False Answer
and SIM Box Detection.
KPIs (examples):
Received CLI on destination side
CLI Indicator distinguishing the follo-
wing cases:
CLI from CgPN (“OK”)
No CLI (“N”)
Wrong CLI (“W”)
Mean Opinion Score (PESQ MOS) for Stay in control of com-
Voice Quality (ITU-T P.862.1) munication beyond
Call Setup Time your network
Example of international CLI quality testing
Testing with prefixed called numbers re- For example, if no CLI is received, there
quires knowledge about the current setup would be no possibility to call back and
at the international gateway exchange. poor voice quality would result in short
The deployment of an SS7 LU directly and frustrating conversations.
at the international gateway Exchange
Maximising revenue is essential in an en-
ensures dedicated interconnection carrier
vironment of falling wholesale prices. This
testing.
objective can only be achieved if you have
Poor CLI and voice quality would inevitab- consistently high quality on your network
ly decrease revenue and market share. and on your international interconnection.
International
Gateway Interconnection
Carriers
www.keynote-sigos.com 25
Use Cases > Revenue Leakage & Fraud Detection
“Fraud“ - the word sounds quite exciting when it appears on a cinema billboard or a TV
programme schedule but when it hits you personally, professionally, or in a corporate
environment, it is much less enticing. Fraud will never be completely eliminated but, unless
fraud management countermeasures are undertaken, it is unlikely that it will be reduced to
a manageable level.
The business goal is to gradually “clean” incoming traffic terminating through SIM boxes
by disconnecting all SIM Box numbers detected and to protect the network from any
potential fraudulent upsurge in their use.
SIM
Originating Network SIM Box Terminating Network
Operators
Local Retail rate
(B) 0,10€
Local SIMs are used to terminate GMSC
(A) 0,14€
international incoming traffic BTS
Air interface
26 www.keynote-sigos.com
Use Cases > Revenue Leakage & Fraud Detection
A common phenomenon is the scenario of Early or False Answer during voice call setup
procedures. How do you detect and fight these cases?
Calls are being charged as though con- Fight fraudulent charges to your custo-
nected without ever reaching the called mers’ accounts with GlobalRoamer, the
party, or additional connection time world-wide distributed test infrastructure
charged. The lack of Active End-to-End for end-to-end testing.
monitoring has led to millions of minutes
being inaccurately billed to the origina-
ting calling parties world-wide. These Benefits:
fraudulent billings sometimes go unnoti- Reduce revenue leakage caused by
ced because the incremental billed call early charging / false answers
duration per user may be in the fraction of Ensure billing accuracy and fight
seconds. interconnect fraud
Prepaid SIMs used in GSM Gateways (SIM Improve quality of calls leading to a
Boxes) could lead to false answers when reduction in customer complaints and
dissatisfaction
the fraudulent SIM Box SIM credit has
Active end-to-end monitoring ensures
been consumed resulting in an announce-
consistency in billing
ment being played. In this instance the
caller has to pay for the call connection
leading to customer complaints and dis-
satisfaction with the service rendered.
Identify leaks in your
International carrier(s) releases answer message even though call(s) are not setup revenue stream
Originating Network
(CUSTOMER) Terminating Network
Setup
International Setup
carrier(s)
Answer
Fraudulent early return of Answer message resulting Setup is not even sent to B-Party
in charging record for non-delivered service Call is not established
Unexpected answer on A-side detected and NO incoming setup on B-side
International carrier(s) releases answer message even though call(s) are not setup
Terminating Network CUSTOMER´s SIMs
(CUSTOMER) on Roaming
Setup
Setup International
carrier(s)
Answer
Setup is not even sent to B-Party Fraudulent early return of Answer message
Call is not establised resulting in charging recod for non-delivered
service
Unexpected answer on A-side detected and NO incoming setup on B-side
www.keynote-sigos.com 27
Use Cases > Revenue Assurance
Revenue Assurance
Money makes the world go round – what happens if your
network rating and billing is not correct?
For all network operators validation of Testing that is both end-to-end and inde-
billing is of major importance. Operators pendent can provide the assurance that
must provide fair and accurate billing the customers are being correctly billed
to the customer and also avoid revenue as well as satisfying compliance require-
leakage or overcharges caused by services ments.
being incorrectly rated and invoiced. In
Today, manual tests not only provide in-
most countries accuracy of metering and
accurate, untrustworthy but in most cases
billing is mandatory to comply with legal
cost inefficient testing. To ensure correct
regulations.
billing, a precise and reliable Revenue
As markets have become increasingly Assurance system is essential. With a
competitive, operators have used innova- SITE test system, continuous testing of
tive tariffs, product and service bundles all services provides maximum assurance
and discounts to differentiate themselves. that all calls are being correctly billed as
Complex and fast changing tariffs inevita- each network element can be tested and
bly create challenges in ensuring correct verified.
billing.
28 www.keynote-sigos.com
Use Cases > Revenue Assurance
CDR Testing
Timely detection of revenue leakages
You want a solution which compares CDRs generated by network nodes like the MSC or
SGSN in a highly automated way and sends alarms mismatches.
Filter
Operator CDRs (rated or unrated) SITE CDRs (unrated)
SITE System
Are Core Network nodes like MSC or SGSN generating the right CDR data? Deploy a test
event generator which generates CDRs that you can compare with your network CDRs.
www.keynote-sigos.com 29
Use Cases > Revenue Assurance
Tariff Testing
Proactively monitor tariff plans against variety of test cases
You want a solution which not only compares CDRs but also detects billing errors befo-
re they turn into customer complaints or revenue losses.
Rating Billing
At the heart of the billing system is the Once a CDR has been rated it is applied to
rating engine. This takes the CDRs (call the customer‘s account, where discounts
detail records) or IPDRs (internet protocol can be applied and from which a bill is
detail records) from the network, and created. Operators usually produce bills in
then applies the appropriate rating plans cycles, spreading the load over a month
to turn this information into rated CDRs or quarter and also evening out cash flow.
ready to be associated with the customer.
Within SITE your tariff model can be repli-
cated. Thus, not only the raw data of CDRs
can be compared but in addition also the
correct billing of a service can be verified.
Thanks to SITE, fast regression testing
of new pricing plans against a variety of
test cases can be performed, detecting
potential flaws in the billing process at a
very early stage.
Tariff CDR
Model Post-
processing
Billing
SITE System
Filter
Operator CDRs (rated) Billing Verification SITE CDRs (unrated)
Rating
Tariff Model
Live CDRs Reference
rated CDR Comparison CDRs
Invoice comparison
Resource allocation for different users
or groups
Detailed test reports
Revenue stream audit
Covering billing aspects of outbound
roaming
30 www.keynote-sigos.com
Use Cases > Revenue Assurance
Keynote SIGOS provides a tool to verify Besides using single vouchers (e.g. from
Prepaid SIM Card Recharging. scratch cards) for a single test, Keynote
SIGOS Test Systems support compre-
SITE or GlobalRoamer have the ability to
hensive voucher repository functionality
check if recharging procedures of prepaid
managing numerous numbers.
cards has been performed successfully.
Further customer specific account veri-
Test Cases collect information about the
fication methods (e.g. via SMS) are also
current account balance and establish a
supported on request.
call in the same way a subscriber does.
That means entering vouchers using
DTMF tones for navigating IVR menus or
Sample Features
using USSD commands where supported.
Detection of revenue leaks due to SIM card
After a SIM card recharging attempt the recharging errors
account balance of a dedicated prepaid Increase of customer satisfaction and spen-
SIM card is re-checked and compared to ding due to error free SIM card recharging
balance before recharging attempt. Simplified prepaid SIM card handling in
the central SIM Multiplexer
Sample KPIs
Initial account balance
Account balance after recharge Ensure correct billing,
Used Voucher for recharge for you and your
Received USSD response string customers
USSD process duration
www.keynote-sigos.com 31
Use Cases > Fixed & IP Network Testing
With the explosive growth in the mobility arena, one could almost believe that the
future of fixed networks was doomed. However, fixed networks continue to maintain
their relevance, with technological evolution requiring new test approaches.
With the SITE test system, Keynote SIGOS provides ONE platform for testing all technologies
– fixed, mobile and IP-based, either within one technology or across technologies.
Fixed network operators benefit from SITE through:
Periodic service quality testing
Ad-hoc service quality testing
SITE supports all interfaces required for fixed network testing:
PSTN
ISDN
DSL
IP (VoIP)
Beyond mobile – the
other kind of KPIs for fixed network testing (examples):
telecommunications Delay
Echo Delay
MOS Value
32 www.keynote-sigos.com
Use Cases > Fixed & IP Network Testing
IP Network Testing
Optimize your data network performance
Slow access, error pages and unsuccessful orders? Just started VoIP services? Are you re-
lying on your customers to find out about incidents, availability, speed and load issues?
FTP
KPIs (examples):
SOAP Network Non-Accessibility
KPIs (examples): File Size
Response Time of SOAP Download Duration
server in seconds Upload Duration
IP Service Failure Ratio
www.keynote-sigos.com 33
Use Cases > Core Network Testing
Typical use cases for testing Typical use cases for regression
without radio access part: testing without radio access part:
Interactive Voice Response incl. Automated regression testing after
interactive announcement tests upgrade/updates on:
Testing of Supplementary Services MSC (via GSM A)
Testing of IN Services MSC and fixed network switches
Inside out – core net- Inbound Roaming tests (via ISUP)
work testing can save Load Tests on Core Network SGSN (2.5G) via Gb
money components SGSN via IuCS and IuPS
Billing Testing via CDR tests SMSC, MMSC
Data Content Testing WAP-, Web-, Mail-Server
Handset Simulation SCP testing including IN services
etc. and prepaid services
etc.
ork
ore Netw
Mobile C
Typical advantages of
ore
core network testing:
Mobile C s
o rk Interface Not influenced by radio specific
Netw
problems
Fast execution of mass tests
(e.g. thousands of tests in an hour)
Quick results
Detailed trace analyses with
protocol stack information
see page 2
34 www.keynote-sigos.com
Use Cases > Nomadic & Indoor Testing
Sports and Social Events: Testing campaign of short time frame and short notice.
www.keynote-sigos.com 35
Invest in the future!
Keynote SIGOS
test systems adapt to your demands.
36
The Test Systems
International
Carrier
Testing
Outbound
Roaming Billing Testing
Testing for International
Traffic
World-wide
Handset Specific
QoS Testing
QoS Tools
for Diagnosis & Reporting
GlobalRoamer
The Reference System for world-wide testing
Largest footprint of world-wide test probes
Managed and serviced by Keynote SIGOS
Extensive set of test case applications
Fraud Detection
Revenue
Assurance
Roaming SITE
Central Unit Tool
Testing
SIM
Multiplexer
Clients
LAN / WAN Drive Service
Testing
LU CLU WLU
LU CLU LU CLU
Handset P
Testing Fixed IP Networks Mobile Specific
h GR
QoS Testing wit
B AL
QoS Tools for GLO
Diagnosis & Reporting
GO
SITE
The Unique Test Platform for various technologies
Mobile / Fixed / IP testing
Core Network testing
Globalize with GRP
37
Test Systems > GlobalRoamer
GlobalRoamer
The On-Demand world-wide test platform!
Challenge Solution
End users demand and expect a high GlobalRoamer allows you to verify that all
quality, reliable service from their chosen services are available to your customers
network operator and a similar experience who are traveling world-wide. With test
regardless of where in the world they are. probes in 150+ countries you have your
world wide testing platform without
Therefore, permanent surveillance of the
investing in infrastructure. Just buy your
roaming network is indispensable but
testing package and run your tests world-
extremely difficult due to a lack of opera-
wide.
tional visibility of the roaming partners’
networks.
Managed Services are on offer to all Operators looking for an operationally efficient solution!
38 www.keynote-sigos.com
Test Systems > GlobalRoamer
GlobalRoamer Login
Enter the most extensive global network test system from your desk and gain access to:
GlobalRoamer Location
GlobalRoamer Country
Location comming soon
November 2010
www.keynote-sigos.com 39
Test Systems > GlobalRoamer
Networks Countries
40 www.keynote-sigos.com
Test Systems > GlobalRoamer
Use Cases
Service Quality in outbound roaming Revenue Assurance in an international Use Cases for
(on-demand testing / periodic testing) context GlobalRoamer
Full range of QoS applications CDR Comparison, Roaming Tariff
(Voice / SMS / Data) (page 14) Model Testing (page 28)
International
Carrier
Testing
Outbound
Roaming Billing Testing
Testing for International
Traffic
World-wide
Handset Specific
QoS Testing
QoS Tools
for Diagnosis & Reporting
www.keynote-sigos.com 41
Test Systems > SITE
SITE
One platform for all your End-to-End test requirements
Challenge Solution
Today, network operators are confronted Keynote SIGOS has developed the most
with an extremely dynamic market and advanced automated test system available
the challenges of keeping up with new on the market. SITE is the proven and flexi-
technology, permanent surveillance of ble test platform for cost- and time-saving
Service Level Agreements (SLA) and redu- automated Active End-to-End testing.
cing cost – whilst also maintaining custo- With SITE, telecommunication operators
mer satisfaction. Since these tests can be all around the world benefit from its
both, labor-intensive and costly they are unique versatility. SITE’s modular structure
too often neglected. To meet these chal- and scalability ensure it can always be
lenges preventive and permanent Service matched exactly to your requirements. In
Quality Assurance by means of End-to-End addition, your local SITE system can go
testing is essential. global by connecting to the world-wide
GlobalRoamer probes with our ‘Global
Resource Pool’ feature – all in one go!
Why SITE?
Why Automated Active Testing and Monitoring with SITE?
Get the full picture of your end users’ Identification and localization of
experience (QoE) and act, instead of service and network can be achieved
reacting to customer complaints before actual service degradation and
Continuously monitor service threat of revenue losses
availability, test and measure quality Reduced time and risks to install or
(KQI) and performance (KPI) modify network infrastructure by
Upfront testing ensures a smooth providing extensive recursive testing
roll-out for new services and new capability
technologies Reduced operating costs by
Initiate reproducible test cases which automating monitoring, testing, and
cannot be done with passive reporting; increased personnel
monitoring solutions efficiency; costs not correlated with
Comprehensive network diagnosis, network size and growth
reporting and alarming Number of test cycles is flexible
Services can be tested before
commercial release
42 www.keynote-sigos.com
Test Systems > SITE
Open, Modular and Customizable – Just the Right System, Always What is SITE?
SITE is an open system and can be easily integrated into existing test environments
Existing equipment can be directly linked to SITE and controlled and monitored
through the SITE system
Software updates, configuration modifications and problem resolution are quickly
and reliably performed by Keynote SIGOS
SITE’s modular structure – software and hardware – guarantees maximum
flexibility in service and protocol testing
From portable and Stand-Alone Systems in test laboratories to distributed systems
covering the geography of an entire live network, everything is possible
Fraud Detection
Revenue
Assurance
Roaming SITE
Central Unit Tool
Testing
SIM
Multiplexer
Clients
LAN / WAN Drive Service
Testing
LU CLU WLU
LU CLU LU CLU
Handset
Testing Fixed IP Networks Mobile Specific
QoS Testing
www.keynote-sigos.com 43
Test Systems > SITE
How does it work? Central SIM Multiplexing Technology – an Unparalleled ‘Teleporter’ for SIM Cards
SIM cards are centrally hosted and virtually transmitted to any of the system’s remote
test stations where the actual test is performed.
SITE can handle thousands of SIM, USIM or Micro-SIM cards in cascade-style boards.
Subscriber information from a SIM card is read out by the system and transmitted via a
LAN/WAN network to any test location required.
The SIM authentication procedure is handled virtually between the wireless interface in
any location and the real SIM stored in the central SIM Multiplexer unit.
44 www.keynote-sigos.com
Test Systems > SITE
P
h GR
L wit
A
LOB
G OG
www.keynote-sigos.com 45
Test Systems > SITE > Hardware Components & Interfaces
Central Unit
This is the base of the whole Keynote
SIGOS Test System SITE. Everything impor-
tant is integrated: O&M Manager, Schedu-
ler, Resource Manager and Test Execution
Manager. 19” (rack mount)
100 V - 240 V, max 8A – 4A, approx. 450 W
Central Unit Extensions (CUX) are impor-
tant to give the possibility to increase the
Main Hardware number of parallel running test cases.
Components
SIM Multiplexer
The SIM Multiplexer has an unlimited
capacity to handles thousands of SIM cards
at various locations all over the world.
Any SIM authentication procedure is SIM Server 100-240 V 1A, 50/60 Hz
handled virtually between the wireless Low power consumption
interface in any location and the real SIM
Compact design, only 3HU
stored in the central Multiplexer unit.
Compatible for SIM, Micro SIM, USIM,
R-UIM
SIM Card Board
Automated voltage negotiation for
each SIM card position
Remote Components
The remote units, also called local units,
are installed wherever they are needed for
2G, 2.5G and 3G or core network tests.
Local Units for fixed and stationary usage:
Local Unit (LU)
Compact Local Unit (CLU)
SS7 Local Unit (SS7 LU)
Gb Local Unit (Gb LU)
IU Local Unit (IU LU)
ISDN PRI Local Unit (ISDN PRI LU)
Remote Components / Wireless Local Unit (WLU)
Local Units
Local Units for mobile usage:
Mobile Local Units (MLU);
12V DC, 5A, typ. 40W
incl. internal SIM Multiplexer
incl. GPS module
Nomadic Probe:
12V DC, 2A, typ. 20W
incl. internal SIM Multiplexer
incl. GPS module
46 www.keynote-sigos.com
Test Systems > SITE > Hardware Components & Interfaces
Test Interfaces
Keynote SIGOS’ SITE Test System supports
the whole range of today’s telecommu-
nication networks. Testing them needs
multiple interfaces which are integrated in
the SITE systems.
Sample interfaces:
3G UMTS/HSPA+ and
2G GSM/GPRS/ EDGE
Voice & Data & Fax
Supported frequency bands:
850/900/1900/2100 MHz
Downlink up to 21.1 Mbps
Uplink up to 5.76 Mbps
SS7 / GSM A, ISUP:
4 E1 (2048 MBit/s) trunks (RJ45
connectors), Impedance of 120/ 75
Ohm balanced/unbalanced
Iu over IP:
based on Ethernet IP,
4 x Ethernet Interface 10/100 Sample Interfaces
Gb over IP:
based on Ethernet IP,
4 x Ethernet Interface 10/100
Gb over E1/T1:
4 E1 (2048 MBit/s) trunks (RJ45
connectors), Impedance of 120/ 75
Ohm balanced/unbalanced
CDMA2000 1X / EV-DO
Supported frequency bands:
800/1900 MHz
ISDN S0:
B-Channel Protocols: like HDLC
X.75, X.25, T.30, V.90,V.120…
D-Channel Protocols: like ETSI-DSS1,
NI-1, CT1, VN3, 1TR6, INS-64, 5ESS, Q-Sig
ISDN S2m:
B-Channel Protocols: like HDLC
X.75, X.25, T.30, V.90,V.120…
D-Channel Protocols: like ETSI-DSS1,
NI-1, 1TR6, NET3, VN3/4/6, INS-64,INS-
1500…
PSTN a/b:
ITU-T Modem Compatibility,
Fax Compatibility
All Components:
Developed by Keynote SIGOS, made in Germany.
www.keynote-sigos.com 47
Deliver high performance!
48
The Test Tools
On SITE and GlobalRoamer
Diagnosis Tools
> Service Alarm Map
> 3G Layer 3 Tracing
49
Test Systems > Test Tools > Reporting & Alarming
SITE and GlobalRoamer Reporting enables Flexible standard charts and diagrams
users to create, view and forward multiple as well as enhanced functionalities like
reports. These reports are generated from “percentile”, “ad hoc reporting” and “derive
measurements collected in the report to” can be immediately generated from
database. These reports can either be recorded KPI data.
based on Keynote SIGOS standard Key
Real time alarming is also embedded:
Performance Indicators (KPIs), on KPIs ac-
resulting alarm notifications are automa-
cording to ETSI standards or on individual
tically distributed via SMS, e-mail, SNMP,
customized KPIs.
etc. to defined recipients. Users can define
Report creation is done by means of an threshold-settings, counters, severity
easy drag-and-drop arrangement. SITE triggering points, etc. which control when
and GlobalRoamer Reporting offers the alarms should be generated or cleared.
possibility to visualize test results using Reports can be illustrated in different
various graphical tools, serving even very ways, either charts in various formats;
specific presentation and monitoring markers, bars, lines etc, or by matrix tables
needs. to provide a fast color coded overview of
vital services or specific KPIs.
Online
Reporting
Test Execution on different locations
real time
Reporting reporting
Alarming
alarming
Test Executions
Post
Reporting
Report
Definition
Raw-Measurements Measurements KPI Database
(Input and Output) Strategy / KPI design
All solutions of SITE and GlobalRoamer Reporting allow the users to observe KPI perfor-
mance in an optimal way: analysis of trends / analysis of incidents based on locations or
based on service problems.
50 www.keynote-sigos.com
Test Systems > Test Tools > Reporting & Alarming
Dashboard
This Graphical User Interface (GUI) system
tool provides a simplified intelligent
interface to SITE and GlobalRoamer repor-
ting. It is of special interest to the people
responsible for the service, who want
to work intuitively without any training
effort. KPIs can easily be filtered and indi-
vidually stored in a few clicks. Individual
configurations allow additional, more
customer-oriented, data analysis. Fast
and easy drill down to individual traces is
possible directly from the Dashboard.
Matrix Report
The Matrix Report environment allows the
user to view Key Performance Indicator
(KPI) data as a numerical value, which can
be easily color coded to provide a quick,
easy to understand overview of network Dashboard
performance. Service KPIs can therefore Matrix
be displayed in a format which is espe-
GIS
cially useful for Network Management
and Operations personnel.
GIS
For service testing “on the move”, a map
based Geographical Information System
(GIS) is integrated into SITE.
Each drive test case collects position data
from a GPS receiver during „visibility“ of
GPS satellites. These are displayed in a GIS.
This means that after service testing a rich
set of KPIs according to GPS data can be
locally analysed displayed on geographic
maps.
www.keynote-sigos.com 51
Test Systems > Test Tools > Test Creation Tools
52 www.keynote-sigos.com
Test Systems > Test Tools > Diagnosis Tools
Diagnosis Tools
Keep the overview or go into details!
Traces
SERVICE View
Drill Down
With Service view you get
an easy high level overview Service Alarm Map
about the status of the whole 3G Layer 3 Tracing
network.
DETAILS View
The Details view is accessed via
single network elements of the
DETAILS View
Service view. It shows exactly
SERVICE View which test case leads when to
which failures.
3G Layer 3 Tracing
Deeper insight into message flow with 3G Layer 3 tracing
Keynote SIGOS offers 3G Layer 3 tracing The information contained in these traces
which is very important for telecommuni- is vital for monitoring and troubleshoo-
cation network testing. The primary goal ting the communication between mobile
is to get a deeper insight into the messa- station and core network.
ge flow and the protocol data exchanged
Optionally, the NAS traces are supplemen-
between mobile station and network.
ted with traces of Radio Resource Control
On Qualcomm-based 3G mobile probes (RRC) signalling messages exchanged
Keynote SIGOS records traces of the Layer between the mobile and the 3G radio
3 Non-Access Stratum (NAS) signalling access network. These RRC traces provide
messages sent and received by the mobile. valuable additional information, facilita-
ting monitoring and troubleshooting of
the Access Stratum (AS) as well.
www.keynote-sigos.com 53
Always at your service!
54
The Test Applications
Network Registration
> Location Update
> GPRS Attach
Messaging
> SMS
> MMS
> Mobile IM
Data
> Data IP
> E-mail
> WAP / Web Browsing
Video
> Video Telephony
> Video Quality
> Streaming
55
Test Systems > Applications > Network Registration
Network Registration
Fundamental for all mobile services!
56 www.keynote-sigos.com
Test Systems > Applications > Network Registration
www.keynote-sigos.com 57
Test Systems > Applications > Voice
Voice Services
The basic elements for telecommunication!
Voice
Do not ignore your core services!
Voice services are fundamental to tele-
communications companies. It is vital
that the user experience of these services
is measured continuously by active test-
ing. Only this can assure the quality
of this core service.
Verification of various KPIs are performed
on basic voice parameters, such as check-
ing B-channel availability, measuring call
establish duration and call success rate
alerts, to name a few.
Sample Features
CLI Check
Call establishment to external party
Sample KPIs Call establishment between two parties
Call Duration Call establishment without answer on
Received CLI external side (no connective costs)
Establish Duration B-Channel check
Alert Duration Check of all available PLMNs
Voice
Push-to-Talk
Interactive Voice Push-to-Talk
Response
Back to the Future with Push-to-Talk!
Suppl. Services
The “push-to-talk” services turn mobile
phones into walkie-talkies with unlimited
range.
The benefit of radio-style communication,
especially broadcasting to multiple users,
makes it much more convenient than
making many phone calls or even call
conferencing.
Sample Features
Test 1-to-1 or 1-to-many communication
Sample KPIs Play and record speech data
Emulating PTT mobiles
Stop-Talking Timer Failure Ratio
Real End-to-End Testing of
Stop-Talking Time
real-time-always-on voice service
Session Cut-off Ratio
Check SIP (Session Initiated Protocol)
Session Setup Time Control Plane
Voice Delay (in session) Check RTP (Real-time Transfer Protocol)
Voice Delay (first) User Plane
Photo © T-Mobile AG
58 www.keynote-sigos.com
Test Systems > Applications > Voice
Voice
Push-to-Talk
Supplementary Services
Interactive Voice
Compliments on your supplementary services? Response
Supplementary services like call forwar- services, including notifications and Suppl. Services
ding, call waiting, call barring, call hold, coding of all relevant information are
CLIP/CLIR are multi-switched services vital for a satisfying end-user experience.
which require complex interaction
Keynote SIGOS Test Systems provide you
within the network and its elements.
with a comprehensive range of test cases
Other supplementary services, like pre- for all relevant KPIs and the ability to
paid customers checking their current ac- test USSD protocol commands as well as
count balance, involves the GSM protocol operator specific extensions, so that your
USSD (Unstructured Supplementary Ser- customers will pay you compliments on
vice Data). At the same time, seamless and your supplementary services!
instant operation of all supplementary
www.keynote-sigos.com 59
Test Systems > Applications > Voice Advanced
Voice Advanced
Do you offer excellent Voice Quality?
Sample KPIs
Echo Return Loss (ERL) in dB
Echo Delay in ms
Echo Classification
(acceptable, unacceptable, side tone)
60 www.keynote-sigos.com
Test Systems > Applications > Voice Advanced
Sample Features
Perceptual analysis of degradations in Sample KPIs
voice signals
3SQM MOS value
Non-intrusive, single ended
analysis method Noise level
Output score correlates well with Background noise
subjective MOS Beeps
Available as DLL/Library or Source Signal to noise ratio
Voice Quality
Voice over IP Quality Testing Referenced VQ
(PESQ)
Voice Quality is vitally important for any
type of network that routes voice traffic. Unreferenced VQ
With the shift from dedicated circuits to (3 SQM)
the efficiency of IP based traffic, it brings Echo Testing
its inherent issues with regard to the Voice over IP
end customer’s satisfaction with quality Quality Testing
performance.
Additional PESQ KPIs such as Real-time
Transport Protocol (RTP), Jitter and Packet
Loss are actively monitored.
Performing checks on a comprehensive
set of voice quality metrics ensures that
IP networks run smoothly and problems
Additional KPIs
are detected before they cause major
RTP Jitter
disturbances leading to customer dissatis-
RTP Packet Loss
faction.
www.keynote-sigos.com 61
Test Systems > Applications > Messaging
Messaging
Are your Messaging Services delivered reliably and on time?
Sample Features
SMS Check functionality of SMSC
Check SM Service functionality at
MMS
peak times
Mobile IM Check SMS transmission time
Sample KPIs
SMS send duration
SMS deliver duration
SMS end-to-end duration
SMS Success ratio
62 www.keynote-sigos.com
Test Systems > Applications > Messaging
Mobile IM SMS
Can your customers chat via Mobile Instant Messaging? MMS
The real time text based communication Mobile IM
between two or more participants is po-
pular on PC devices, e.g. Skype, ICQ, MSN,
Yahoo, Google… etc. This instant mes-
saging platform has made the leap from
the PC to the mobile device, connecting Sample Features
friends, peers and colleagues while they Registration at the IM server
are on the go. Successful login
“Get presence”-information of other users
To get connected to either fixed or mobile
and whether two parties can “see” each
IM users, Java applets are installed on other
mobile devices delivering branded IM Text message receipt from IM server
user interfaces. A single device client may Successful logout from the IM server
provide access to multiple IM systems
which transmit and receive presence Sample KPIs
information. Time of OMA IM Login Request
Session ID given from IM server
The device clients have to be compliant
Time when a party sends the message
to the Open Mobile Alliance (OMA) Instant
Messaging and Presence Service (IMPS). Time of OMA IM Logout Request
www.keynote-sigos.com 63
Test Systems > Applications > Data
Data
Boost your trusted data communication!
Data IP
Do you meet your subscribers’ demands with GPRS, EDGE, UMTS
and HSPA Data Services?
Over the Air (OTA) IP data services offer To increase revenue and service quality,
subscribers a highly effective way to SITE and GlobalRoamer offer data tests
connect to a dynamically rich world to access all available technologies via
filled with internet based services such dedicated interfaces to discover service
as Email, Instant Messaging, websites, performance and functionality problems.
VoIP and much more.
GPRS represents the first step towards
faster access provided via EDGE, UMTS,
HSPA (HSDPA / HSUPA). To maintain this
flexibility in speed, network operators
have to deal with the operation and
maintenance of multiple technologies.
This complexity drives up costs.
64 www.keynote-sigos.com
Test Systems > Applications > Data
E-Mail
Modern life is unthinkable without E-Mail!
Subscribers not only need voice commu-
Sample Features
nication, they also want be in contact with
Mobile E-mail upload and download from
friends and colleagues via mobile E-mail. an E-mail server
In order to gain acceptance as a reliable
Interfaces: GSM Um, GSM Gb, 3G UMTS Uu
service frequently used by the subscri- or Iu PS
bers, network errors must be avoided and SMTP server
uncovered by performing active conti-
POP3/IMAP server
nuous tests.
Sample KPIs
The question is, whether mobile E-mails
Mobile E-mail address
are delivered on time to the receivers’
Mobile E-mail size
designated email addresses.
Mobile E-mail fetch duration
Keynote SIGOS Test Systems provide Mobile E-mail send duration
E-mail testing via multiple interfaces, like Mobile E-Mail End-to-End Transaction
GSM Um, GSM Gb, 3G UMTS Uu or Iu PS. Time with Notification
It can be checked whether a mobile E-Mail Mobile E-mail success ratio
can be sent and received via a POP3 / IMAP /
SMTP server. The mobile E-Mail would be
sent via Simple Mail Transfer Protocol
(SMTP) to an E-Mail server and fetched via
Post Office Protocol version 3 (POP3) or
Internet Message Access Protocol (IMAP).
Data IP
E-Mail
Web / WAP Browsing
www.keynote-sigos.com 65
Test Systems > Applications > Video
Video Services
Provide your customers more than moving color pixels!
Video Telephony
Do you provide reliable video telephony in 3G UMTS?
High quality for Video Telephony using 3G The implementation of this technology
UMTS is an absolute must, without which often involves complex interaction bet-
it is used perhaps once, and then never ween network nodes supplied by diffe-
again by your subscribers! rent manufacturers and therefore cons-
tant automated testing should be applied
The premium cost paid for the use of
to check initial configurations, and then
UMTS service will most often increase
provide active continuous monitoring of
customer‘s expectations regarding quality
the service.
of service rendered.
Due to competitive pressure, it is man-
datory for wireless service providers to
increase their subscribers’ average reve-
nue quickly by successfully launching new
services such as video telephony.
At the same time, they must maintain the
consistent high quality their customers
have come to expect.
66 www.keynote-sigos.com
Test Systems > Applications > Video
Video Quality
Is your network Video Quality excellent?
3G UMTS opened a world of possibilities
with multimedia applications. Customized Sample Features
infotainment like streaming video, video Testing IVR trees Real End-to-End Testing
of real-time video services (video telephony,
messaging, mobile TV and video telepho-
video streaming, video messaging)
ny offer a unique opportunity to create a
Objective MOS Video Quality result values
market for highly personalized and truly
from 1 - 5 (1-bad, 2-poor, 3-fair, 4-good,
inimitable mobility services. For mobile 5-excellent)
customers the quality of services is decis-
PEVQ analysis is based on human model
ive for acceptance; especially for motion of visual perception
picture based services, quality is the key
factor of success. Sample KPIs
Keynote SIGOS Test Systems deliver MOS value
perceptual quality measurements to Delays
reproduce subscribers’ quality impressi- Brightness
on mapped to the mean opinion score Contrast
(MOS), similarly to other quality tests. Distortion indicators
Be sure that your network’s new multi-
media applications are more than just
moving color pixels.
Streaming
What about your Streaming service? Video Telephony
Video Quality
Today, almost every major event, e.g.
sport, news or society events can be Sample Features Streaming
accessed via real-time multimedia streams Parallel subsessions per stream,
on a mobile phone. These multimedia e.g. video and audio
applications become more and more Send streamed multimedia over IP
important in the wireless and mobile TCP or UDP transport protocols
community. Measurement interval in multiple
of 100 milliseconds
To make sure that customers can enjoy
Used industry standard RTP/RTSP
these exciting premium services, it is most
important to guarantee an impeccable Sample KPIs
streaming service. Using the industry
RTSP packets loss percent video
standard protocols RTP and RTSP, the Key-
RTSP packets loss percent audio
note SIGOS Test Systems are up-to-date
RTSP packets received video
with the latest technology. Scheduled
and continuous active testing ensure that RTSP packets received audio
multimedia streams deliver the desired
contents and the required quality even to
the largest possible groups.
www.keynote-sigos.com 67
Test Systems > Applications > Value Added Services
68 www.keynote-sigos.com
Test Systems > Applications > Value Added Services
Value Added
Services
Digital Rights
Management
www.keynote-sigos.com 69
Test Systems > Applications > Handset Oriented Testing
BlackBerry
Your network`s sweetest fruit
BlackBerry is today’s leading wireless
connectivity solution for a large number
of mobile business professionals found in
enterprise and governmental organiza-
tions world-wide.
It allows users to stay connected with
secured wireless access to e-mail, cor-
porate data, calendar and web, to easily
manage all their communication and
information from a single BlackBerry
device whenever and wherever requi-
red. BlackBerry eliminates the hassles of
dialup by moving mobile data to a “push”
architecture.
Sample Features
Especially for mobile professionals, it is
Real End-to-End testing of BlackBerry
vital that the network operator provides
‘push’ service
the highest levels of quality and reliability.
Testing carried out using a commercial
BlackBerry device
Check sending and receiving e-mails
Sample KPIs
BlackBerry Check the BlackBerry device integrated
Send time
email features
iPhone Receive time
Using BlackBerry devices with a java
Handset Simulation Round trip time application for reflector code – for
Battery level of the device sending emails
Battery temperature of the device Management notification and reporting
iPhone
Up with the hype on iPhone tests
For many users, the iPhone and the 3G Operators around the world specify this
iPhone represents a new era of mobile group of iPhone users as high-tech – high
phone interaction and services. potential customers with distinctive tech-
nology and quality demands. The unique
The unique combination of multimedia
services offered for this iPhone customer
content, intuitive multi-touch display
base like the Visual
controls, accelerometer and much more
Voice Mailbox
created strong demand for new opera-
create additional
tor services dedicated only for a unique
quality process
group of users.
demands at
each network
operator.
Photo © T-Mobile AG
70 www.keynote-sigos.com
Test Systems > Applications > Handset Oriented Testing
Sample KPIs
Duration
Failure Rates
Handset Simulation
Do handsets work perfectly in your mobile network?
The opportunity for mobile operators
to sell exciting new mobile content and SITE tests specific handset characteristics
handsets is enormous, but the variety against network services and device
of available services like MMS, Video specific monitoring of pages with fixed
Streaming and Web Browsing may cause content/ URLs. The following important
problems when using different handsets. content questions are validated:
BlackBerry
How can these new devices and services Color Support: Check if device is capable
be properly tested in a cost-effective way of displaying colored images iPhone
that ultimately leads to increased revenue Image Size: Comparison of all downloa- Handset Simulation
and customer satisfaction? ded images with maximum height and
We can help you with a powerful tool to width of the device
test all your services, simulating the large Content Support: Check (based on HTTP/
variety of handsets in your network. No WTP accept header) if device can decode
labor intensive and high-cost manual downloaded content
testing! Data Format: Check if the downloaded
content is valid
Sample Features
Intuitive Recording of browsing actions
No drag ‘n’ drop anymore
Support of HTML forms
Easy creation and adaptation of browsing
sessions
Received page content at a glance
KPIs for each browsing action
User defined measurements / KPIs can be
added with ‘Test Case Editor’
Whole session can be ‘Replayed’ during
development to evaluate the test case
www.keynote-sigos.com 71
We take load off your shoulders!
72
The Professional Services
Managed
Services
Training Consulting
Services
73
Professional Services > Managed Services
Managed Services
We take the load off your shoulders!
– Flexible and Customizable
74 www.keynote-sigos.com
Professional Services > Managed Services
www.keynote-sigos.com 75
Professional Services > Consulting Services
Consulting Services
Customized for all your specific needs!
Support
SITE Warranty Fax to Keynote SIGOS Support
E-mail Support - A fast and reliable way Keynote SIGOS Trouble Ticket System
to get clear answers and step-by-step (WebRDDB) – Web based access for
instructions should you experience monitoring customer ticket status
problems online
Support Hotline – direct communication
with Keynote SIGOS professionals
(Monday – Friday during business hours
(CET); 24/7 for premium service
subscribers)
76 www.keynote-sigos.com
Professional Services > Project Management & Implementation
www.keynote-sigos.com 77
Professional Services > Training
Training
Wherever you want, with specially trained experts!
Reporting &
Diagnosis
- Advanced
User Training
- Advanced
Administrator Test Case Editor
Reporting & Diagnosis - Base Training Training
78 www.keynote-sigos.com
Index
Index
Keyword Page Keyword Page
3 G Layer 3 Tracing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
3SQM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Network Structure (of SITE) . . . . . . . . . . . . . . . . . . . . . . . 2
Alarming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 Nomadic Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 Open Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Billing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Outbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
BlackBerry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 Performance Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Carrier Quality Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 Periodic QoS Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
Carriers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75 PESQ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
CDR Comparison Testing . . . . . . . . . . . . . . . . . . . . . . . . . 29 PEVQ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Central Unit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Compact Local Unit (CLU) . . . . . . . . . . . . . . . . . . . . . . . . 46 Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Consulting Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Project Engineering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Content Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 Project Implementation . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Control Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Project Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Core Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Push-to-Talk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Dashboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 QoS Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Data IP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 Regression Test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 Regulators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Digital Rights Management . . . . . . . . . . . . . . . . . . . . . . 69 Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Revenue Assurance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Early Charging Detection . . . . . . . . . . . . . . . . . . . . . . . . . 27 Revenue Leakage & Fraud Detection . . . . . . . . . . . . . 26
Echo . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Ring back tone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Email Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 Ring tone download . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Engineering Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . . . . . 23
Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . . . . . 24
Fraud Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Roaming Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Gb Local Unit (Gb LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Senior Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76
GIS (Geographical Information System) . . . . . . . . . . . 51 Service Alarm Map . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
Global Ressource Pool (GRP) . . . . . . . . . . . . . . . . . . . . . . 45 Service Quality Monitoring . . . . . . . . . . . . . . . . . . . . . . . 14
GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 SIM Box Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
GPRS Attached . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 SIM Multiplexer (Hardware) . . . . . . . . . . . . . . . . . . . . . . 46
GPS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 SIM Multiplexing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
GRQ Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
GSMA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 SITE Recorder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
GUI (Graphical User Interface) . . . . . . . . . . . . . . . . . . . . 51 SLA Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . . . . 70 SMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Handset Simulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 Speech . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 SS7 Local Unit (SS7 LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
Hotline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Strategic Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76
Inbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Streaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Indoor Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 Supplementary Services . . . . . . . . . . . . . . . . . . . . . . . . . 76
Interactive Voice Response (IVR) . . . . . . . . . . . . . . . . . . 59 Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Interconnection Carriers . . . . . . . . . . . . . . . . . . . . . . . . . 39 System Hosting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 Tariff Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
International Carrier Quality Testing . . . . . . . . . . . . . . 25 Test Call / Event Generation . . . . . . . . . . . . . . . . . . . . . . 28
International Gateway . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 Test Case Editor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
IP Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
iPhone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 Test Infrastucture Management (TIM) . . . . . . . . . . . . . 74
IREG 24, 26, 27, 29, 32, 35, 50, 60 . . . . . . . . . . . . . . . . . . 20 Test Operations Management (TOM). . . . . . . . . . . . . . 74
ISDN PRI Local Unit (ISDN PRI LU) . . . . . . . . . . . . . . . . . 46 Test Sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Local Unit (LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Test Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Location Update . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
lu Local Unit (lu LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Value Added Services (VAS) . . . . . . . . . . . . . . . . . . . . . . 68
Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Managed Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Video Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Matrix Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 Video Telephony . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
MMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63 Voice over IP Quality Testing . . . . . . . . . . . . . . . . . . . . . . 61
Mobile Instant Messaging (Mobile IM) . . . . . . . . . . . . 63 Voice Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
Mobile Local Unit (MLU) . . . . . . . . . . . . . . . . . . . . . . . . . . 46 WAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
Mobile Network Operators . . . . . . . . . . . . . . . . . . . . . . . 39 Warranty. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76
Mobile Virtual Network Operators (MVNO) . . . . . . . . 39 Web Browsing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
Wireless Local Unit (WLU) . . . . . . . . . . . . . . . . . . . . . . . . 46
www.keynote-sigos.com 79
More than 200 operators rely on Keynote SIGOS solutions.
mers
custo
d e
wi
-
ld
or
ur w
Some of o