Tems Investigation Test Procedures

TEMSINVESTIGATION TESTPROCEDURES

Drafted by: Reviewed by: Reviewed by: Reviewed by: Approved by: Ufuk Yurtsever Kerem zyetkin Orhan Uzgidim Zaid Salman Ufuk Yurtsever Date: Date: Date: Date: Date: 12.01.2008 21.05.2008 23.05.2008 26.05.2008 27.05.2008

OPTIMUMNETWORKSOLUTIONSINC.

Optimum Network Solutions Inc. 1

Tems Investigation Test Procedures

CONTENTS: 1 INTRODUCTION 2 SETTINGUPTHEEQUIPMENT 3 SETTINGUPTEMSINVESTIGATION 4 GSMVOICECALLS 5 SCANNERMODE 6 DEDICATEDMODE 7 IDLEMODE 8 GPRSTESTS 9 HOTSPOT(LANDMARK)TESTS 10BENCHMARKTESTS 11SINGLESITECHECK 12GLOSSARY

Optimum Network Solutions Inc. 2

Tems Investigation Test Procedures

1INTRODUCTION:
This document is prepared to be used as a manual while preparing for and performingaGSMand/orGPRSEDGEtestbytheDriveTestEngineer/Technician. The drive test tool described throughout this document is TEMS Investigation version7.1.3and8.1.3 By completing this document, reader will be able to setup a drive test kit, to performaGSM,GPRS,Hotspot(Landmark),SwaporBenchmarkdrivetest.

TypicalDTSetup Optimum Network Solutions Inc.

Tems Investigation Test Procedures

2SETTINGUPTHEEQUIPMENT
Inordertobereadyforadrivetest,thefollowingequipmentshouldbeready: 1. AlaptopPCwithatleastoneUSBport.(mandatory) 2. AUSBHUB(1to4)(preferablyaPCMCIAExpressUSBhub) 3. TEMSInvestigationSW(7.1.3and8.1.3areusedasoftoday)(mandatory) 4. TEMSInvestigationDongle(mandatory) 5. An MS compatible with TEMS SW i.e. Sony Ericsson W600i, K600, K790, K800..(mandatory) 6. DatacablefortheMS(mandatory) 7. A GPS (Garmin Etrex Legend, Delorme), GPS shall have NMEA 0183 interface.(mandatory) 8. RS232toUSBConverter(ifGPSinterfaceisRS232) 9. ExternalantennaadapterfortheMS(ifneeded) 10. ExternalantennafortheMS(ifneeded) 11. CarHolderfortheMS(optional) 12. Inverter(tosupplypowerforPCduringthetest)(mandatory) 13. Asimcardfortheoperatortobetested(mandatory,exceptscannertest)

ExternalAntennaAdapter

PCMCIAExpress4portUSBHUB

Car HolderforK790

0dBGainExternalAntenna

Optimum Network Solutions Inc. 4

Tems Investigation Test Procedures

3SETTINGUPTEMSINVESTIGATION7.1.3:
ThefirstthingtoknowisthecommunicationporttotheMSisconnected,thewaytodo thatisbyopeningdevicemanagerandlookingfortheconnectedmodems.Afterfinding thecorrectmodemrelatedtoourphone,gotoproperties,advancedtab,andadvanced portproperties. Thebelowpicturedepictsthisprocess,aseasilyseenthecomportforthemodemhere isCom13.

SearchingforthecorrectComportforthePhoneModem. NextstepisopeningTEMSInvestigationprogram.Therewillbetwoconsecutiveportsin theTEMSPortConfigurationwindow,intheCtrl&ConfigTab.Thesmallerportwillbe assignedtoDC(DataCable)andthebiggerportwillbeassignedtoMS(MobileStation)

Belowistheexampleforthatprocess:

Optimum Network Solutions Inc. 5

Tems Investigation Test Procedures

3.1SETTINGUPTEMSINVESTIGATION8.1.3:
ByconnectingtheUSBcabletothePC.MSwillbeassignedasMS1andDCwillbe assignedasDC1automatically.(Thereisnoneedforportconfiguration(manually)) Belowistheexampleforthatprocess:

Afteridentifyingtheequipment,MS1,DC1,GPS,thetestcanbestarted.

Optimum Network Solutions Inc. 6

Tems Investigation Test Procedures

4GSMTESTS:
AnMSisalwaysinCSModewhenperformingVoiceCall.Thestepsofanordinary GSMVoiceCallislistedbelow: 1. IdleMode(MSisnotinacall,onlycellreselectingalongtheway) 2. CallInitialization(Numberdialled) 3. CallAttempt 4. DedicatedMode 5. CallSetup 6. CallEstablished 7. Handover 8. Callend 9. IdleMode

GSMVoiceCallSteps. InGSMtestsMScanbeusedindifferentmodes: ScannerMode DedicatedMode IdleMode

4.1SCANNERMODE:
Inscannermode,weusuallygiveanumberoffrequenciestobescannedbyMS.e.g. inVodafonenetworkitis2130,4079. LetsgooverthestepstosetupanMSinscannermode.Firstofall,thereisnoneed touseaSIMcardforanMStobeusedinscannermode.AfterconnectingtheMSto TEMS investigation we will use this button ( tested.Thebelowwindowopens:

) to enter the frequencies to be

Optimum Network Solutions Inc. 7

Tems Investigation Test Procedures

CheckdecodeBSIC,andclickchannelselection.DecodedBSICinformationisusedfor identifyingthetransmittingbasestation

Asdepictedaboveenterthefrequenciestobetested,e.g.thistimeitisentered21 30,4079forBCCHcarriersofVodafone. Afterthatclickthisbutton( )tostartscanning.Whenyouchoosescannertabin TEMSInvestigationthebelowscreenappears.

Optimum Network Solutions Inc. 8

Tems Investigation Test Procedures

As illustrated above, you can see all the frequencies under test from strongest to weakestatthetopwindow,allfrequenciesfrom21to79inthenumberorderonthe middlewindowandtherespectivesignalstrengthsofthestrongestfrequencieson thebottomleftwindow. Onlythingleftistopushtherecordbuttonandstartfrequencytestwhilerecording thelogfiles.ThismodeisusuallyusedinLandmark(Hotspot)tests.

4.2DEDICATEDMODE:
In dedicated mode, MS performs a voice call; there are two types of DEDICATED MODEcallsgenerallyacceptedlongcallandshortcall.

4.2.1LongCall:
Theusualwaytostartandstopthecallsmanually,butitisrecommendeddoitisby preparing a command sequence (with long call Duration) in order to automatically startandstopvoicecalls. Alsomostoftheoperatorsusuallyaskfordefinitecalldurationduringthetests. InlongcallMSperformsacallcontinuousduration,someOperatorsaskforalong callthattheMSperformsacall(like15minutes)andwaits15secondstostartthe secondcall.

4.2.1ShortCall:
Thewaytodothisisthatyoushouldprepareacommandsequencetoautomatically startandstopvoicecalls. Optimum Network Solutions Inc. 9

Tems Investigation Test Procedures InshortcallMSperformsacallwithshortcallduration(like180seconds)andwaits 15 seconds to start the second call. (Call duration is depending on the Operator request) Long call is usually preferred to check the drops or HO failures along the test, whereasshortcallsusuallypreferredtocheckthecallsetupKPIs,like,CallSetup Successrate,Blocking. Therearetwoexamplesforlongandshortcallsbelow:

Shortcallexample

Optimum Network Solutions Inc. 10

Tems Investigation Test Procedures

LongCallexample Differenceof`shortcall`and`longcall`isonlytheduration(e.g.3minutesforshort calland15minutesforlongcall) Duringthetest,theprocessshallbeasfollows; 1 Pushrecord buttonandchooseanappropriatefilenameforthelog file.i.e.0608_2.log. 2 StartCommandSequencebypushingrunbutton 3 Waitfortheendofthesequence. 4 Pushthestopbutton

( )

( )

( )

5IDLEMODE:
In idle mode tests the aim is to record the behaviour of the MS while it is in idle mode,itisnotpreferredtouseidlemodeforcoveragerecording.However,onecan havethecellreselectioncharacteristicsoftheareaifidlemodeMSisused. Inidlemodetest,thereisnoneedforacommandsequence.Onlythingtobedone isrecordandstoptosavealogfile. Optimum Network Solutions Inc. 11

Tems Investigation Test Procedures

6GPRSTESTS
GPRS tests are done for measuring pocket data transmission from the selected locationsorsectorsbythecustomer. GPRSSESSIONS:

The normal mode MS uses for voice calls are Circuit Switching Mode. However, GPRS Sessions take place while the MS is in Packet Switching Mode. Hence, in everyGPRSsessionMShastoswitchtoPSMode,andgetbacktoCSModewhenthe sessionfinishes.ThegeneraldescriptionofatypicalGPRSFTPSessionisasfollows: 1PSAttach 2PDPContextActivation 3SessionStart 4Sessionend 5PDPContextDeactivation 6PSDetach The below excerpts from TEMS Investigation 8.1.3, Signalling Tab, Events window showstwoconsecutiveFTPsessionswithalltheabovelistedeventsoccurringin order.

Optimum Network Solutions Inc. 12

Tems Investigation Test Procedures

TwoconsecutiveFTPsessionsfromTEMSInvestigation8.1.3. UsuallyFTPandPingsessionsareusedtotesttheGPRSnetworkperformance.InFTP testtherearetwofiles,oneintheFTPserver,oneinthePCcollectingthedatainthe field.ThesetwofilesareuploadedanddownloadedthroughtheMSusingGPRSand the throughputs are recorded in the logs. In Ping test, large numbers of pings are sentfromPCtoservertoseethesuccessrate. MSCONFIGURATIONFORGPRSTEST MSshallbesetupfortheGPRSconnection.Thesesettingsareavailableintheweb sites of all GSM operators. A data account shall be created with the necessary usernameandpasswords.MSshallbeinCSOnlymodeinorderforustoseePS attachandPSdetacheventsinallthesessions.IftheMSisleftinPSandCSmode therewillbenoPSAttachandPSDetacheventintheGPRSsessions. BelowarethesettingsforVodafoneTRnetworkforaSonyEricssonK790MStobe enabledforGPRSservice: DataAccountName:Vodafone DataAccountType:PSdata APN:Internet Username:vodafone Optimum Network Solutions Inc.

13

Tems Investigation Test Procedures Password:vodafone LoginRequest:OFF Allowcalls:Automatically IPadress: DNSadres: Authantication:None,PAP,CHAPselected DataCompression:Off HeaderCompression:Off AfterthesesettingsaredoneintheMS,thereismoretobedoneonthePCside. connecttheMStothePC, innetworkneighbourhood,createanewconnection, connecttothenetworkatmyworkplace, dialupconnection, choosethemodemrelatedtotheMS,i.e.SonyEricssonK790datamodem, givetheconnectionanamei.e.Vodafone, thenumbertobedialledis*99#. Aftercreatingthisnewdataconnection,weshalltrytoconnecttointernetthrough GPRS. If the result is positive, we may go on to configure out test equipment with TEMSInvestigation. EQUIPMENTCONFIGURATIONFORTEMSINVESTIGATION8.1.3

RightclickonMS1AirInterfaceforreachingequipmentproperties

Optimum Network Solutions Inc. 14

Tems Investigation Test Procedures

ChecktheoffboxintheGSMEDGECapabilitytab.

DoubleclickonDataforopeningpropertieswindow.

Optimum Network Solutions Inc. 15

Tems Investigation Test Procedures

SetPacketCapturetoOnandPacketsizetoFullpacketsize COMMANDSEQUENCE AftersuccessfullyconnectingtheMStoTEMSSW,theCommandSequenceshallbe prepared.Thebelowfigureswilldepictthecommandsequencelineswrittenforthe VodafoneTRStaticGPRSTests: Three types of GPRS test command sequences will be used due to customers request: 1 Comprisesof10FTPSessions(5DLand5UL)and1pingSession(Stationary)
2 Comprisesof20FTPSessions(10DLand10UL)and1pingSession(Stationary) 3 Comprisesof10FTPSessions(5DLand5UL)(mobility)

1Command sequence below comprises of 10 FTP Sessions (5 DL and 5 UL) and 1 PingSession(500pings,32KBeach).InFTPDL,a240kfileisdownloadedfromFTP server,whileinFTPULa40kfileisuploadedtoFTPserver.Therearewaitcommands lasting for 5 seconds in between all the sessions and wait commands lasting for 3 secondsbetweenallstartandstoprecordcommands.

Optimum Network Solutions Inc. 16

Tems Investigation Test Procedures

CommandsequenceandFTPDLdetails

FTPUplinkdetails

Optimum Network Solutions Inc. 17

Tems Investigation Test Procedures

PINGdetails 2 Same command sequence with only FTP session count difference above (10 UL and10DL) 3Commandsequencebelowcomprisesof10FTPSessions(5DLand5UL).InFTP DL,a240kfileisdownloadedfromFTPserver,whileinFTPULa40kfileisuploaded to FTP server. There are wait commands lasting for 5 seconds in between all the sessionsandwaitcommandslastingfor1secondsbetweenallstartandstoprecord commands.

CommandsequenceandFTPDLdetails

Optimum Network Solutions Inc. 18

Tems Investigation Test Procedures

FTPULdetails Duringthetest,theprocessshallbeasfollows; 1 StartCommandSequencebypushingrunbutton( ) 2 Waitfortheendofthesequence.(forastaticGPRStest) 3 Wait for a wait command and stop sequance by pushing stop button (
4 Afterfinishingthetest:

).(foramobileGPRStest)

Therewillbe3logfileswiththenamecomprisesofdateandlognumber forstationarytests.i.e0521_01,0521_02and0521_03. FirstoneisDLsessionlogfile,secondisULandthelastoneisPingsession logfile. Therewillbeseverallogfilesnamedasabove.Logfilesendingwithodd numbersareDLandtheothersareULlogfiles.

Forthesectoreltests,namethefilesusingformatbelow: CLName_CellID_DDMMYY_LogNumber. i.eCL17_22198_21052008_01 Forthelocationtests,namethefilesusingformatbelow: CLName_LocationName_DDMMYY_LogNumber. i.eCL17_Hacettepe_Tip_Fklts_21052008_02 Optimum Network Solutions Inc. 19

Tems Investigation Test Procedures Forthemobiletests,namethefilesusingformatbeolw: Mob_CLName_StartingTime_DDMMYY_LogNumber i.eMob_CL17_1435_21052008_03

Optimum Network Solutions Inc. 20

Tems Investigation Test Procedures

9HOTSPOT(LANDMARK)TESTS
Hotspottestsareformeasuringthestrongestfrequenciesatthetestlocation. Beforestartingtothehotspot(landmark)test,testerhastosetup2MS.Onewillbe usedforIdleModeandtheotherforScannerMode. Duringthetest,theprocessshallbeasfollows; 1 Push record ( ) button and choose an appropriate filename for the log fileusingtheformatasshownbelow MIPrinx_LocationName_MS_DDMMYY_LO1 i.e227166_EsenbogaHavaalani_MS3_21052008_01 2 Waitforatleast5minutes. 3 Pushthestopbutton( )

Testwillberepeatedintwoorthreeplacesnearthelocationasshownbelowifits possible.

Optimum Network Solutions Inc. 21

Tems Investigation Test Procedures

10BENCHMARKTESTS

Benchmark tests done for comparison of network (Vodafone) with other networks (TurkcellandAvea)andmeasuringstrongestfrequenciesinblacklistedlocations. TherearetwowaystomakeBenchmarktests: WithoneMSandScanner Testrepeatsthreetimesatthesameroutewitheachprovideras MS1VodafoneMS3Scanner(withscannerfrequencies2130,4079) MS1AveaMS3Scanner(withscannerfrequencies512586[1800], 16,3338) MS1TurkcellMS3Scanner(withscannerfrequencies1019,81120) Namethelogfilesusingformatasshownbelow siteID_MS1_VF_MS3_SCN_DDMMYY siteID_MS1_AVEA_MS3_SCN_DDMMYY siteID_MS1_TR_MS3_SCN_DDMMYY

WithtwoadditionalMSandScanner Only one test shall be done using all providers at same time. In this scenario, three MSs will have three different simcards and scanner will scanallthefrequenciesbelongingtothedifferentoperators. Example:16,1030,3338,40120[900],512586[1800] Namethelogfilesusingformatasshownbelow siteID_MS1_VF_MS2_TR_MS3_AV_MS4_SCN_DDMMYY

Optimum Network Solutions Inc. 22

Tems Investigation Test Procedures

11SWAPTESTS
Swap tests are done for checking sites after swapping that has been done by the operatorforcabinets,antennasorequipmentonsitesforneweronesorforanother vendor. Site check is being done to find out possible problems which can occur duringswapprocedure. Genericproblemslistedbelow; Crossconnection(Orpartialcrossconnection) Hardwareproblems Missingneighbours Databaseproblems(Coordinate,Azimuthfaults) Swaptestprocedureconsistsoftwokindsoftests:mobilityandstatic.Duringswap test,twocommandsequencesareused,eachforonetypeoftest. Mobile test is done by making dedicated mode test on a route around the site,commandsequenceshouldbeasbelow,

Optimum Network Solutions Inc. 23

Tems Investigation Test Procedures

Mobiletestcommandsequencedetails(Dedicated150s/Idle30s) Statictestisdonebymakingdedicatedmodetestinpointsinfrontofevery sectoronsite,commandsequenceshouldbeasbelow,

Optimum Network Solutions Inc. 24

Tems Investigation Test Procedures

Statictestcommandsequencedetails(Dedicate20s/Idle10s).

Drivetestroutesandotherimportantmatters

Inmobiletest,weshouldfollowbelowprocedures: Twocirclesaroundthesite,onesmallandonebig,ifitispossible(Testerwill decidetherangeofcircles,accordingtocoverageofsite). Detailedtestforeverysectorincoverageareasofsectors. DTEngineershouldcheckHOfromeachsectortoneighbourcellsandback (Neighbourshereshallbecellsintheothersites,collocatedcellsarealwaysdefined neighbors). Instatictest,weshouldfollowbelowprocedures: Staticcallpointshouldbeinfrontofthesectorandsignalstrengthshouldbe good(Between45dbmand65dbm).

Optimum Network Solutions Inc. 25

Tems Investigation Test Procedures

Exampleformobilityandstaticswaptestroutes. Duringmobilitytest,theprocessshallbeasfollows: 1 Pushrecord( )buttonandchooseanappropriatefilenameforthelogfile usingtheformatasshownbelow mobil_siteid_YYYY_MMDD_01 i.emobil_984_2008_0516_01 2 StartCommandSequencebypushingrunbutton( 3 When mobility test finish, wait for a wait command and stop sequence by pushingstopbutton( 4 Pushthestopbutton( Optimum Network Solutions Inc. 26 ) ). )

Tems Investigation Test Procedures Duringthestationarytest,theprocessshallbeasfollows: 1 Push record ( ) button and choose an appropriate filename for the log fileusingtheformatasshownbelow static_siteid_YYYY_MMDD_01(Forfirstsector) i.estatic_984_2008_0516_01 2 StartCommandSequencebypushingrunbutton( 3 Whenstationarytestfinish,waitfortheendofthecommandsequence. 4 Pushthestopbutton( Afterfinishingthetest: Tester should prepare an excel report for each site which has been tested and all filescopiedunderonefolder.Filenamesshouldbeasbelow: FolderName; SW_siteid_MM.DD.YYYYlogs i.eSW_984_05.16.2008logs ExcelSheet; CLXX_siteid_MM_DD_YYYY i.eCL08_984_05_16_2008 MobilLogs; mobil_siteid_YYYY_MMDD_01 i.emobil_984_2008_0516_01 StaticLogs; static_siteid_YYYY_MMDD_01(Forfirstsector) i.estatic_984_2008_0516_01 ) )

Optimum Network Solutions Inc. 27

Tems Investigation Test Procedures

GLOSSARY
PDPContext

APDP(PacketDataProtocol)ContextisalogicalassociationbetweenaMS(Mobile Station)andPDN(PublicDataNetwork)runningacrossaGPRSnetwork.Thecontext definesaspectssuchasRouting,QoS(QualityofService),Security,Billingetc. PSPacketSwitched Inapacketswitchnetworks,datamaybetransferredbydividingitintosmallblocks orpiecesknownaspackets.Eachpacketcontainsinformationinitsheadertoallow ittoberoutedbypacketswitchesacrossthenetwork.Thisisamoreefficientmeans oftransferringdata.AnexampleofapacketswitchednetworkistheVodafone. CircuitSwitching Circuitswitchingisaprocessinwhichadedicatedphysicalcircuitpathmustexist betweensenderandreceiverforthedurationofthecall.Theswitchisemployedto connectthevariousphysicalpathsthatmakeuptheendtoendconnection. SwitchingtakesplacewithinLayer2oftheOSI(OpenSystemInterconnection)7 layermodel. CallInitialization CallinitializingisthestepofdiallingnumberforstartingaGSMvoicecall. CallAttempt In a telecommunicationsystem, a demand by auserfor aconnectionto another user.ThisisthesecondstepofstartingaGSMvoicecall.Note:Intelephonetraffic analysis,callattempts are counted during a specifictime frame. The callattempt countincludesallcompleted,overflowed,abandoned,andlostcalls. CallSetup Call setup is the step comes after call attempt that caller starts to hear the calling toneuntilcalleduseranswersthecall. CallEstablished

Optimum Network Solutions Inc. 28

Tems Investigation Test Procedures Callestablishedisthestepthatthecalleduseracceptsthecall.GSMvoicecallstarts withthisstep. Handover Handover(handoff)isswitchingofanongoingcalltoadifferentchannelorcell. Therearefourtypesofhandovers

Switchingchannelsinthesamecell. SwitchingcellsundercontrolofthesameBaseStationController(BSC) SwitchingcellsunderthecontrolofdifferentBSCs,butbelongingtothesame MobilserviceSwitchingCenter(MSC) SwitchingcellsundercontrolofdifferentMSCs.

Thefirsttwotypesofhandover,calledinternalbecausetheyinvolveonlyBSC,and MSCisnotifiedonlyoncompletionofthehandover. Thelasttwotypesofhandover,calledexternalbecausetheyinvolveMSC. MSC(MobileservicesSwitchingCenter) The MSC performs the telephony switching functions for the mobile network. It controls calls to and from other telephony and data systems, such as the Public Switched Telephone Network (PSTN), Integrated Services Digital Network (ISDN), publicdatanetworks,privatenetworksandothermobilenetworks. BSC(BaseStationController) TheBSCmanagesalltheradiorelatedfunctionsofaGSMnetwork.Itisahigh capacityswitchthatprovidesfunctionssuchasMShandover,radiochannel assignmentandthecollectionofcellconfigurationdata.AnumberofBSCsmaybe controlledbyeachMSC.

Optimum Network Solutions Inc. 29