Automated Testing

Copyright
Copyright 2002 IPNetFusion Inc.
3400 Waterview Parkway
Richarson! "# $%0&0! '()
)** rights reserve
Printe in the 'nite (tates o+ ),erica
Warranty
In+or,ation in this guie is su-.ect to change without notice.
Co,panies! na,es! an ata use in e/a,p*es herein are
+ictitious un*ess otherwise note. No part o+ this guie ,ay -e
reprouce or trans,itte in any +or, -y ,eans e*ectronic or
,echanica*! +or any purpose! without e/press written
per,ission o+ IPNetFusion Inc.
Contents
AUTOMATED TESTING.............................................................................................1
INTRODUCTION TO THE TEST SUITE RUNNER................................................2
"est Pro+i*e Creation..................................................................................................3
"est Pro+i*e 0/ecution...............................................................................................%
Functions o+ 1og! 1og as "e/t! 0/ecution 1eve* an 2isp*ay 1eve*........................%
Fi*e 3enu...................................................................................................................%
0it ,enu...................................................................................................................4
5iew 3enu................................................................................................................6
(cheu*er.................................................................................................................74
INTRODUCTION TO REPORTER...........................................................................17
'se Case +or Reporter..............................................................................................7&
RUN REPORTER.........................................................................................................2
!OGGER.......................................................................................................................2"
0it...........................................................................................................................30
5iew.........................................................................................................................33
iii
Automated Testing
) key +eature o+ 0)(" is the capa-i*ity to run auto,ate
testing. In orer to run auto,ate tests! a syste, not on*y nees
the too*s to -ui* ,essages an test protoco*s! -ut a*so shou*
-e a-*e to ,anage severa* iscrete aspects o+ a test. 3anaging
iscrete aspects si,u*taneous*y can -e 8uite co,p*icate!
consiering that each action ,ust -e e/ecute! con+ir,e an
*ogge +or veri+ication.
(o,e capa-i*ities o+ 0)(" +or supporting auto,ation are
,entione -e*ow9
Ca** Processing "est )uto,ation
Network 3anage,ent
:raphica* 0itors
)*ar, 3onitoring
Fau*t Creation
"est Runner;(cheu*er
Resource 3anage,ent
1ogger
Reporting
"est 3anage,ent
)uto,ate "esting 7
Introduction to the Test Suite Runner
"he test suite runner is use to e/ecute the test suites. 'sing
the runner! the user can scheu*e the test suites to run within a
speci+ie ti,e interva*. It can -e invoke irect*y through the
esktop +ro, the runner *ist. "he 0vent server an (cheu*e
server shou* -e active on the esktop to invoke the "( runner.
"he test suite runner is shown in the +o**owing +igure9 <
"he +unctions o+ the test suite runner are ivie into three
categories9 <
"est pro+i*e creation
2 0)("
"est pro+i*e e/ecution
(cheu*ing the test suites
Test Profile Creation
Need of Test Profile
) pro+i*e keeps the current settings o+ the runner winow in a
+i*e +or,at. "he e/tension na,e o+ the pro+i*e is =. pro+i*e>. It
is save in the ?R@@"A2IRBCCataCCcon+igCCpro+i*e +o*er. "he
runner *oas the pro+i*e an runs the test cases! which are save
within it. I+ no pro+i*e is create then the =e+au*t pro+i*e> is
*oae uring e/ecution.
Test Profile Panel
When user c*icks the test pro+i*e creation ta- pane! the
+o**owing :'I appears9 <
Test Profile Name
In the "est pro+i*e na,e te/t +ie*! we enter the pro+i*e na,e.
)uto,ate "esting 3
Test Profile Creator
In the "est pro+i*e creator te/t +ie*! we can enter the na,e o+
the user who has create the pro+i*e.
Description
In this te/t<+ie* user can a any escription a-out the test
cases that is to -e e/ecute or any other te/t that the user +ee*s
wou* -e suita-*e.
Test Cases Panel
In the test cases pane* a test case *ist is isp*aye. @n any test
suite na,e we can write c*ick an a pop up ,enu wi** appear
showing three options i.e.! 5iew "est (uite! )rgu,ents an
2e*ete.
View Test Suite
'sing this option the test suite can -e viewe +ro, the runner.
) test suite eitor wi** -e opene to isp*ay that test suite.
Delete
4 0)("
C*icking this option the test case can -e e*ete +ro, the test
case *ist. When the e*ete option is c*icke! a con+ir,ation
ia*og co,es as shown -e*ow9 <
Test Profile !ecution
In test pro+i*e e/ecution pane* the test suite is e/ecute. In this
pane*! there are +aci*ities +or isp*ay settings! setting +i*ters +or
"I@s! to view the *ogs! an to view the event trace.
View Types
2i++erent view types in the runner are "e/t view! 0vent "race!
"I@ view! :raph view an DotPoint.
For ,ore in+or,ation on view types! see etai*s
"ilter Settings
"he +i*ter settings pane* he*ps the user to view the *ogs as
esire.
For ,ore in+or,ation on +i*ter settings! see etai*s
"unctions of #og$ #og as Te!t$ !ecution
#e%el and Display #e%el
For ,ore in+or,ation on 1og an 1og as "e/t! see etai*s.
"unctions of the Different &enus
"ile &enu
)uto,ate "esting %
!oad Test Suite #Ct$%&S'i(t&!)
"his option opens a ia*og -o/ isp*aying a** the scripts in the
?R@@"A2IRBCCataCCtsCCscript +o*er. "he esire script can -e
*oae +or e/ecution.
!oad P$o(i%e #Ct$%&!)
"his option opens a ia*og -o/ isp*aying a** the e/isting
pro+i*es in the ?R@@"A2IRBCCataCCcon+igCCpro+i*e +o*er.
Sa*e P$o(i%e #Ct$%&S)
"his option a**ows the user to save the pro+i*e.
Sa*e P$o(i%e As #Ct$%&S'i(t&S)
"his option he*ps the user to save a pro+i*e in another na,e.
Run #Ct$%&R)
"his option is use to e/ecute the *oae script.
C%ose #Ct$%&C)
"his option a**ows user to c*ose the current*y running
app*ication.
+uit #Ct$%&+)
"his option a**ows user to 8uit +ro, the runner.
dit menu
4 0)("
Test,ed #Ct$%&T)
It provies +aci*ity to enter i++erent test -e na,es +or sening
an receiving ,essages.
I+ in the esktop.os the entry is EUseTest,ed-no./ then the
originating an the ter,inating graph wi** run success+u**y with
sa,e test -e na,e.
I+ in the esktop.os the entry is EUseTest,ed-0es./ then the
originating an the ter,inating graph wi** run success+u**y
having i++erent test -e na,es. I+ they have the sa,e "est-e
na,e! the test cases wi** not -e e/ecute success+u**y.
Test En*i$onment #Ct$%&S'i(t&E)
It a**ows user to change the 2e+au*t entry o+ "est 0nviron,ent.
)+ter entering the na,e in the given te/t area when the user
c*icks on the 1A22%03 an 1O4a03 -utton! this na,e is
re+*ecte in the Runner.
)uto,ate "esting $
Sea$5' #Ct$%&6)
(earch a**ows the user to search +or a string in the *og winow.
6ind Ne7t #68)
Fin ne/t takes the user to the ne/t ,atch +ro, the ,ost recent
(earch.
P$o2e$ties #Ct$%&P)
"he property options isp*ays a ia*og -o/ in which the
properties o+ the *ogs can -e set.
& 0)("
Runtime #Ct$%&N)
"he Runti,e 2ia*og option a**ows the user to know how ,uch
ti,e is re8uire to e/ecute that "est (uite.
(uppose i+ user enters 70 (econs! then the "( is e/ecute +or
70 sec! i+ it is not e/ecute with in this ti,e then "( is a-orte.
View &enu
)uto,ate "esting 6
"he 5iew ,enu has +ive options9 2e-ug! 2u,p @-.ect
Counter! 3essages! (tatus! an Reporter.
De'ug (Ctrl)D*
"he 2e-ug @ption shows the *og *eve* status to the user. I+
users enter ** 4 an c*icks the 2e-ug -utton! then it sets the *og
*eve* as set *og *eve* 4 on the 2e-ug 5iewer winow. Now i+
we run the "(! then it shows a** the etai*s in the 2escription
co*u,n.
C*ear ta- wi** then c*ear a** the ata o+ the 2e-ug 5iewer
winow.
C*icking on the 1og "o Fi*e -utton wi** save the etai*s o+ the
2e-ug viewer winow in a "e/t +or,at on the path 9
2ataC1ogsCRunner2e-ug.

Dump +',ect Counter (Ctrl)&*
"he 2u,p @-.ect Counter @ption isp*ays the in+or,ation o+
70 0)("
o-.ects -eing use. I+ user se*ects the (how )** @-.ects then it
isp*ays a** the o-.ects an the status o+ each o-.ect..
&essages (Ctrl)Shift)&*
It stores the status shown in (tatus -ar o+ the "C Runner
seria**y.
Status (Ctrl)-*
"he (tatus winow o+ the "est (uite runner isp*ays the status
o+ the se*ecte test suite a+ter e/ecution. It inc*ues in+or,ation
a-out the (uccess an Fai*ure o+ the test cases. (ee etai*s.
E7am2%e9 "he user tries to e/ecute a test suite! which ca**s
three "CFs through the "C 1ist "I@s. "he return types o+ the
two "CFs are success an one "C is Fai*ure. "he (tatus
winow wi** show the (tatus as shown -e*ow.
)uto,ate "esting 77
"a%orite
"he Pro+i*es that we want to use regu*ar*y can -e ae into
+avorites -y c*icking the 1Add to3 option.
"he create +o*er pro,pts +or a +o*er na,e to create a
su-,enu insie the ,ain +avorites ,enu.
"he 1Add to3 option co,es auto,atica**y insie every +o*er
as shown in the +o**owing +igure.
72 0)("
.elp &enu (Alt).*
.elp Topics
Gy c*icking the De*p "opics it isp*ays the etai*e escription
a-out the se*ecte "I@ or 0itor.
A'out
When user c*icks on the E)-outF -utton! it isp*ays the 0)("
version an H2I version that we are using current*y in our too*.
)uto,ate "esting 73
Scheduler
"he user is a-*e to scheu*e the test suite in a regression
environ,ent to e/ecute at a *ater ti,e. "o invoke the scheu*er!
the user has to se*ect s5'edu%e$ 2ane% in the runner. In the
scheu*er winow the user can se*ect test suites an input the
nu,-er o+ ti,es to e/ecute the test suites.
74 0)("
@nce the 1Mo$e3 check -o/ is se*ecte the +o**owing ia*og
wi** appear.
)uto,ate "esting 7%
"he user can scheu*e the test suites! accoring to the choices
shown in the picture a-ove. "he user can enter the ,a/i,u,
e/ecution ti,e +or a test suite or the poo* o+ test suites in ter,s
o+ secons! ,inutes! or hours.
)n option +or the generation o+ the 1og Fi*e is inc*ue. I+ the
1og +i*e is scheu*e! then the re*evant *og +i*es are generate!
otherwise no *og +i*es wi** -e generate.
"he (cheu*e +re8uency option a**ows the user to e/ecute the
test suites once! ai*y! week*y! or ,onth*y.
"he =E7it $unne$ a(te$ e7e5ution> option has two choices!
yes an no! +or e/iting the runner a+ter e/ecution o+ the "est
(uite. "est 0nviron,ent sets the environ,ent o+ the "est (uite.
74 0)("
Introduction to Reporter
"he reporter is one o+ severa* auto,ation +eatures that a**ows
users gather etai*e in+or,ation o+ test cases an test suites
that were e/ecute +ro, the 2esktop Reporter! (cheu*er! or
-y e/ecuting a *oa poo* +ro, the 3:CP 1oa Runner. It
keeps a etai*e report o+ so,e o+ the test suites statistics! such
as the ti,e o+ e/ecution! nu,-er o+ "Cs use! whether or not
the graph was co,p*ete! etc. "he Reporter is invoke -y
c*icking the 1Re2o$te$3 -utton o+ the 2esktop. "he winow o+
the Reporter is ca**e 1Test Re2o$te$3.
Test Reporter
"he "est Reporter isp*ays the "( Na,e! 'ser! "est (uite! an
(tatus.
For the iniviua* "CFs! the "C Na,e! (tatus! (tart "i,e! 0n
"i,e! "est 2uration an Co,,ent are isp*aye.
"est Reporter Winow has two pane*sJ the *e+t pane* re+*ects
"est suites whereas the right pane* shows the corresponing
"CFs o+ the se*ecte "est (uite.
!e(t Po$tion o( T'e Test Re2o$te$ :indo;9
)uto,ate "esting 7$
Sta$t9 2ate an ti,e o+ e/ecution o+ the test suite.
Use$9 2isp*ays the 1ogin na,e o+ the user who ran the
"est (uite.
Test Suite9 "he na,e o+ the "est (uite e/ecute. "he
na,e o+ the *oa poo*;Choice;"est suite is isp*aye n
the case o+ a *oa poo*!.
Status9 (hows whether the "( ran success+u**y
KCo,p*eteL or not KInco,p*eteL.
Rig't Po$tion o( t'e Test Re2o$te$ :indo;9
Test Case9 Na,e o+ the test cases use in the se*ecte
"est suite.
Status9 "he status o+ the test case9 (uccess! Fai*ure! or
in progress.
Du$ation9 "ota* e/ecution ti,e o+ the test case.
Comment9 "he co,,ents o+ the "I@ K(et in the 0n
"I@ o+ the test caseL
-se Case for Reporter
(e*ect <Re2o$te$< too* +ro, the 2esktop. "he choice *ists
in the winow he*ps +i*tering the +i*es. "he *e+t choice *ist
has on*y one option Ki.e. withinL. )n the right choice *ist
has +our options Ki.e. ,inutes! hours! ays! an weekL.
Changing the choices in the choice *ist wi** +i*ter the +i*es.
0nter the appropriate va*ue in the te/t +ie*. Gy e+au*t! the
va*ue appearing in this +ie* is 40 ,inutes. C*ick the
16i%te$3 -utton! so that the +i*tere +i*es wi** appear in the
Reporter as shown in the +igure -e*ow. Khere a** +i*es ran -y
a,inistrator within the *ast 40 ,inutesL
7& 0)("
"o view the *og in+or,ation o+ the e/ecute test case!
se*ect a "est suite +i*e +ro, the *e+t *ist an then se*ect the
1=ie; !og3 -utton in the Reporter. I+ the *og +i*e e/ists! it
wi** -e isp*aye in the 1og 5iewer.
)uto,ate "esting 76
I+ no *og +i*e e/ists +or the se*ecte "est (uite then it
shows the 1!og (i%e not (ound3 ,essage on the (tatus Gar
o+ the "est Reporter.
C*ick the 1Detai%3 option to view the etai*s +or a se*ecte
test suite resu*t. "he +o**owing winow appears9
20 0)("
C*ick the 1P$int3 -utton to print the etai*s o+ the test suite
resu*t.
(e*ect a "( ta-*e +ro, the *e+t pane* winow. @nce the "(
is se*ecte! the 5iew choice *ist wi** -e activate. "here are
+our choices to view the status o+ the "(9 )**! (uccess!
Fai*ure! In Progress! an Inco,p*ete. "he )** option is the
e+au*t state.
)uto,ate "esting 27
C*ick on the 6i%e9 P$e*ie;. ) ia*og winow wi** appear
that shows the etai*s o+ the se*ecte "(s! as we** as the
corresponing test cases.
1et the preview winow stay as it is. Now se*ect 6i%e9
Sa*e. ) save +i*e ia*og wi** appear on the screen. (e*ect
the irectory an give the +i*e na,e in the speci+ie space
an c*ick =Sa*e3 to save the test ata o+ the se*ecte "(
Kan the corresponing "CFsL in a te/t +i*e Kthe na,e
+o**owe -y .t/tL in the speci+ie irectory.
22 0)("
C*ick the 1+uit3 -utton to e/it +ro, the Reporter winow.
)uto,ate "esting 23
Run Reporter
It is one o+ the i,portant +eatures o+ 0)(" that isp*ays the
0vent trace in D"31 +or,at an a*so the o++*ine *ogs. It can -e
invoke +ro, 2esktop<<M),in<<MReporter as -e*ow
@n se*ecting Reporter option +ro, ),in -utton the Reporter
winow appears as -e*ow
24 0)("
It contains three ,enus as Fi*e! too*s an De*p. Fi*e ,enu
contains one option as =Re+resh> which is use +or re+reshing
the winow.
"oo*s ,enu contains three options as 1ogger! 0vent "race an
(how unsuccess+u* "Cs.
1ogger option is use to isp*ay the o++*ine *ogs o+ se*ecte
test case.
0vent "race option is use to isp*ay the event trace o+ se*ecte
test case in D"31 +or,at.
"he (how unsuccess+u* "Cs option is use to isp*ay the
etai*s o+ unsuccess+u* "Cs ca**e in a "est suite.
@n se*ecting the 0vent "race option the event trace o+ se*ecte
"C is isp*aye as -e*ow.
)uto,ate "esting 2%
"he De*p ,enu contains as the +o**owing options9 De*p "opics
an )-out
"o view the event trace the user has to se*ect the
=(ave)sD"31> option +ro, +i*ter setting pane* o+ the runner
winow. )n +or viewing *ogs the user has to keep the *og
-utton =@N>.
24 0)("
)uto,ate "esting 2$
#ogger
When a test case is e/ecuting in regression ,oe! a *og
showing etai*s o+ each an every "I@ e/ecute can -e create.
"he etai*s inc*ue the na,e o+ the "I@! ti,e o+ e/ecution!
return resu*t +ro, the "I@! an other etai*s speci+ic to that
"I@. "hese *og etai*s can -e store in a +i*e so that they can -e
use +or +urther use. "he *og +i*e escri-es the e/ecution path
o+ the test *ogic +ro, the start to the en. In these +i*es the user
can see the resources ac8uire! ti,ers set! ti,er e/piration!
user input te/t! etc.
"he 1ogger winow as shown -e*ow consists o+ i++erent
,enus an the *og +i*e se*ection winow.
"he ,enu -ar o+ the *ogger winow appears a shown -e*ow9
2& 0)("
"ile

+pen (Ctrl)+*
@pens the 1og +i*e.
P$o5edu$es9
(e*ect 6i%e9O2en an the winow shown -e*ow wi**
appear.
(e*ect a 1ogs +o*er showing ti,e sta,p +ro, the
winow an then c*ick the @k -utton.
)uto,ate "esting 26
"he winow shown a-ove contains a** the *og +i*es
having ti,e sta,p that can -e viewe through the
*ogger.
It contains the +i*ena,es o+ the test cases that were
e/ecute with its e/tension coe as the ate an ti,e
sta,p.
(e*ect a +i*e na,e an then c*ick the @pen -utton to
open the *og +i*e.
Sa%e as
"his co,,an saves the *og +i*es in te/t +or,at.
Close
"his co,,an c*oses the current*y opene *og +i*e.
/uit
"his co,,an 8uits the *ogger winow.
dit
"his ,enu has two options9 =Sea$5'> an =P$o2e$ties>.
30 0)("
Search
"he search option is use +or searching the *og steps +ro, the
*ogger winow.
)uto,ate "esting 37
Properties
"he properties option takes the user to the properties ia*og!
which shows the page with a** the properties.
32 0)("
View
"his ,enu has one option9 =Status>! 1De,ug3/ 1Dum2 o,>e5t
Counte$3 and 1Messages3.
%ent Trace
For event trace! see detai%s.
"ilter Settings
Fi*ter gives a -rie+ escription o+ the *og +i*es isp*aye. Dere a
+i*ter can -e set on the *og ,essages that are to -e isp*aye.
For ,ore in+or,ation! see detai%s.
:o "o 3ain
)uto,ate "esting 33