04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates

SignIn/Register Help Country

Products
OracleTechnologyNetwork

Archive
AutoServiceRequest(ASR)
AllSystemAdminArticles
AllSystemsTopics
CoolThreads

Solutions

SystemAdminsandDevelopers

Communities

Downloads

Iama...

Store

Iwantto...

Support

Search

Training

Partners

About

OTN

HandsOnLabs

Lab:HowtoDeployaFourNodeOracleRAC12cClusterin
Minutes
UsingOracleVMTemplates

byOlivierCanongewithcontributionsfromChristophePauliat,SimonCoter,SaarMaoz,DoanNguyen,LudovicSorriaux,CecileNaud,and
RobbieDeMeyer

DST
EndofNotices
FAQ
HandsOnLabs
HighPerformanceComputing
Interoperability

New
Anupdatedversionofthishandsonlabisavailableatthefollowinglink:
http://www.oracle.com/technetwork/serverstorage/vm/downloads/holoraclevm2368799.html
ThishandsonlabisstillvalidforOracleVM3.2releases.

Patches
Security
SoftwareStacks
SolarisDeveloper

ThishandsonlabdemonstrateshowtouseOracleVMTemplatestovirtualizeanddeploycomplexOracleApplicationsinminutes.Stepby
stepinstructionsdemonstratehowtodownloadandimporttemplatesanddeploytheapplications,usinganOracleRACtemplateasan
example.

SolarisHowTo
SolarisStudioIDETopics

PublishedJanuary2014

SysadminDays
SystemAdminDocs
Upgrade
VMServerforSPARC
DidyouKnow
JetToolkit
OracleACESforSystems
OracleonDell

TableofContents
LabObjective
Preparation
WhatYouWillLearn:SummaryofLabSteps
GlobalArchitecture
DetailedInstructionsfortheLab
InstallOracleVMManagerinOracleVMVirtualBox
InstallOracleVMServerinOracleVMVirtualBox
StartBothServers(VirtualMachines)
ConnecttotheOracleVMManagerConsole
DiscovertheOracleVMServer
ConfiguretheNetwork
CreateVirtualNetworkInterfaceCards
CreateaServerPool
CreateaStorageRepository
ImporttheOracleVMTemplates
CloneFourVirtualMachinesfromtheTemplate
CreateaSharedDiskfortheOracleASMConfiguration
UseDeployclustertoStarttheVirtualMachinesasOracleRACNodes
Summary
AppendixA:OracleFlexASMandFlexCluster
SeeAlso
AbouttheAuthor
Acknowledgments

Wanttocommentonthis
article?Postthelink
onFacebook'sOTN
Garagepage.Havea
similararticletoshare?
BringituponFacebookor
Twitterandlet'sdiscuss.

LabObjective
ThisdocumentisanadaptationofHandsOnLab9982,whichwasrunduringtheOracleOpenWorld2013sessions.
Note:DuringthislabatOracleOpenWorld,ademoenvironmentbuiltonasinglex86laptopwasused.However,youcanrunthislabatyourhome
orofficeonanx86server,x86desktop,orx86laptop.
ThishandsonlabisforapplicationarchitectsorsystemadministratorswhoneedtodeployandmanageOracleApplications.Theobjectiveofthis
labistodemonstratehowOracleVMTemplatesprovideaneasyandfastwayofdeployingOracleApplications.Thesetemplatesaredesignedto
buildtestorproductionclustersthatconsistofanynumberofnodes,butbydefault,atwonodeclusteriscreated.
Thetemplatesincludefullsupportforsingleinstance,OracleRestart(SingleInstanceHighAvailability[SIHA]),andOracleRealApplication
Clusters(OracleRAC)databasedeploymentsforbothOracleDatabase11gRelease2andOracleDatabase12c.Thetemplatesalsosupportthe
FlexClusterfeatureofOracleDatabase12candOracleFlexAutomaticStorageManagement(ASM),aswellasautomationfor
container/pluggabledatabasesinOracleDatabase12c.
Duringthislab,youaregoingtodeployafournodeFlexCluster(threehubsandoneleaf)withadedicatednetworkforOracleFlexASMtraffic.For
moreinformationaboutOracleFlexASMandFlexCluster,seeAppendixA.
Preparation
Torunthislab,youwillneedthefollowing:
Anx86machinewith16GBofRAMandfourCPUcores.
Anyx86operatingsystemsupportedbyOracleVMVirtualBox,forexample,MicrosoftWindows,mostLinuxdistributions,OracleSolarisforx86
machines,andAppleMacOSX(OracleLinux6update4wasusedwhenthelabwasrunatOracleOpenWorld)
Hereisalistofactionsyoushouldperformbeforestartingthelab:
CheckthatyourOSis64bits.
InstallthelatestOracleVMVirtualBoxversionandtheOracleVMVirtualBoxExtensionPackonyourx86machine.
InstallthelatestJavaRuntimeEnvironment(JRE)7(thejavawsbinaryisneededtogettheVNCconsole).Downloadtheversionthatis
appropriatefortheOSonyourx86machinefromhttp://java.com/en/download/manual.jsp.
DownloadthelatestOracleVMVirtualBoxTemplateforOracleVMManager.(You'llneedtoacceptthelicenseagreementfirst.)
DownloadthelatestOracleVMVirtualBoxTemplateforOracleVMServer.(You'llneedtoacceptthelicenseagreementfirst.)
DownloadthelatestOracleVMTemplatesforasingleinstanceorOracleRACdeploymentofOracleDatabasebyusingthefollowingsubsteps.
Note:Thefollowingtemplatesareusedintheexampleinthislab:

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

1/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
[Aug2013]SingleInstance&OracleRAC12cRelease1,includingOracleGridInfrastructure(12.1.0.1.0)&OracleLinux6Update4Available
fromOracleSoftwareDeliveryCloudfor64BitLinux"[MediaPack:B7402601:OracleVMTemplatesforOracleDatabaseMediaPackforx86(64
bit)
GototheOracleVMTemplatesforOracleDatabasewebpage,clicktheOracleSoftwareDeliveryCloudlinkprovidedfordownloadingthe
templates,andthensignintotheOracleSoftwareDeliveryCloud.
Onceloggedin,selectthetwocheckboxestoacknowledgethelicenseandexportrestrictionagreements,andclickContinue.
IntheMediaPackSearchpage,ensureOracleVMTemplatesisselectedintheSelectaProductPacklistandx8664bitisselectedinthe
Platformlist,andthenclickGo.
Onthenextpage,selectOracleVMTemplatesforOracleDatabaseMediaPackforx86(64bit),whichispartnumberB7402601,andthenclick
Continue.
Onthenextpage,downloadbothfiles:thefirst(part1of2)containstheOSfiles,andthesecond(part2of2)containstheOracleDatabase
installationfiles.Eachisa.zipfilethatcontainsa.tgzor.tbzfile(whichyouwilllaterimportusingOracleVMManager),forexample:
OVM_OL6U4_X86_64_12101DBRAC_PVM1of2.tbz
OVM_OL6U4_X86_64_12101DBRAC_PVM2of2.tbz
DownloadthelatestDeployclustertool.(You'llneedtoacceptthelicenseagreementfirst.)

WhatYouWillLearn:SummaryofLabSteps
Inthislab,youwilllearnhowOracleVMworksandhowtoexecutethefollowingsteps:
InstallOracleVMManagerinOracleVMVirtualBox.
InstallOracleVMServerinOracleVMVirtualBox.
Startbothservers(thatis,theOracleVMVirtualBoxvirtualmachines).
ConnecttotheOracleVMManagerconsole.
DiscovertheOracleVMServer.
Createandconfigureavirtualmachine(VM)network.
Createvirtualnetworkinterfacecards(VNICs).
Createaserverpool.
Createastoragerepository.
ImporttheOracleVMtemplatesforOracleDatabaseandOracleRAC.
CreatefourVMsfromanOracleRAC12ctemplate.
CreateanOracleASMdiskandmapittoeachVMusingtheOracleVMcommandlineinterface(CLI).
UsetheDeployclustertooltostartandconfigureallfourOracleVMvirtualmachinesasOracleRACnodes.
GlobalArchitecture
Figure1showsallthecomponentsusedinthislab(OracleVMVirtualBoxandOracleVMvirtualmachines)withtheirnamesandconfiguration
(memory,IPaddresses,networks,andsoon).

Figure1.Labarchitecturediagram.

DetailedInstructionsfortheLab

InstallOracleVMManagerinOracleVMVirtualBox
TheOracleVMVirtualBoxTemplateforOracleVMManageryoudownloadedcontainsthefollowingsoftwarecomponents:
OracleLinux5update9withtheUnbreakableEnterpriseKernel(2.6.39)
OracleVMManager3.2.4
OracleWebLogicServer10.3
MySQL5.5
Performthefollowingsteps:
IntheOracleVMVirtualBoxconsole,importtheVMfromtheOracleVMManagertemplate:
SelectFile>ImportAppliance.
SelecttheOracleVMManager.3.2.4b524.ovafile.
ClickNext.
ChangethenameoftheVirtualSystem1fromOracleVMManager3.2.4b524toHOL9982_ovm_mgr.
ClickImport.
ModifythesettingsofthevirtualmachineHOL9982_ovm_mgr:
ConfigurethenetworkbygoingtoNetworkandclickingtheAdapter1tab.FromtheAttachedtolist,selectHostonlyAdapter.
LeaveAmountofMemoryas4096MB(youneedatleast3072MB).
StartthevirtualmachineHOL9982_ovm_mgr.
Configurethevirtualmachine(intheVMconsole):
Settherootpasswordtoovsroot.
Configurethenetwork:

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

2/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
IPaddress:192.168.56.3
Netmask:255.255.255.0
Gateway:192.168.56.1
DNSserver:192.168.56.1(wewillnotuseDNS,butwehavetogiveanIPaddresshere)
Hostname:ovmmgr.oow.com
Waitfortheboottocomplete.

InstallOracleVMServerinOracleVMVirtualBox
Performthefollowingsteps:
IntheOracleVMVirtualBoxconsole,importtheVMfromtheOracleVMServertemplateyoudownloaded:
SelectFile>ImportAppliance.
SelecttheOracleVMServer.3.2.4b525.ovafile.
ClickNext.
ChangethenameoftheVirtualSystem1fromOracleVMServer3.2.4b525toHOL9982_ovm_srv.
ClickImport.
ModifythesettingsofthevirtualmachineHOL9982_ovm_srv:
SetAmountofMemoryto10240MB(System).
ConfigurethenetworkbygoingtoNetworkandclickingtheAdapter1tab.FromtheAttachedtolist,selectHostonlyAdapter.
ConfigurethenextnetworkbygoingtoNetworkandclickingtheAdapter2tab.ClickEnableandfromtheAttachedtolist,selectHostonly
Network.
ConfigurethenextnetworkbygoingtoNetworkandclickingtheAdapter3tab.ClickEnableandfromtheAttachedtolist,selectHostonly
Network.
SelecttheVMnamedHOL992_ovm_srv.
Clickthe
icon.
GotoStorage,andunderSataController,removetheexistingdiskOracleVMServer3.2.4b525disk2.vmdk.
Clickthe
icontoaddanewdisk.
ClickCreatenewdisk,selectVMDK,selectDynamicallyallocated,namethediskOVMRepo,andspecifyitssizeas50Gb.ClickCreateandthen
clickOK.
StartthevirtualmachineHOL9982_ovm_srv.
Configurethevirtualmachine(intheVMconsole):
Configurethenetwork:
IPaddress:192.168.56.2
Netmask:255.255.255.0
Gateway:192.168.56.1
DNSserver:192.168.56.1(wewillnotuseDNS,butwehavetogiveanIPaddresshere)
Hostname:ovmsrv.oow.com
Waitfortheboottocomplete.
Ifyourx86machinerunsaUNIX,Linux,orMacoperatingsystem,openaterminalwindowandconnecttotheVMusingssh.(YoucanusePuTTY
ifyourmachinerunsMicrosoftWindows.)
Note:Thepasswordisovsroot.
$sshroot@192.168.56.2
Addthefollowinglinetothe/etc/hostsfile:
192.168.56.3ovmmgr.oow.comovmmgr

StartBothServers(VirtualMachines)
Aspreviouslyexplained,wewilluseOracleVMVirtualBoxtohostthetwoservers(OracleVMServerandOracleVMManager)onasinglex86
machine.
BothVMsshouldhavebeenstartedintheprevioussectionswhenyouinstalledOracleVMServerandOracleVMManagerifnot,pleasestartboth
VMsnow.
Performthefollowingsteps:
WaitfortheOracleLinuxscreenontheHOL9982_ovm_mgrVM(seeFigure2).
WaitfortheOracleVMServerscreenontheHOL9982_ovm_srvVM(seeFigure2).
OpenaterminalwindowandcheckthatyouareabletopingbothVMsusingthefollowingIPaddresses:
HOL9982_ovm_mgr:192.168.56.3
HOL9982_ovm_srv:192.168.56.2

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

3/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates

Figure2.CheckthatyoucanpingbothVMs.
OncebothVMsarestartedandyouhaveverifiedthatyoucanpingthem,dothefollowing:
MinimizethemainOracleVMVirtualBoxwindow.
MinimizetheOracleVMManagerwindow.
MinimizetheOracleVMServerwindow.
Allthenextstepswillbedonefromyourx86machine'snativeOS.

ConnecttotheOracleVMManagerConsole
Performthefollowingsteps:
Onyourx86physicalmachine'sdesktop,openaFirefoxbrowserandconnecttotheOracleVMManagerconsoleusingURL
https://192.168.56.3:7002/ovm/console.
Youshouldgetthefollowingloginscreen:

Figure3.OracleVMManagerloginscreen.
Loginusingthefollowingcredentials:
Login:admin(defaultOracleVMManageradministrator)
Password:Welcome1

DiscovertheOracleVMServer
WhenyouaddOracleVMServerstoyourOracleVMManagerenvironment,thisprocessisknownasdiscoveringOracleVMServers.Thefirst
thingyoushoulddotosetupyourvirtualizationenvironmentistodiscoveryourOracleVMServers.
WhenanOracleVMServerisdiscovered,itcontainssomebasicinformationaboutitselfandaboutanyimmediateconnectivitytoasharedSAN,
butitisconsideredtobeinanunconfiguredstate.AnystorageattachedtotheOracleVMServerisalsodiscovered.Dependingonyourhardware
andnetworkingconfiguration,externalstoragemightbeautomaticallydetectedduringdiscoveryoftheOracleVMServers.
Inthislab,ourOracleVMServerdoesnothaveanysharedstorageithasonlylocalOracleClusterFileSystem2(OCFS2)storagethatis
discoveredduringdiscoveryoftheserver.

Performthefollowingsteps:
ClicktheServersandVMstab,ifitisnotalreadyselected.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

4/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
Clickthe iconinthetoolbar.
EntertheOracleVMAgentpassword(ovsroot)andtheIPaddress(192.168.56.2)fortheOracleVMServer(s)tobediscovered.
ClickOK.

Figure4.DiscoveringOracleVMServers.
TheOracleVMServersarediscoveredandaddedtotheUnassignedServersfolderintheServersandVMstab.Thenamedisplayedfora
discoveredOracleVMServeristheassignedDNSname,nottheIPaddress:

Figure5.DiscoveredserversaddedtotheUnassignedServersfolder.
Thenextstepusuallyisthediscoveryofastoragearray.However,inthislab,wehaveonlyalocalOCFS2diskattachedtotheOracleVMServer,
anditisdiscoveredduringthediscoveryoftheOracleVMServer.Soournextstepistoconfigurethenetwork.

ConfiguretheNetwork
OracleVMhasanumberofnetworkfunctions:ServerManagement,LiveMigrate,ClusterHeartbeat,VirtualMachine,andStorage.TheServer
Management,LiveMigrate,andClusterHeartbeatroleswereautomaticallyassignedtothemanagementnetwork(192.168.56.0)whenyou
discoveredtheOracleVMServer.TheVirtualMachineandStoragerolesarenotautomaticallycreated,andyoumustmanuallycreatethese.The
StorageroleisrequiredonlyforiSCSIbasedstorage,soforthepurposesofthelocalstorageusedinthislab,itisnotrequired.
Inthislab,youwillassignthedefaultmanagementnetwork(PubNet)theVirtualMachinerole,andyouwillthencreatetwonewnetworks:
PrivNetwiththeVirtualMachinerole,whichwillbeusedforOracleRACprivatenetworktraffic
ASMNetwiththeVirtualMachinerole,whichwillbeusedforASMtraffic(theOracleFlexASMfeatureofOracleDatabase12c)

ConfiguretheDefaultManagementNetwork
Performthefollowingsteps:
ClicktheNetworkingtab,andthenclicktheNetworkssubtab.
SelecttheexistingManagementNetwork,192.168.56.0.
Toeditthemanagementnetwork,click

andthendothefollowing:

Changethenetwork'snametoPubNet.
AddtheVirtualMachineroletoPubNetandclickNext.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

5/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates

Figure6.Editingthedefaultmanagementnetwork.
Checkthatovmsrv.oow.comisintheSelectedServer(s)columnandclickNext.
Checkthatovmsrv.oow.combond0isintheSelectedPortscolumnandclickNext.
SelectNoneforbothVLANGroupandVLANsegmentandclickNext.
MakenochangestotheIPaddresses,andthenclickFinish.
Nowwearegoingtocreateanewnetwork,PrivNet,whichisgoingtobeusedforOracleRACtraffic.

CreatethePrivateNetwork
Performthefollowingsteps:
ClicktheNetworkingtab,andthenclicktheNetworkssubtab.
Clickthe icontostarttheCreateNetworkwizard.
SelectCreateanetworkwithbonds/portsonlyandclickNext.

Figure7.Creatingtheprivatenetwork.
Specifythenewnetwork'snameasPrivNet.
AssigntheVirtualMachineroletothisnewnetwork.

Figure8.Specifyingthenetwork'snameandrole.
ClickNext.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

6/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
AttheSelectServersstepofthewizard,selectovmsrv.oow.comtobeincludedinthenewnetworkbymovingittotheSelectedServer(s)liston
theright.

Figure9.Selectingserversforthenewnetwork.
ClickNext.
AttheSelectPortsstepofthewizard,selectovmsrv.ooweth1andmoveittotheSelectedPortslistontheright.

Figure10.Selectingportsforthenewnetwork.
ClickNext.
AttheConfigureIPAddressesstepofthewizard,setupthenetworkbonding.
YoucanusestaticIPaddressesorDHCP,oryoucanhavenoIPaddressesassignedtothenetwork.Inthislab,wedonotneedtouseIP
addressesbecausewearecreatinganetworkforuseonlybyvirtualmachines,soleaveAddressingsettoNone.
ClickFinishtocreatethePrivNetnetwork.

Figure11.Finishingtheconfigurationoftheprivatenetwork.
CreatetheASMTrafficNetwork(forOracleFlexASM)
Tocreatethisnetwork,repeatthestepsyouperformedintheprevioussectiontocreatetheprivatenetwork,exceptusethefollowingvalues
instead:
InStep4,specifythenewnetwork'snameasASMNet.
InStep9,selectovmsrv.ooweth2andmoveittotheSelectedPortslistontheright.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

7/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
NowwearegoingtocreatesomeVNICs(virtualnetworkinterfacecards).

CreateVirtualNetworkInterfaceCards
TheVNICManagercreatesVNICs,whichareusedbyVMsasnetworkcards.YoucreatevirtualnetworkinterfacesbydefiningarangeofMAC
addressestouseforeachVNIC.EachMACaddresscorrespondstoasingleVNIC,whichisusedbyaVM.BeforeyoucancreateaVMthathas
theabilitytoconnecttothenetwork,youshouldgenerateasetofVNICs.YouneedtoperformthissteponlywhenyourunoutofVNICs,noteach
timeyouwanttocreateaVM.
Inthislab,20VNICsarealreadypresent,soyouwillcreate20additionalVNICs.
Performthefollowingsteps:
ClicktheNetworkingtab,andthenclicktheVirtualNICssubtab.
TheCreateVirtualNICspageisdisplayed.
ClickAutoFilltogetthenextavailableMACaddressesandclickCreate.

Figure12.CreatingmoreVNICs.
Thenextstepwillbetocreateaserverpool.

CreateaServerPool
AserverpoolcontainsagroupofOracleVMServers,whichasagroupperformVMmanagementtasks,suchasensuringhighavailability(HA),
implementingresourceandpowermanagementpolicies,andprovidingaccesstonetworks,storage,andrepositories.
Inthislab,wewillcreateaserverpoolwithasingleOracleVMServerinside.
Performthefollowingsteps:
ClicktheServersandVMstab.
Clickthe

iconinthetoolbar.

TheCreateaServerPoolwizardisdisplayed.
Enterthefollowingserverpoolinformation:
ForServerPoolName,entermypool.
ForVirtualIPAddressforthePool,enter192.168.56.4.
DeselectClusteredServerPool.

Figure13.Creatingandconfiguringaserverpool.
ClickNextandaddtheOracleVMServertotheserverpoolbymovingovmsrv.oow.comtotheSelectedServer(s)listontheright.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

8/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates

Figure14.AddingtheOracleVMServertotheserverpool.
ClickFinishandverifythatOracleVMServerovmsrv.oow.comisnowpartofserverpoolmypool.

Figure15.VerifyingthattheOracleVMServerispartoftheserverpool.
Youwillnowcreateastoragerepository.

CreateaStorageRepository
AstoragerepositoryiswhereOracleVMresourcesmayreside.ResourcesincludeVMs,templatesforVMcreation,VMassemblies,ISOfiles(DVD
imagefiles),sharedvirtualdisks,andsoon.
Performthefollowingsteps:
IntheRepositoriestab,click ,andthenintheCreateaDataRepositorywizard,enterOVMRepoforRepositoryNameandmypoolforServer
PoolName.
Selectthe50GBharddisk(SATA_VBOX_HARDDISK).

Figure16.Creatingastoragerepository.
PresentrepositoryOVMRepototheOracleVMServerbymovingovmsrv.oow.comtothePresenttoServer(s)listontheright:

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

9/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates

Figure17.PresentingtherepositorytoOracleVMServer.
TherepositoryhasnowbeencreatedandpresentedtotheOracleVMServerovmsrv.oow.com

ImporttheOracleVMTemplatesYouDownloaded
TheOracleVMtemplatescanbeusedtobuildanOracleDatabase12cRelease1orOracleDatabase11gRelease2singleinstancedatabaseor
aclusterthathasanynumberofnodesandincludesOracleClusterware,OracleDatabase,andOracleAutomaticStorageManagement(ASM),
patchedtothelatest,recommendedpatches.TheenvironmentcomesloadedwithSwingbench,OracleClusterHealthMonitor,OracleOS
Watcher,ASMLibRPMs,andothertools.
Duringtheinstallationprocess,asingleinstanceOracleDatabaseoranOracleRACdatabaseinstanceiscreatedonallnodesbydefault.Any
numberofnodesorinstancescanbeaddedorremovedfromtheclusterusingasinglecommand.
Performthefollowingsteps:
LoginasrootonOracleVMManager:
sshroot@192.168.56.3
Changetothe/var/www/htmldirectoryandcreateadirectorynamedFiles.
CopythetwoOracleDatabasetemplatefilesyoudownloadedearlier(*.tgzor*.tbz)to/var/www/html/Files(youwillneedFilezillaorsome
otherFTPclient).
FromtheOracleVMManagerGUI,importthetemplatefilesbyprovidingbothURLsforthesameimportsession.Theimportprocesswilltake
severalminutesbepatient.

Figure18.Importingthetemplatefiles.
Verifythatthetemplatefilesarepresentintherepository:

Figure19.Verifythatthetemplatefilesarepresentintherepository.
NowthatyouhavearepositorywithanOracleRAC12ctemplateinside,youaregoingtocreatefourVMsfromthistemplate.

CloneFourVirtualMachinesfromtheTemplate
ThegoalofthislabistoconfigureafournodeOracleRACcluster,soyouneedtocreatefourvirtualmachines.Beforecreatingthosevirtual
machinesyouaregoingtoeditthetemplateandmatchthetemplatewiththenetworkconfigurationyoucreatedinthe"ConfiguretheNetwork"
section.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

10/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
Performthefollowingsteps:
IntheRepositoriestab,selecttheOVM_OL6u4...DBRACtemplateandclick
toeditthetemplate.
IntheEditVMTemplatewizard,selecttheNetworkstabandassignPubNet,PrivNet,andASMNettotheSelectedEthernetNetworkslist(keep
theorder:PubNetfirst,PrivNetsecond,andASMNetthird).AnyothernetworkpresentintheSelectedEthernetNetworkslistcanberemoved.

Figure20.Selectingthenetworks.
ClickOK.
ClicktheServersandVMstab.
Clickthe iconinthetoolbar.
FromtheCreateVirtualMachinewizard,dothefollowingtoclonefourVMsfromthetemplate:
SelectClonefromanexistingVMTemplate.
SetCloneCountto4.
SetVMNametorac.

Figure21.CloningtheVMsfromthetemplate.
ClickFinish.
IntheServersandVMstab,inthePerspectivelist,selectVirtualMachinesyoushouldseefourVMs:rac.0,rac.1,rac.2,andrac.3.

Figure22.VerifyingtheclonedVMs.
YoucannowcreateashareddiskforthefutureOracleASMconfiguration.

CreateaSharedDiskfortheOracleASMConfiguration
OracleASMisavolumemanagerandafilesystemforOracleDatabasefiles,whichsupportssingleinstanceOracleDatabaseandOracleRAC
configurations.OracleASMisOracle'srecommendedstoragemanagementsolutionthatprovidesanalternativetoconventionalvolume
managers,filesystems,andrawdevices.
OracleASMusesdiskgroupstostoredatafilesanOracleASMdiskgroupisacollectionofdisksthatOracleASMmanagesasaunit.Withinadisk
group,OracleASMexposesafilesysteminterfaceforOracleDatabasefiles.Thecontentoffilesthatarestoredinadiskgroupisevenly
distributed,orstriped,toeliminatehotspotsandtoprovideuniformperformanceacrossthedisks.Theperformanceiscomparabletothe
performanceofrawdevices.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

11/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
Inthissection,wewillcreateonlyoneOracleASMdisk.Inarealworldscenario,youwouldhavemorethanoneOracleASMdisk.Althoughthose
diskscouldbecreatedusingtheOracleVMManagerGUI,theprocesswouldbeveryrepetitive.Instead,youaregoingtouseCLIcommandsto
createandmapouroneOracleASMdisktotherac.0,rac.1,andrac.2VMs.Becausetherac.3VMwillbetheleafnode,wedon'tgiveitaccessto
theshareddisk.
OracleVMCLIcommandscanbescripted,whichisamoreuserfriendlywaytoautomaticallyrepeatcommands.TheCLIisincludedintheOracle
VMManagerinstallation.
Performthefollowingsteps:
Ifyourx86machinerunsaUNIXorLinuxOS,openaterminalwindowandconnecttoovmmgr.oow.comusingssh.(IfyourmachinerunsMicrosoft
Windows,usePuTTYinstead,asshowninFigure23.)
Forexample,thefollowingLinuxcommandusessshtoconnecttoovmmgr.oow.comusingIPaddress192.168.56.3andthecredentials
admin/Welcome1onport10000:
sshadmin@192.168.56.3p10000

Figure23.ConnectingtotheVM.
CreatetheshareddiskusingthecreateVirtualDiskcommand(seeFigure24):
createVirtualDiskname=racasm1size=5sparse=yesshareable=yesonRepositoryname=OVMRepo
MaptheshareddisktoeachVM,asshowninFigure24:
createvmDiskMappingslot=2storageDevice=racasm1name=racasm1onvmname=rac.0
createvmDiskMappingslot=2storageDevice=racasm1name=racasm1onvmname=rac.1
createvmDiskMappingslot=2storageDevice=racasm1name=racasm1onvmname=rac.2

Figure24.MappingtheshareddisktotheVMs.
Verifythattheracasm1diskispresentandassignedtoVMsrac.0,rac.1,andrac.2:

Figure25.Verifyingtheshareddisk.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

12/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
YouwillnowbeabletostartandconfigurealltheVMsusingtheDeployclustertool.

UseDeployclustertoStarttheVirtualMachinesasOracleRACNodes
OracleVM3userscanbenefitfromtheDeployclustertool,whichnowfullysupportssingleinstance,OracleRestart(SIHA),andOracleRAC
databasedeployments.ThetoolleveragestheOracleVM3APIsothatwhengivenasetofVMs,itquicklybootsthemup,sendstheneeded
configurationdetails,andautomaticallyinitiatesasingleinstanceorclusterbuild,withoutrequiringyoutologintoDom0,toanyoftheinvolved
VMs,ortoOracleVMManager.
InOracleRACdeployments,therearetwowaystodeploythetemplates(hence,therearetwoseparatedocuments):
Inaproductionenvironment(supported)wheretheshareddiskisconfiguredasphysicaldevicespassedthroughtotheguestVMs.Formore
detailsonrunningOracleRACinanOracleVMenvironment,seehttp://www.oracle.com/technetwork/database/clustering/oracleracinoraclevm
environment131948.pdf.
Inatestenvironment(unsupported)wheretheshareddiskisconfiguredasvirtualdevices.Inthisconfiguration,bothguestscanalsorunonone
OracleVMServer.
Productionenvironmentsmaynotdothefollowing:
RunmorethanoneVMbelongingtosameclusteronthesameOracleVMServer(Dom0).
UsefilesinDom0toemulateshareddisksfortheOracleRACnodes/VMs.
Inthislab,youaregoingtodeploythetemplateintestmode.
Createanetconfig.iniFileforDeployment
WewillnowcopytheDeployclustertool(DBRACOVMDeployclustertool.zip)toOracleVMManagerandcreateanetconfig.inifile,which
willsummarizeallthenetworkinformationforourfourOracleRACnodes(forexample,publicIPaddresses,privateIPaddresses,andsoon).This
filewillbeusedduringthedeploymentprocess.
Note:ThegoalofthislabistoshowhowtocreateafournodeclusterusingOracleVMwithFlexClusterandOracleFlexASM,nottoactuallyruna
fournodecluster.Becauseofthelimitedresourceswehaveonthex86machine,thebuildforthisfournodeclusterwillnotfinish.Bycomparison,
asimilardeploymentonabaremetal/OracleVMenvironmentwithadequateresourceswouldtakearound30to40minutes.
Performthefollowingsteps:
Ifyourx86machinerunsaUNIXorLinuxOS,openaterminalwindowandconnecttoovmmgr.oow.comusingssh.(IfyourmachinerunsMicrosoft
Windows,usePuTTYinstead.)
Forexample,thefollowingLinuxcommandusessshtoconnecttoovmmgr.oow.comusingtheroot/ovsrootcredentials:
sshroot@192.168.56.3
Createadirectorycalled/SoftOracleandchangetothisdirectory:
mkdirSoftOracle
cd/SoftOracle
UsinganFTPclient,copyDBRACOVMDeployclustertool.ziptothe/SoftOracledirectoryandthenunzipthefile.
Changetothe/SoftOracle/deploycluster/utilsdirectoryandcreatethenetconfig12cRAC4node.inifilebycopyingallthelinesfrom
onlytheleftcolumnofTable1andpastingthemintothefile:
Table1.Contentforthenetconfig12cRAC4node.inifile.
#Nodespecificinformation
NODE1=rac0
NODE1IP=192.168.56.10
NODE1PRIV=rac0priv
NODE1PRIVIP=10.10.10.230
NODE1VIP=rac0vip
NODE1VIPIP=192.168.56.230
NODE1ROLE=HUB

#Node1name
#Node1IPaddress
#PrivateIPnameforRAC
#PrivateIPforRAC
#VirtualIPnameforRAC
#VirtualIPforRAC
#ROLENODE(HUBorLEAF)

NODE2=rac1
NODE2IP=192.168.56.11
NODE2PRIV=rac1priv
NODE2PRIVIP=10.10.10.231
NODE2VIP=rac1vip
NODE2VIPIP=192.168.56.231
NODE2ROLE=HUB
NODE3=rac2
NODE3IP=192.168.56.12
NODE3PRIV=rac2priv
NODE3PRIVIP=10.10.10.232
NODE3VIP=rac2vip
NODE3VIPIP=192.168.56.232
NODE3ROLE=HUB
NODE4=rac3
NODE4IP=192.168.56.13
NODE4PRIV=rac3priv
NODE4PRIVIP=10.10.10.233
#NODE4VIP=rac3vip
#NODE4VIPIP=192.168.56.233
NODE4ROLE=LEAF
#Commondata
PUBADAP=eth0
PUBMASK=255.255.255.0
PUBGW=192.168.56.1
PRIVADAP=eth1
PRIVMASK=255.255.255.0
RACCLUSTERNAME=oow12c
DOMAINNAME=localdomain#Maybeblank
DNSIP=#Startingfrom2013Templatesallowsmultivalue
#Deviceusedtotransfernetworkinformationtosecondnode
#ininterviewmode
NETCONFIG_DEV=/dev/xvdc
#11gR2specificdata

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

#Publicinterfaceiseth0
#Privateinterfaceiseth1
#Clustername

13/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
SCANNAME=oow12cscan
SCANIP=192.168.56.235
GNS_ADDRESS=192.168.56.236
#12cFlexparameters(uncommenttotakeeffect)
FLEX_CLUSTER=yes#If'yes'impliesFlexASMaswell
FLEX_ASM=yes
ASMADAP=eth2#Mustbedifferentthanprivate/public
ASMMASK=255.255.255.0
NODE1ASMIP=10.11.0.230
NODE2ASMIP=10.11.0.231
NODE3ASMIP=10.11.0.232
NODE4ASMIP=10.11.0.233

#SCANname
#SCANIPaddress
#GridNamingServiceIPaddress
#BuildingaFLEXCluster
#FLEXASMrequirededicatednet

#SingleInstance(descriptioninparams.ini)
#CLONE_SINGLEINSTANCE=yes#SetupSingleInstance
#CLONE_SINGLEINSTANCE_HA=yes#SetupSingleInstance/HA(OracleRestart)
Createaparams12c.iniFileforDeployment
Nowwewillcreateaparams12c.inifile,whichwillbesenttoallVMs,allowingmorecontrolofclusterinstallationoptions,suchastheASM
redundancylevel,databasename,sessionID(SID),ports,andsoon.Ifthisfileissupplied,itoverwritestheparams.inifileinsidetheguestsat
path/u01/racovm/params.initherefore,anysettingssuchasdisknamesoranyspecifieddiscoverystringshouldmatchthesettingsthatthe
VMsareconfiguredwith.
Performthefollowingsteps:
Changetothe/SoftOracle/deploycluster/utilsdirectory.
Createaparams12c.inifilebycopyingallthelinesfromTable2andpastingthemintothefile:
Table2.Contentfortheparams12c.inifile.
#
#/*Copyright2013,Oracle.Allrightsreserved.*/
#
#
#WRITTENBY:Oracle.
#v1.0:Jul2013Creation
#
#
#OracleDB/RAC12cOneCommandforOracleVMGenericconfigurationfile
#ForSingleInstance,SingleInstanceHA(OracleRestart)andOracleRAC
#
#############################################
#
#GenericParameters
#
#NOTE:Thefirstsectionholdsmoreadvancedparametersthat
#shouldbemodifiedbyadvancedusersorifinstructedbyOracle.
#
#Seefurtherdownthisfileforthebasicusermodifiableparameters.
#
##############################################
#
#Tempdirectory(forOUI),optional
#Default:/tmp
TMPDIR="/tmp"
#
#Progresslogfilelocation
#Default:$TMPDIR/progressracovm.out
LOGFILE="$TMPDIR/progressracovm.out"
#
#Mustbeginwitha"+",see"man1date"forvaliddateformats,optional.
#Default:"+%Y%m%d%T"
LOGFILE_DATE_FORMAT=""
#
#Should'clone.pl'beused(defaultno)ordirect'attachhome'(defaultyes)
#toactivatetheGridandRAChomes.
#AttachispossibleintheVMsinceallrelinkingwasdonealready
#Certainchangesmaystilltriggeraclone/relinkoperationsuchasswitching
#fromroletononroleseparation.
#Default:yes
CLONE_ATTACH_DBHOME=yes
CLONE_ATTACH_GIHOME=yes
#
#ShouldarelinkbedoneontheGridandRAChomes.Defaultisno,
#sincethesoftwarewasrelinkedinVMalready.Settingittoyes
#forcesarelinkonbothhomes,andoverridestheclone/attachoption
#abovebyforcingcloneoperation(clone.pl)
#Default:no
CLONE_RELINK=no
#
#ShouldarelinkbedoneontheGridandRAChomesincaseofamajor
#OSchange;Defaultisyes.Incasethehomesareattachedtoadifferent
#majorOSthantheywerelinkedagainst,arelinkwillbeautomatically
#performed.Forexample,ifthehomeswerelinkedonOL5andthenused
#withanOL6OS,orviceversa,arelinkwillbeperformed.Todisable
#thisautomatedrelinkingduringinstall(cloningstep),setthis
#valuetono(notrecommended)
#Default:yes
CLONE_RELINK_ON_MAJOR_OS_CHANGE=yes
#
#Therootoftheoracleinstallmustbeanabsolutepathstartingwitha/
#Default:/u01/app
RACROOT="/u01/app"
#
#ThelocationoftheOracleInventory

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

14/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
#Default:$RACROOT/oraInventory
RACINVENTORYLOC="${RACROOT}/oraInventory"
#
#ThelocationoftheSOFTWAREbase
#InroleseparatedconfigurationGIBASEmaybedefinedtosetthelocation
#oftheGridhomewhichdefaultsto$RACROOT/$GRIDOWNER.
#Default:$RACROOT/$RACOWNER
RACBASE="${RACROOT}/oracle"
#
#ThelocationoftheGridhome,mustbesetinRACorSingleInstanceHAdeployments
#Default:$RACROOT/12.1.0/grid
GIHOME="${RACROOT}/12.1.0/grid"
#
#ThelocationoftheDBRAChome,mustbesetinnonClusterwareonlydeployments
#Default:${RACBASE}/product/12.1.0/dbhome_1
DBHOME="${RACBASE}/product/12.1.0/dbhome_1"
#
#ThediskstringusedtodiscoverASMdisks,itshouldcoveralldisks
#onallnodes,eveniftheirphysicalnamesdiffer.Itcanalsohold
#ASMLibsyntax,e.g.ORCL:VOL*,andhaveasmanyelementsasneeded
#separatedbyspace,taborcomma.
#Donotremovethe"set/+onoglob"optionsbelow,theyarerequired
#sothatdiscoverystringdon'texpandonassignment.
setonoglob
RACASMDISKSTRING="/dev/xvdc1"
set+onoglob
#
#Providelistofdevicesoractualpartitionstouse.Ifactual
#partitionnumberisspecifiednopartitioningwillbedone,otherwisespecify
#topleveldevicenameandthediskwillautomaticallybepartitionedwith
#onepartitionusing'parted'.Forexample,if/dev/xvdh4islisted
#belowitwillbeusedasis,ifitdoesnotexistanerrorwillberaised.
#However,if/dev/xvdhislisteditwillbeautomaticallypartitioned
#and/dev/xvdh1willbeused.
#Minimumof5devicesorpartitionsarerecommended(seeASM_MIN_DISKS).
ALLDISKS="/dev/xvdc"
#
#ProvidelistofASMLibdiskstouse.Canbeeither"diskname"or
#"ORCL:diskname".TheymustbemanuallyconfiguredinASMLibby
#mappingthemtocorrectblockdevice(thispartisnotyetautomated).
#Ifyouincludeanydisksheretheyshouldalsobeincluded
#inRACASMDISKSTRINGsettingabove(discoverystring).
ALLDISKS_ASMLIB=""
#
#Bydefault5disksforASMarerecommendedtoprovidehigherredundancy
#forOCR/Votingfiles.Ifforsomereasonyouwanttouseless
#disks,thenuncommentASM_MIN_DISKSbelowandsettothenewminimum.
#MakeneededadjustmentsinALLDISKSand/orALLDISKS_ASMLIBabove.
#Default:5
ASM_MIN_DISKS=1
#
#Bydefault,wholedisksspecifiedinALLDISKSwillbepartitionedwith
#onepartition.Ifyouprefernottopartitionandusewholedisk,set
#PARTITION_WHOLE_DISKStono.Keepinmindthatifatalatertime
#someonewillrepartitionthedisk,datamaybelost.Probablybetter
#toleaveitas"yes"andsignalit'susedbyhavingapartitioncreated.
#Default:yes
PARTITION_WHOLE_DISKS=yes
#
#Bydefault,disk*names*areassumedtoexistwithsamenameonallnodes,i.e
#allnodeswillhave/dev/xvdc,/dev/xvdd,etc.Itdoesn'tmeanthatthe*ordering*
#isalsoidentical,i.e.xvdccanreallybexvddontheothernode.
#Ifsuchpersistentnaming(notordering)isnotthecase,i.enode1has
#xvdc,xvddbutnode2callsthem:xvdn,xvdmthenPERSISTENT_DISKNAMESshouldbe
#settoNO.Inthecasewheredisksarenameddifferentlyoneachnode,a
#stampingoperationshouldtakeplace(writingtosecondsectorondisk)
#toverifyifallnodesseealldisks.
#Stampingonlyhappensonthenodethebuildisrunningfrom,andbackup
#istakento$TMPDIR/StampDiskbackupdiskname.dd.Remotenodesreadthestamped
#dataandifalldisksarediscoveredonallnodesthediskconfigurationcontinues.
#Default:yes
PERSISTENT_DISKNAMES=yes
#
#Thisparameterdecideswhetherdiskstampingtakesplaceornottodiscoverandverify
#thatallnodesseealldisks.Stampingistheonlywaytoknow100%thatthedisks
#areactuallythesameonesonallnodesbeforeinstallationbegins.
#Themasternodewritesauniqueuuidtoeachdiskonthesecondsectorofthedisk,
#thenremotenodesreadanddiscoveralldisks.
#Ifyouprefernottostampthedisks,setDISCOVER_VERIFY_REMOTE_DISKS_BY_STAMPINGto
#no.However,inthatcase,PERSISTENT_DISKNAMESmustbesetto"yes",otherwise,with
#bothparameterssetto"no"thereisnowaytocalculatetheremotedisknames.
#Thedefaultforstampingis"yes"sinceinVirtualmachineenvironments,scsi_id(8)
#doesn'treturndatafordisks.
#Default:yes
DISCOVER_VERIFY_REMOTE_DISKS_BY_STAMPING=yes
#
#Permissionsandownershipfiles,EL4usesPERMISSIONFILE,EL5usesUDEVFILE
UDEVFILE="/etc/udev/rules.d/99oracle.rules"
PERMISSIONFILE="/etc/udev/permissions.d/10oracle.permissions"
#
#DiskpermissionstobesetonASMdisksuseifwanttooverridethebelowdefault
#Default:"660"(owner+group:read+write)
#ItmaybepossibleinNonroleseparationtouse"640"(owner:read+write,group:read)
#however,thatisnotrecommendedsinceifanewdatabaseOSuser
#isaddedatalatertimeinthefuture,itwillnotbeabletowritetothedisks.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

15/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
#DISKPERMISSIONS="660"
#
#ASM'sminimumallocationunit(au_size)forobjects/files/segments/extentsofthefirst
#diskgroup,insomecasesincreasingtohighervaluesmayhelpperformance(atthe
#potentialofabitofspacewasting).Legalvaluesare1,2,4,8,16,32and64MB.
#Notrecommendedtogoover8MB.CurrentlyifinitialdiskgroupholdsOCR/Votingthenit's
#maximumpossibleau_sizeis16MB.Donotchangeunlessyouunderstandthetopic.
#Mostreleasesdefaultto1MB(Exadata'sdefault:4MB)
#RACASM_AU_SIZE=1
#
#ShouldwealigntheASMdiskstoa1MBboundary.
#Default:yes
ALIGN_PARTITIONS=yes
#
#ShouldpartitioneddisksusetheGPTpartitiontable
#whichsupporteddeviceslargerthan2TB.
#Default:msdos
PARTITION_TABLE_GPT=no
#
#Theseareinternalfunctionsthatcheckifadisk/partitionisheld
#byanycomponent.Theyareruninparallelonallnodes,butinsequence
#withinanode.DonotmodifytheseunlessexplicitlyinstructedtobyOracle.
HELDBY_FUNCTIONS=(HeldByRaidHeldByAsmlibHeldByPowerpathHeldByDeviceMapperHeldByUserHeldByFilesystemHeldBySwap)
#
#####STORAGE:Filesystem:DB/RAC:(shared)filesystem
#
#NOTE1:TonotconfigureASMunsetRACASMGROUPNAME
#NOTE2:Notalloperations/verificationtakeplaceina
#FSconfiguration.
#Forexample:
#Themountpointsarenotautomaticallycreated/mounted
#Besteffortverificationisdonethatthecorrect
#mountoptionsareused.
#
#ThefilesystemdirectorytoholdDatabasefiles(control,logfile,etc.)
#ForRACitmustbeasharedlocation(NFS,OCFSorin12cACFS),
#otherwiseitmaybealocalfilesystem(e.g.ext4).
#ForNFSmakesuremountoptionsarecorrectasperdocs
#suchasNote:359515.1
#Default:None(SingleInstance:$RACBASE/oradata)
#FS_DATAFILE_LOCATION=/nfs/160
#
#ShouldthedatabasebecreatedintheFSlocationmentionedabove.
#Ifvalueisunsetorsettono,thedatabaseiscreatedinASM.
#Default:no(SingleInstance:yes)
#DATABASE_ON_FS=no
#
#ShouldtheabovedirectorybeclearedfromClusterwareandDatabase
#filesduringa'clean'or'cleanlocal'operation.
#Default:no
#CLONE_CLEAN_FS_LOCATIONS=no
#
#NamesofOCR/VOTEdisks,couldbeinaboveFSDatafilelocation
#oradifferentproperlymounted(shared)filesystemlocation
#Default:None
#CLONE_OCR_DISKS=/nfs/160/ocr1,/nfs/160/ocr2,/nfs/160/ocr3
#CLONE_VOTING_DISKS=/nfs/160/vote1,/nfs/160/vote2,/nfs/160/vote3
#
#LocationofOCR/VOTEdisks.Valueof"yes"meansinsideASM
#whereasanyothervaluemeanstheOCR/VotingresideinCFS
#(abovelocationsmustbesupplied)
#Default:yes
#CLONE_OCRVOTE_IN_ASM=yes
#
#ShouldaddnodesoperationCOPYtheentireOracleHomestonewlyadded
#nodes.Bydefaultnocopyisdonetospeeduptheprocess,however
#ifexistingclustermembershavechanged(patchesapplied)compared
#tothenewlycreatednodes(usingthetemplate),thenacopy
#oftheOracleHomesmightbedesiredsothatthenewlyaddednodewill
#getallthelatestmodificationsfromthecurrentmembers.
#Default:no
CLONE_ADDNODES_COPY=no
#
#Shouldanaddnodeoperationfullycleanthenewnodebeforeadding
#ittothecluster.Settingtoyesmeansthatanylingeringrunning
#Oracleprocessesonthenewnodearekilledbeforetheaddnodeis
#startedaswellasalllogs/tracesareclearedfromthatnode.
#Default:no
CLONE_CLEAN_ON_ADDNODES=no
#
#Shouldaremovenodeoperationfullycleantheremovednodeafterremoving
#itfromthecluster.Settingtoyesmeansthatanylingeringrunning
#Oracleprocessesontheremovednodearekilledaftertheremovenodeis
#completedaswellasalllogs/tracesareclearedfromthatnode.
#Default:no
CLONE_CLEAN_ON_REMNODES=no
#
#Should'cleanlocal'requestpromptforconfirmationifprocessesarerunning
#Notethataglobal'clean'willfailifthisissetto'yes'andprocessesarerunning
#thisisadesignedsafeguardtoprotectenvironmentfromaccidentalremoval.
#Default:yes
CLONE_CLEAN_CONFIRM_WHEN_RUNNING=yes
#
#Shouldtherecommendedoraclevalidatedororaclerdbmsserver*preinstall
#becheckedforexistenceanddependenciesduringcheckstep.Ifanymissing

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

16/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
#rpmsarefounduserwillneedtouseup2dateorothermethodstoresolvedependencies
#TheRPMmaybeobtainedfromUnbreakableLinuxNetworkorhttp://oss.oracle.com
#Default:yes
CLONE_ORACLE_PREREQ_RPM_REQD=yes
#
#Shouldthe"verify"actionsoftheaboveRPMberunduringbuildcluster.
#Theseadjustkernelparameters.IntheVMeverythingispreconfiguredhence
#defaultisnottorun.
#Default:no
CLONE_ORACLE_PREREQ_RPM_RUN=no
#
#BydefaultafterclusterwareinstallationCVU(ClusterVerificationUtility)
#isexecutedtomakesurealliswell.Settingto'yes'willskipthisstep.
#SetCLONE_SKIP_CVU_POSTHASforSIHA(OracleRestart)environments
#Default:no
#CLONE_SKIP_CVU_POSTCRS=no
#
#Allowstoskipminimumdiskspacechecksonthe
#OracleHomes(recommendednottoskip)
#Default:no
CLONE_SKIP_DISKSPACE_CHECKS=no
#
#Allowstoskipminimummemorychecks(recommendednottoskip)
#Default:no
CLONE_SKIP_MEMORYCHECKS=yes
#
#Onsystemswithextremememorylimitations,e.g.VirtualBox,itmaybeneeded
#todisablesomeClusterwarecomponentstoreleasesomememory.Workload
#Management,ClusterHealthMonitorandClusterVerificationUtilityare
#disabledifthisoptionissettoyes.
#ThisisonlysupportedforproductionusagewithClusterwareonlyinstallation.
#Default:no
CLONE_LOW_MEMORY_CONFIG=yes
#
#Bydefaultonsystemswithlessthan4GBofRAMthe/dev/shmwill
#automaticallyresizetofitthespecifiedconfiguration(ASM,DB).
#Thisisdonebecausethedefaultof50%ofRAMmaynotbeenough.To
#disablethisfunctionalitysetCLONE_TMPFS_SHM_RESIZE_NEVER=yes.
#Default:no
CLONE_TMPFS_SHM_RESIZE_NEVER=no
#
#Todisablethemodificationof/etc/fstabwiththecalculatedsizeof
#/dev/shm,setCLONE_TMPFS_SHM_RESIZE_MODIFY_FSTAB=no.Thismaymeanthat
#someinstancesmaynotproperlystartfollowingasystemreboot.
#Default:yes
CLONE_TMPFS_SHM_RESIZE_MODIFY_FSTAB=yes
#
#ConfigurestheClusterManagementDB(akaClusterHealthMonitororCHM/OS)
#Default:no
CLONE_GRID_MANAGEMENT_DB=no
#
#SettingCLONE_CLUSTERWARE_ONLYtoyesallowsClusterwareonlyinstallation
#anyoperationtocreateadatabaseorreferencetheDBhomeareignored.
#Default:no
#CLONE_CLUSTERWARE_ONLY=no
#
#Asdescribedinthe11.2.0.2READMEaswellasNote:1212703.1multicasting
#isrequiredtorunOracleRACstartingwith11.2.0.2.Ifthischeckfails
#reviewthenote,andremoveanyfirewallrulesfromDom0,orreconfigure
#theswitchservicingtheprivatenetworktoallowmulticastingfromall
#nodestoallnodes.
#Default:yes
CLONE_MULTICAST_CHECK=yes
#
#Shouldamulticastcheckfailurecausethebuildtostop.It'spossibleto
#performthemulticastcheck,butnotstoponfailures.
#Default:yes
CLONE_MULTICAST_STOP_ON_FAILURE=yes
#
#Listofmulticastaddressestocheck.Bydefault11.2.0.2supports
#only230.0.1.0,howeverwithfixforbug9974223orbundle1andhigher
#thesoftwarealsosupportsmulticastaddress244.0.0.251.Iffuture
#softwarereleaseswillsupportmoreaddresses,modifythislistasneeded.
#Default:"230.0.1.0224.0.0.251"
CLONE_MULTICAST_ADDRESSLIST="230.0.1.0224.0.0.251"
#
#ThetextspecifiedintheNETCONFIG_RESOLVCONF_OPTIONSvariableiswrittento
#the"options"fieldinthe/etc/resolv.conffileduringinitialnetworksetup.
#Thisvariablecanbesethereinparams.ini,orinnetconfig.inihavingthesame
#effect.Itshouldbeaspaceseparatedoptionsasdescribedin"man5resolv.conf"
#underthe"options"heading.Someusefuloptionsare:
#"singlerequestreopenattempts:xtimeout:x"xbeingadigitvalue.
#The'singlerequestreopen'optionmaybehelpfulinsomeenvironmentsif
#inboundsshslownessoccur.
#Notethatminimalvalidationtakesplacetoverifytheoptionsarecorrect.
#Default:""
#NETCONFIG_RESOLVCONF_OPTIONS=""
#
##################################################
#
#Thesecondsectionbelowholdsbasicparameters
#
##################################################
#
#ConfiguresaSingleInstanceenvironment,includingadatabaseas

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

17/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
#specifiedinBUILD_SI_DATABASE.Inthismode,noClusterwareorASMwillbe
#configured,henceallrelatedparameters(e.g.ALLDISKS)arenotrelevant.
#Thedatabasemustresideonafilesystem.
#Thisparametermaybeplacedinnetconfig.iniforsimplerdeployment.
#Default:no
#CLONE_SINGLEINSTANCE=no
#
#ConfiguresaSingleInstance/HAenvironment,akaOracleRestart,including
#adatabaseasspecifiedinBUILD_SI_DATABASE.Thedatabasemayresidein
#ASM(ifRACASMGROUPNAMEisdefined),oronafilesystem.
#Thisparametermaybeplacedinnetconfig.iniforsimplerdeployment.
#Default:no
#CLONE_SINGLEINSTANCE_HA=no
#
#OSUSERSANDGROUPSFORORACLESOFTWARE
#
#SYNTAXforuser/groupareeither(VARdenotesthevariablenamesbelow):
#VAR=username:uidOR:VAR=username
#VARID=uid
#VAR=groupname:gidOR:VAR=groupname
#VARID=gid
#
#Ifuid/gidareomittednochecksaremadenoruserscreatedifneedbe.
#Ifuid/gidaresuppliedtheyshouldbenumericandnotclash
#withexistinguid/gidsdefinedonthesystemalready.
#NOTE:InRACusernamesanduid/gidmustmatchonallclusternodes,
#theverificationprocessenforcesthatonlyifuid/gid's
#aregivenbelow.
#
#Ifincorrectconfigurationisdetected,changestousersandgroupsaremadeto
#correctthem.Ifthisissetto"no"thenerrorsarereported
#withoutanattempttofixthem.
#(Users/groupsareneverdropped,onlyaddedormodified.)
#Default:yes
CREATE_MODIFY_USERS_GROUPS=yes
#
#NONROLESEPARATED:
#NoGriduserisdefinedandallrolesaresetto'dba'
RACOWNER=oracle:1101
OINSTALLGROUP=oinstall:1000
GIOSASM=dba:1031
GIOSDBA=dba:1031
#GIOSOPER=#optionalin12c
DBOSDBA=dba:1031
#DBOSOPER=#optionalin12c
#
#ROLESEPARATION:(uncommentlinesbelow)
#SeeNote:1092213.1
#(Numericchangesmadetouid/gidtoreducethefootprintandpossibleclashes
#withexistingusers/groups)
#
##GRIDOWNER=grid:1100
##RACOWNER=oracle:1101
##OINSTALLGROUP=oinstall:1000
##GIOSASM=asmadmin:1020
##GIOSDBA=asmdba:1021
##GIOSOPER=#optionalin12c
##DBOSDBA=dba:1031
##DBOSOPER=#optionalin12c
##Newin12carethese3roles,ifunset,theydefaultto"DBOSDBA"
##DBOSBACKUPDBA=dba:1031
##DBOSDGDBA=dba:1031
##DBOSKMDBA=dba:1031
#
#ThenamefortheGridhomeintheinventory
#Default:OraGrid12c
#GIHOMENAME="OraGrid12c"
#
#ThenamefortheDB/RAChomeintheinventory
#Default:OraRAC12c(SingleInstance:OraDB12c)
#DBHOMENAME="OraRAC12c"
#
#ThenameoftheASMdiskgroup,default"DATA"
#IfunsetASMwillnotbeconfigured(seefilesystemsectionabove)
#Default:DATA
RACASMGROUPNAME="DATA"
#
#TheASMRedundancyforthediskgroupabove
#ValidvaluesareEXTERNAL,NORMALorHIGH
#Default:NORMAL(ifunset)
RACASMREDUNDANCY="EXTERNAL"
#
#AllowsrunningtheClusterwarewithadifferenttimezonethanthesystem'stimezone.
#IfCLONE_CLUSTERWARE_TIMEZONEisnotset,theClusterwareTimezonewill
#besettothesystem'stimezoneofthenoderunningthebuild.Systemtimezoneis
#definedin/etc/sysconfig/clock(ZONEvariable),ifnotdefinedorfilemissing
#comparisonof/etc/localtimefileismadeagainstthesystem'stimezonedatabasein
#/usr/share/zoneinfo,ifnomatchor/etc/localtimeismissingGMTisused.Ifyou
#wanttooverridetheabovelogic,simplysetCLONE_CLUSTERWARE_TIMEZONEtodesired
#timezone.Notethatacompletetimezoneisneeded,e.g."PST"or"EDT"isnotenough
#needstobefulltimezonespec,e.g."PST8PDT"or"America/New_York".
#Thisvariableisonlyhonoredin11.2.0.2orabove
#Default:OS
#CLONE_CLUSTERWARE_TIMEZONE="America/Los_Angeles"
#

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

18/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
#CreateanACFSvolume?
#Default:no
ACFS_CREATE_FILESYSTEM=no
#
#IfACFSvolumeistobecreated,thisisthemountpoint.
#Itwillautomaticallygetcreatedonallnodes.
#Default:/myacfs
ACFS_MOUNTPOINT="/myacfs"
#
#NameofACFSvolumetooptionallycreate.
#Default:MYACFS
ACFS_VOLNAME="MYACFS"
#
#SizeofACFSvolumeinGigaBytes.
#Default:3
ACFS_VOLSIZE_GB="3"
#
#NOTE:IntheOVM3enhancedRACTemplateswhenusingdeploycluster
#tool(outsideoftheVMs).Thecorrectandsecurewaytotransfer/setthe
#passwordsistoremovethemfromthisfileandusetheP(params)
#flagtotransferthisparams.iniduringdeployoperation,inwhich
#casethepasswordswillbeprompted,andsenttoallVMsinasecureway.
#ThepasswordthatwillbesetfortheASMandRACdatabases
#aswellasEMDBConsoleandtheoracleOSuser.
#Ifnotdefinedheretheywillbepromptedfor(onlyonce)
#atthestartofthebuild.Requiredtobesethereorenvironment
#forsilentmode.
#Usesinglequotetopreventshellparsingofspecialcharacters.
RACPASSWORD='oracle'
GRIDPASSWORD='oracle'
#
#Passwordfor'root'user.Ifnotdefinedhereitwillbeprompted
#for(onlyonce)atthestartofthebuild.
#Assumedtobesameonbothnodesandrequiredtobesethereor
#environmentforsilentmode.
#Usesinglequotetopreventshellparsingofspecialcharacters.
ROOTUSERPASSWORD='ovsroot'
#
#BuildDatabase?TheBUILD_RAC_DATABASEwillbuildaRACdatabaseand
#BUILD_SI_DATABASEasingleinstancedatabase(alsoinaRACenvironment)
#Default:yes
BUILD_RAC_DATABASE=yes
#BUILD_SI_DATABASE=yes
#
#Allowsfordatabaseandlistenertobestartedautomaticallyatnext
#systemboot.ThisoptionisonlyapplicableinSingleInstancemode.
#InSingleInstance/HAorRACmode,theClusterwarestartsupall
#resources(listener,ASM,databases).
#Default:yes
CLONE_SI_DATABASE_AUTOSTART=yes
#
#Commaseparatedlistofnamevaluepairsfordatabaseinitializationparameters
#Usewithcare,novalidationtakesplace.
#Forexample:"sort_area_size=99999,control_file_record_keep_time=99"
#Default:none
#DBCA_INITORA_PARAMETERS=""
#
#Createa12cContainerDatabaseallowingpluggabledatabasestobeadded
#usingoptionsbelow,oratalatertime.
#Default:no
DBCA_CONTAINER_DB=no
#
#PluggableDatabasename.In'createdb'operationanumberisappendedattheend
#basedoncount(below).In'deletepdb'exactnamemustbespecifiedhereorin
#anenvironmentvariable.
#Default:mypdb
DBCA_PLUGGABLE_DB_NAME=mypdb
#
#NumberofPluggableDatabasestocreateduringa'createdb'operation.Avalue
#ofzero(default)disablespluggabledatabasecreation.
#Default:0
DBCA_PLUGGABLE_DB_COUNT=0
#
#ShouldaPolicyManageddatabasebecreatedtakingintoaccountthe
#optionsbelow.Ifsetto'no'anAdminManageddatabaseiscreated.
#Default:no
DBCA_DATABASE_POLICY=no
#
#CreateServerPools(PolicyManageddatabase).
#Default:yes
CLONE_CREATE_SERVERPOOLS=yes
#
#RecreateServerPools;ifalreadyexist(PolicyManageddatabase).
#Default:no
CLONE_RECREATE_SERVERPOOLS=no
#
#Listofserverpoolstocreate(PolicyManageddatabase).
#Syntaxispoolname:category:min:max
#Allexceptnamecanbeomitted.CategorycanbeHuborLeaf.
#Default:mypool
CLONE_SERVERPOOLS="mypool"
#
#ListofServerPoolstobeusedbythecreateddatabase(PolicyManageddatabase).
#TheserverpoolslistedinDBCA_SERVERPOOLSmustappearinCLONE_SERVERPOOLS
#(andCLONE_CREATE_SERVERPOOLSsettoyes),ORmustbemanuallyprecreatedfor

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

19/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates
#thecreatedatabasetosucceed.
#Default:mypool
DBCA_SERVERPOOLS="mypool"
#
#Databasecharacterset.
#Default:WE8MSWIN1252(previousdefaultwasAL32UTF8)
#DATABASE_CHARACTERSET="WE8MSWIN1252"
#
#UsethisDBCAtemplatename,filemustexistunder$DBHOME/assistants/dbca/templates
#Default:"General_Purpose.dbc"
DBCA_TEMPLATE_NAME="General_Purpose.dbc"
#
#Shouldthedatabaseincludethesampleschema
#Default:no
DBCA_SAMPLE_SCHEMA=no
#
#RegistersnewlycreateddatabasetobeperiodicallymonitoredbyClusterVerification
#Utility(CVU)onacontinuousbasis.
#Default:no
DBCA_RUN_CVU_PERIODICALLY=no
#
#CertainpatchesappliedtotheOraclehomerequireexecutionofsomeSQLpost
#databasecreationforthefixtobeappliedcompletely.Thesefilesarelocated
#underpatches/postsqlsubdirectory.Itispossibletorunthemserially(adds
#tooverallbuildtime),orinthebackgroundwhichisthedefault.
#Notethatwhenrunninginbackgroundthesescriptsmayrunalittlelongerafter
#theRACCluster+Databasearefinishedbuilding,howeverthatshouldnotcause
#anyissues.IfoverallbuildtimeisnotaconcernchangethistoNOandhave
#thescriptsrunaspartoftheactualbuildinserial.
#Default:yes
DBCA_POST_SQL_BG=yes
#
#AnoptionalusercustomSQLmaybeexecutedpostdatabasecreation,defaultnameof
#scriptisuser_custom_postsql.sql,itislocatedunderpatches/postsqlsubdirectory.
#Default:user_custom_postsql.sql
DBCA_POST_SQL_CUSTOM=user_custom_postsql.sql
#
#TheDatabaseName
#Default:ORCL
DBNAME="ORCL"
#
#TheInstancename,maybedifferentthandatabasename.Limitedinlengthof
#1to8foraRACDBand1to12forSingleInstanceDBofalphanumericcharacters.
#IgnoredforPolicyManagedDB.
#Default:ORCL
SIDNAME="ORCL"
#
#ConfigureEMDBExpress
#Default:no
CONFIGURE_DBEXPRESS=no
#
#DBExpressportnumber.Ifleftatthedefault,afreeportwillbeassignedat
#runtime,otherwisetheportshouldbeunusedonallnetworkadapters.
#Default:5500
#DBEXPRESS_HTTPS_PORT=5500
#
#SCAN(SingleClientAccessName)portnumber
#Default:1521
SCANPORT=1521
#
#LocalListenerportnumber
#Default:1521
LISTENERPORT=1521
#
#Allowscolorcodingoflogmessages,errors(red),warning(yellow),
#info(green).Bydefaultnocolorsareused.
#Default:NO
CLONE_LOGWITH_COLORS=no
#
#ENDOFFILE
#
RuntheDeployclusterTool
TheDeployclustertoolcanberunwithseveralparametersherewewillusethefollowingparameters:
uspecifiesanOracleVMManageruser.
MprovidesalistofVMs.
Nspecifiesthenetconfigfiletobeusedduringdeployment(netconfig12cRAC4node.ini).
Pisaparameterthatspecifiesthefiletouseforthebuildingcluster(params12c.ini).
DspecifiestheDryrunmode,whichallowsyoutoseeasimulationoftheoperationthatwillbeperformed.
Also,becauseoflimitedmemoryresourcesonthex86machine,wewilltellDeployclusternottocheckthememorysizeofourVMs.
Performthefollowingsteps:
Changetothe/SoftOracle/deployclusterdirectory.
Editthedeploycluster.inifilebychangingtheDEPLOYCLUSTER_SKIP_VM_MEMORY_CHECK=nolineto
DEPLOYCLUSTER_SKIP_VM_MEMORY_CHECK=yes.
RunthefollowingcommandtorunDeployclusterinDryrunmode:
./deploycluster.pyuadminMrac.?Nutils/netconfig12cRAC4node.iniPutils/params12c.iniD
YouwillbeaskedforapassworduseWelcome1.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

20/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates

Figure26.RunningDeployclusterinDryrunmode.
Checkforanyerrors.Allstepsshouldbegreen,asshowninFigure26ifnot,correctanyissues.
Whenallissueshavebeenresolved,runthesamecommandasbeforeexceptdonotusetheDparameter:
./deploycluster.pyuadminMrac.?Nutils/netconfig12cRAC4node.iniPutils/params12c.ini
YouwillbeaskedforapassworduseWelcome1.

ChangethedefaulttimeoutforVNCconsoles(settingitto300secondsinsteadof30seconds)byrunningthefollowingcommands.
Note:WhenopeningaVNCconsoleforanOracleVMguestforthefirsttime,thereareseveralwarningsaboutsecurity.Itcantakemorethan30
secondstoreadthemandclosethewindows.
#sshroot@192.168.56.3
#cd/u01/app/oracle/ovmmanager3/ovm_utils
#./ovm_managercontroluadminpWelcome1hlocalhostT300csetsessiontimeout300
IntheOracleVMManagerGUI,checkthatallVMsarerunningandopenaconsoleonVMrac.0byselectingtheVMandclicking

Figure27.CheckingtheVMsandopeningaconsole.
ItispossibletomonitortheprogressoftheclusterinstallationbyusingsshtoconnecttothefirstVM(rac.0)andlookingat
/u01/racovm/buildcluster.log.Thislogfilewillcontaininformationforallcommandsexecutedinverbosemode,soyoucanseethevarious
toolssuchasclone.pl,netca,andemcathatareexecutedandtheiroutput.Todothis,performthefollowingsteps.
WaitfortheloginpromptonVMrac.0.
ConnecttoVMrac.0usingssh(asdefinedinthenetconfig12cRAC4node.inifile,theIPaddressofthatVMis192.168.56.10):
Note:Thepasswordisovsroot.
sshroot@192.168.56.10
Checktheprogressofthebuildclusteroperationinthe/u01/racovm/buildcluster.loglogfile:
tailf/u01/racovm/buildcluster.log
Summary
Congratulations!Youhavecompletedthislab.
Asyoucansee,weareprettymuchatthelimitofwhatwecanachievewitha"small"x86machine.Aslongasthebuildclusteroperationis
progressingoneachnode,accesstotheVMswillbequiteslow.Becauseofseveralresourcelimitationsonthex86machine(CPU,diskaccess,
andnetworkbandwidth),youwillnotbeabletoseetheendofthedeploymentduringthislabsession.However,usingsimilarinstructions,youcan
createatwonodeclusterorevenasingleinstanceclusterthatwillneedfewerresourcesthanafournodeOracleRACcluster.

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

21/22

04/03/2016

HowToDeploya4NodeRACClusterUsingOracleVMTemplates

AppendixA:OracleFlexASMandFlexCluster

AboutOracleFlexASM
InatypicalOracleGridInfrastructureinstallation,eachnodewillhaveitsownASMinstancerunningandactasthestoragecontainerforthe
databasesrunningonthenode.Thereisasinglepointoffailurethreatwiththissetup.Forexample,iftheASMinstanceonthenodesuffersor
fails,allthedatabasesandinstancesrunningonthenodewillbeimpacted.
ToavoidasinglepointoffailurefortheASMinstance,OracleDatabase12cprovidestheOracleFlexASMfeature.OracleFlexASMisadifferent
conceptandarchitecturealltogether.OnlyafewASMinstancesneedtorunonagroupofserversinthecluster.WhenanASMinstancefailsona
node,OracleClusterwareautomaticallystartsreviving(replacing)theASMinstanceonadifferentnodetomaintainavailability.Inaddition,this
setupalsoprovidesloadbalancingcapabilitiesforASMinstancesrunningonthenode.AnotheradvantageofOracleFlexASMisthatitcanbe
configuredonaseparatenode.

Figure28.OracleFlexASM.

AboutFlexCluster
OracleDatabase12csupportstwotypesofclusterconfigurationsatthetimeofOracleClusterwareinstallation:atraditional,standardclusteranda
FlexCluster.
Inatraditional,standardcluster,allnodesintheclusteraretightlyintegratedwitheachother,interactthroughaprivatenetwork,andcanaccess
thestoragedirectly.Ontheotherhand,aFlexClusterintroducestwotypesofnodesarrangedinahubandleafnodesarchitecture.Thehub
nodesarearrangedsimilartonodesinatraditionalstandardclusterthatis,theyareinterconnectedthroughaprivatenetworkandhavedirect
read/writeaccesstothestorage.Theleafnodesaredifferentfromthehubnodes.Theydon'tneedtohavedirectaccesstotheunderlyingstorage
rathertheyaccessthestorageanddatathroughhubnodes.
Youcanconfigureupto64hubnodes,andmanyleafnodes.InaFlexCluster,youcanhavehubnodeswithouthavingleafnodesconfigured,but
noleafnodescanexistwithouthubnodes.Youcanconfiguremultipleleafnodestoasinglehubnode.InaFlexCluster,onlyhubnodeswillhave
directaccesstotheOracleClusterRegistryandvotingdisks.Whenyouplanlargescaleclusterenvironments,FlexClusterwouldbeagreat
featuretouse.Thissortofsetupgreatlyreducesinterconnecttrafficandprovidesroomtoscaleuptheclustertothetraditional,standardcluster.
SeeAlso
OracleVMdocumentation
OracleVMTemplatedocumentationforOracleDatabaseandOracleRAC
AbouttheAuthor
OlivierCanongeisasystemssalesconsultantforOracleinFrance.
Acknowledgments
SpecialthankstoChristophePauliat,SimonCoter,SaarMaoz,DoanNguyen,LudovicSorriaux,CecileNaud,andRobbieDeMeyerfortheir
contributions.

Revision1.0,01/10/2014
Followus:
Blog|Facebook|Twitter|YouTube

Emailthispage

PrinterView

ORACLECLOUD
LearnAboutOracleCloud
Computing
GetaFreeTrial
LearnAboutDaaS
LearnAboutSaaS
LearnAboutPaaS
LearnAboutIaaS
LearnAboutPrivateCloud
LearnAboutManagedCloud

JAVA
LearnAboutJava
DownloadJavaforConsumers
DownloadJavaforDevelopers
JavaResourcesforDevelopers
JavaCloudService
JavaMagazine

CUSTOMERSANDEVENTS
ExploreandReadCustomer
Stories
AllOracleEvents
OracleOpenWorld
JavaOne
EMAILSUBSCRIPTIONS
SubscribetoOracle
Communications
SubscriptionCenter

COMMUNITIES
Blogs
DiscussionForums
Wikis

SERVICESANDSTORE
LogIntoMyOracleSupport
TrainingandCertification
BecomeaPartner

OracleACEs
UserGroups
SocialMediaChannels

FindaPartnerSolution
PurchasefromtheOracleStore
CONTACTANDCHAT
Sales:+1.800.633.0738
GlobalContacts
OracleSupport
PartnerSupport

Subscribe Careers ContactUs SiteMaps LegalNotices TermsofUse Privacy CookiePreferences OracleMobile

http://www.oracle.com/technetwork/systems/handsonlabs/deployracovmcluster2101019.html

22/22