Our Rela Life Experience of A Successful 11gr2 Upgrade

Our real life experience of a
successful 11gR2 upgrade

Who we are? What do we do?
Financial Shared Services a division of the Dept. of Justice & Equality
9 Client Organisations (D/Justice & Equality, D/Taoiseach, D/Arts, Heritage &

Gaeltacht, Garda Sochna, Prison Service, Courts Service, Property Registration
Authority, National Museum and National Library)
Client Budgets of 2.6 billion
1,115,000 salary payments in 2011
111,800 pension payments in 2011
490,000 general payments (invoices, expenses, fees, grants) in 2011 on Oracle
Financials
Oracle Financials 5,000 users nationwide, 30,000 Supplier accounts

2

Department of Justice
and Law Reform
An Garda Sochna

Deirdre Experience
FSS IT since 1997
BSc (Computer Science) Trinity College Dublin

Working with Oracle Financials since 2000
Senior DBA since 2005

FSS & Oracle Financials History
2000 - 11.0.3 / 8.0.3

2002 - 11.5.9 / 9.2.0.5
2006 - 11.5.10.2
2009 - 9.2.0.8
2010 - OATM/ Hardware Replatform
2011 - 11.2.0.2 and a whole lot more!
TBC - R12?

http://www.oracle.com/us/support/library/lifetime-support-technology-069183.pdf


How we benefited from being a Reference Site
Locally held workshops
11g New Features workshop; Managing Oracle Database 11g with Grid Control
Direct access to Oracle database upgrade expert

Mike Dietrich
Issue resolution
Assistance with SRs
Patch release dates

Advised of latest Opatch
8

Diagnostic & Tuning Pack

9

10

11

Doc 881505.1 : Interoperablility Notes
Oracle Applications Release 11i with
Oracle 11g Release 2 (11.2.0)
Doc 883202.1 : Patch Requirements for
Extended Support of Oracle E-Business
Suite Release 11.5.10
https://blogs.oracle.com/upgrade/
12

What we upgraded?
Oracle Developer 6i (6.0.8.28.0 (patchset 19)

ATG Rollup Patchset (ATG_PF.H.RUP7)
Browser Java Plug-in (SunJRE 1.6.0_23)
JDK 6.0 SR2
Oracle Application Server (iAS 1.0.2.2.2 (rollup 5)
Oracle Discoverer (10.1.2.55.26)
Oracle RDBMS (11.2.0.2)
13

14

Oracle Service Requests
120
Number of SRs
100
80
58
Issue
60
Query
40
20
50
32
4
0
Investigation & Testing
Go-Live Weekend &

Issues
31
0
Production SRs during
Project
Phase
15

Component Test
Assembly Test
Technical Test
Integration Tests (including Fix Phase)
UAT
Performance Indicator Test
16

Testing issues:
An error page intermittently displayed when reviewing
expense claims.
Issues occurred in the Workflow tools
Concurrent request submission screen
Customizations had to be re-applied
17

18

19

20

21

22

23

Thursday June 9th 2011
24

Ciaran Experience
9 years working in IT full time
Started Career as Programmer

Moved to Windows & Unix Sysadmin
Web Development
Started in FSS as OA DBA August 2009
25

Steps done in advance of upgrade

Before the Upgrade Weekend
Roll out and Testing of JRE to FSS and Client Orgs
Roll out of New FSS Desktop
Advised to Keep 32 days of Statspack reports
Weekend Before Upgrade
Apply AIX TL11 to satisfy AIX dependencies.
AIX Kernel Parameters
JDK 6.0 SR2 32 Bit
Increase Page Space on DB Node
Install & Patch 11gR2 Home
Install & Patch Oracle Application Server 10g Release 2
Install & Patch Oracle BI 10g Release 2
26

27

Upgrade Day Thursday 9th June 2011
Advised to export Perfstat schema before upgrade.

Advised to export COECBOSTATS schema.
We exported our Discoverer 4i EUL.
Upgraded the Release 4.1 EUL
Ran Remote Diagnostic Agent(RDA)
Gathered Stats on the System Schema
System Downtime Start 5pm
Shutdown Production.
Confirmed that last Redo Log has been applied to DR
Disabled archive log mode on Prod.
Backed up Two Nodes of Production
28

Patching the Apps Tier
Implementation Plan Budgeted for 17.5 hours of patching

Two person team, one for each node.
Developer Patch Set 19
Convert to using JRE
ATG Rollup 7
Update Apps Tier to use JDK 6.
Oracle Applications Discoverer 10g interop patches
11g Interoperability patches
Patches to fix Integration testing Issues
Post patching adadmin Tasks
DBA Verification Test
Patching Actually took 11hours. A time saving of 37%
Environment Shutdown and Backup Number 2 started.
29

Pre Database Upgrade Tasks
Executed Root.sh
Created NLS 9i data dir
Fix issues identified by Sanity Checks and Testing
Advised to drop RAC component from DB
Executed the Pre-Upgrade information Tool - utlu112i
Create the new 11g listener
Set the pre-requisite 11g environment information.
30

The Database Upgrade
31

The Database Upgrade
32

The Database Upgrade - Failure 1.
ORA-29553: class in use: SYS.javax/mail/Folder

ORA-06512: at "SYS.INITJVMAUX", line 23
ORA-06512: at line 5
33

The Database Upgrade - Raised a P1 SR.
34

35

The Database Upgrade - Raised a P1 SR.
36

The Database Upgrade Followed ODM Action Plan
dbua -initParam "memory_target"=900M
37

The Database Upgrade - Failure 2.
ORA-00838: SPECIFIED value of MEMORY_TARGET is too

small, needs to be at least 4224M
ORA-01708: failure in processing system parameters
38

39

The Database Upgrade - Third Time Lucky?
dbua initParam "_kghdsidx_count"=1
40

The Database Upgrade Success.
41

The Database Upgrade - Post DBUA tasks
Gather Fixed Object Stats 2 mins
Recompile Invalid Objects 5 hrs 54 mins
Upgrade Time Zone 3 mins
42

Post Database Upgrade tasks.
Upgrade Stats Tables Created by the DBMS_STATS Package

Modify initialization parameters
Install Oracle Data Mining and OLAP
Fix Korean lexers
Run adgrants.sql
Grant create procedure privilege on CTXSYS
Set CTXSYS parameter
Implement and run AutoConfig
Gather statistics for SYS schema
Re-create grants and synonyms
Confirm system environment variables
43

October CPU.
Fix defective version of share.zip shipped in Developer 6i P19

Four patches applied using adpatch
Post patching adadmin tasks
DBA Verification Test
Systems Dev Verification and Fix Implementation.
44

Production Readiness Tasks
Configure archivelog mode

Backup number 3
Implement Dataguard.
Implement Reporting Database.
Upgrade Discoverer EUL.
45

Summary
Backups Important
Faced a real situation where we had to roll backup
Times will vary from test to production
In our case Production is significantly more powerful than test
Even with two DBUA failures we clawed back the time
Instead of task based upgrades switch to time based
Reasons for Success
Prep work and Investigation

Extensive testing
Reference site with access to Oracle Experts
Dedication of both the DBA and Systems Development teams
46

Doc 883202.1 : Patch Requirements for Extended Support of Oracle
E-Business Suite Release 11.5.10
Doc 881505.1 : Interoperablility Notes Oracle Applications Release
11i with Oracle 11g Release 2 (11.2.0)
Doc 785351.1 : Oracle 11gR2 Upgrade Companion
E17222-04 : Oracle Database Upgrade Guide 11g Release 2 (11.2)
Doc 837570.1 : Complete Checklist for Manual Upgrades to 11gR2
Doc 421191.1 : Complete checklist for manual upgrades of Oracle
databases from any version to any version on any platform
47

Your test results might be not very helpful if your test

system is heavily undersized
But at least having a poor test system is much better
than having no test system at all..
https://blogs.oracle.com/UPGRADE/OOW_7Flavors_TuttiFrutti[1].pdf
48

Contact Details
Deirdre ODowd
dodowd@justice.ie
Ciaran OSullivan
cgosullivan@justice.ie
http://ie.linkedin.com/in/suilamhain
49

50

Our Rela Life Experience of A Successful 11gr2 Upgrade

Încărcat de

Informații document

Titlu original

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

Our Rela Life Experience of A Successful 11gr2 Upgrade

Încărcat de

Drepturi de autor:

Formate disponibile

Our real life experience of a

successful 11gR2 upgrade

Our real life experience of a

Who we are? What do we do?

Financial Shared Services a division of the Dept. of Justice & Equality

9 Client Organisations (D/Justice & Equality, D/Taoiseach, D/Arts, Heritage &

Client Budgets of 2.6 billion

1,115,000 salary payments in 2011

111,800 pension payments in 2011

490,000 general payments (invoices, expenses, fees, grants) in 2011 on Oracle

Oracle Financials 5,000 users nationwide, 30,000 Supplier accounts

Our real life experience of a

Our real life experience of a

BSc (Computer Science) Trinity College Dublin

Senior DBA since 2005

Our real life experience of a

2000 - 11.0.3 / 8.0.3

Our real life experience of a

Our real life experience of a

Our real life experience of a

Direct access to Oracle database upgrade expert

Patch release dates

Our real life experience of a

Diagnostic & Tuning Pack

Our real life experience of a

Our real life experience of a

Our real life experience of a

Our real life experience of a

Oracle Developer 6i (6.0.8.28.0 (patchset 19)

Our real life experience of a

Our real life experience of a

Go-Live Weekend &

Our real life experience of a

Our real life experience of a

Our real life experience of a

Our real life experience of a

Our real life experience of a

Our real life experience of a

Our real life experience of a

Our real life experience of a

Our real life experience of a

Thursday June 9th 2011

Our real life experience of a

Started Career as Programmer

Our real life experience of a

Steps done in advance of upgrade

Our real life experience of a

Our real life experience of a

Advised to export Perfstat schema before upgrade.

System Downtime Start 5pm

Our real life experience of a

Implementation Plan Budgeted for 17.5 hours of patching

Our real life experience of a

Our real life experience of a

Our real life experience of a

Our real life experience of a

ORA-29553: class in use: SYS.javax/mail/Folder

Our real life experience of a

Our real life experience of a

Our real life experience of a

Our real life experience of a

dbua -initParam "memory_target"=900M

Our real life experience of a