US008527473B1

(12) United States Patent

Brown et a].

(10) Patent N0.: (45) Date of Patent:

(56)

US 8,527,473 B1
Sep. 3, 2013

(54)

IDENTIFYING DATABASE REQUEST

SOURCES IN MULTI-DATABASE SYSTEMS

References Cited
U.S. PATENT DOCUMENTS

(75) Inventors: Douglas P. Brown, Rancho Santa Fe,

CA (US); John Mark Morris, San

7,774,329 B1 *

8/2010

Peddy et a1. ................ .. 707/705

2007/0203910 2009/0144344 2004/0225911 A1 *

11/2004 6/2009 8/2007

Ferguson McBride Smith et et a1. a1. ............ .. .. 707/204

Diego, CA (US); Anita Richards, San Juan Capistrano, CA (US)

* cited by examiner
Primary Examiner * Rehana Perveen
Assistant Examiner * Raheem Hof?er

(73) Assignee: Teradata US, Inc., Dayton, OH (US) (*)

Notice:

(74) Attorney, Agent, or Firm * Howard Speight

Subject to any disclaimer, the term of this patent is extended or adjusted under 35

(57)

ABSTRACT

USC 154(b) by 898 days.

Recovering from a failure of a soon-to-fail database system among a plurality of database systems in a multi-database system in processing a request submitted to the multi-data

(21) App1.No.: 12/344,991 (22)

Filed:

base system through a multi-database system session is accomplished. A query band is created for the request. The
query band is de?ned to be an identi?er that uniquely identi

Dec. 29, 2008

?es the session and the request among the plurality of sessions

and plurality of requests being processed by the multi-data

base system at the time that the request Was submitted. The query band is attached to a transaction issued by the multi database system to the soon-to-fail database system to execute the query. The status concerning execution of the

Related US. Application Data

(63) Continuation-in-part of application No. 11/254,374,

?led on Oct. 20, 2005, noW Pat. No. 8,280,867.

transaction is reported by the soon-to-fail database system.

The status includes the query band. The status is logged. The failure of the soon-to-fail database system is detected. The state of the soon-to-fail database system is reconstructed from the logged status as the state related to the processing of the transaction using the query band. The reconstructed state is used to continue processing of the transaction by an altema tive database system. The alternative database system is one

(51) (52) (58)

Int. Cl.

G06F 7/00 G06F 17/00

US. Cl.

(2006.01) (2006.01)

USPC .......................... .. 707/682; 707/685; 707/675

Field of Classi?cation Search None

See application ?le for complete search history.

of the plurality of database systems in the multi-database system. The request is processed to produce a result and the result is stored. 21 Claims, 43 Drawing Sheets

CLIENT
SYSTEM

r140
135 100

MAINERAME
:
-

/
I
I

PARSING ______________________________ /130

ENGINE
115

i
-

I
i

Ii
I

f
f 1101
PROCESSING

I
MODULE

f 1102
PROCESSING

f 1103
PROCESSING

f IION Ig
_ , . _ PROCESSING

Ql8DES I 52 0
-

I
'

MODULE

MODULE

MODULE

;
i

E'
I

1201

1202

1203
Q I I I

120M lI
|

i
I

1251

1252

1253

1252 E

US. Patent

Sep. 3, 2013

Sheet 3 0f 43

US 8,527,473 B1

WORKLOAD PROFILE

PERFORMANCE TUNING

CAPACITY PLANNING

WORKLOAD RULES

K_ REGULATOR 1 /

415

US. Patent

Sep. 3, 2013

Sheet 4 0f 43

US 8,527,473 B1

FIG. 5
ADMINISTRATOR

K 405
505

QUERY LOG

/515 GUIDANCE
GUIDE FOR CREATION OF WORKLOAD RULES

EXCEPT. LOG/OUEUE

WORKLOAD RULES

(INCLUDING SLGs)

US. Patent

Sep. 3,2013

Sheet 5 0f 43

US 8,527,473 B1

FIG. 6
REGULATOR

415

409

REQUESTS WORKLOAD

605A
MN

J
ASSIGNED

RULES
REQUESTS

ASSIGNNIENT 0F REQUESTS TO WORKLOAD GROUPS AND PRIORITY CLASSES

WORKLOAD QUERY <

(DELAY) MANAGER
620b 6200 WORKGROUP PEREORNIANCE
WORKLOAD

620a

/
' '

6208

AGAINST
RULES

PRIORITY CLASSES
REQUEST PROCESSOR I

r)
lTl\l _lF loRLl{l(liAi-Tg
UNOER CONTROL OF

j
EXCEPTION

PRQEEII'EI 1$$HEgJJLER I ) 525

ALLOCATION
ADJUSTMENTS

REGINA

NIONITOR T 615

PROCESSING
630

US. Patent

Sep. 3, 2013

Sheet 6 0f 43

US 8,527,473 B1

FIG. 7
wDRKLDAD QUERY

(DELAY) MANAGER

/ 610

ASSIGNED REQUEST

COMPARATOR FOR

705

WORKGROUP
ZEQIFIQSNANCE
WORKLOAD

DETERMINING IF REQUEST
SHOULD BE QUEUED 0R RELEASED FOR EXECUTION

RULES
409

QUEUED REQUEST

WORKLOAD

710/ RELEASED REQUEST

V J 715
DISPATCHER OF REQUESTS T0 PRIORITY cLASSES

620a] 62gb
I_| \_J

650s
l__| ' ' '

620s
|_|

US. Patent

Sep. 3, 2013

Sheet 7 0f 43

US 8,527,473 B1

FIG. 8
EXCEPTION MONITOR

f 615
W O R K LOAD DH U L E S

THROUGHPUT INFORMATION
|
|

l I

WORKLOAD

-+-)

WORKLOAD PERFORMANCE ; PERFORMANCE TO WORKLOAD RULES r>AGAlNST COMPARATOR WORKLOAD RULES

PERFORMANCE GOAL INDEX

(PGI) FOR EACH

WORKGROUP CALCULATOR
EXCEPT.
SYSTEM RESOURCE ALLOCATION TO REDUCE MAX PGI CALCULATOR

LOG/QUEUE

Y
SYSTEM RESOURCE ALLOCATION ADJUSTMENTS

US. Patent

Sep. 3, 2013

Sheet 8 0f 43

US 8,527,473 B1

24Mm3Uh.-oOwHxm8sB

US. Patent

Sep. 3, 2013

Sheet 14 0f 43

US 8,527,473 B1

A # _

259 85:51aSE2\8
2 5 8 E 3 6 5 0 2 M 5 8 E % I ; \E2m9aE
AM 82

2 4 8 51 0@S: 2 5;A|J zoEwe_m

\M586

M $ 9 A

5Em6s4z0:./2a58u 59ESO26MQD:X;9ESV

% 6E 2

+ E5381%

52:%8:

US. Patent

Sep. 3, 2013

Sheet 15 0f 43

US 8,527,473 B1

FIG. 16
REQUEST DETAILS

K515
/1605

16101
GIvE DBA:

i
REVISED WD

- SNAPSHOT OF SYSTEM USAGE AGGREGATING

ON, E.G., ACCOUNTS, APPLICATIONS. ETC.

- MAPPING OF EXISTING WD-LIKE DEFINITIONS

T0 WDS
- EXISTING WDS

CLASSIFICATIONS
505 510 AND EXCEPTION CRITERIA

OuERY LOG

EXCEPT. LOG/OuEuE

F
1615
WD

[1635
CLASSIF.
OK '2
Y

SPLIT/MERGE

J 1 6 20

DEFINE SLGS FOR WDS

r1625

DEFlNE PSF SETTINGS FOR WDS

US. Patent

Sep. 3, 2013

Sheet 16 0f 43

US 8,527,473 B1

FIG. 18
AFTER MERGE

FIG. 19
AFTER SPLIT

US. Patent

Sep. 3, 2013

Sheet 17 0f 43

US 8,527,473 B1

[- 635
FIG. 20

+ f2005
MERGE 0R SPLIT FOR

ACCOUNTING PURPOSES
505

2015 QUERY LOG EXCEPT. LOG/QUEUE

r 2020
LOOK FOR CLUSTERS OF REQUESTS WITHlN WDS BASED

ON WHO, WHAT, WHERE

yr

r2025

SPLIT BY CHOSEN CLUSTERS

US. Patent

Sep. 3, 2013

Sheet 18 0f 43

US 8,527,473 B1

FIG. 21

/12
f2105
MAP REQUEST WHO, WHAT,
WHERE INFO INTO N-GRID

QUERY LOG
505

EXCEPT. LOG/QUEUE
510
_______ "I

2115]
LET DBA DEFINE CLUSTERS

i {2110
FIND CLUSTERS OF REQUESTS WITH LEAST IN COMMON WITH OTHER GROUPS OF REQUESTS

US. Patent

Sep. 3, 2013

Sheet 19 0f 43

US 8,527,473 B1

FIG. 22

[- 620

r2205
PROVIDE HISTORICAL

THROUGHPUT, RESPONSE TIME, AND DEFAULTS (E.G. 95TH PERCENTILE WITH 25% BOOST)
QUERY LOG 505 EXCEPT. LOG/OUEUE 510
AS A STARTING POINT

PERFORMANCE, E.G.,

r2210

LET DBA DEFINE AND REFINE SLGS WITH LIMITS

I
FIG. 23

625

r2305
SUGGEST PSF SETTINGS EXCEPTION ACTIONS AND DELAY RLILES

OUERY LOG
505

EXCEPT. LOG/OUEUE

I
LET DBA ADJUST

[2310